2024-09-05T17:16:39.840 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-05T17:16:39.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T17:16:39.934 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094 branch: main description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} email: ceph-qa@ceph.com first_in_suite: false job_id: '7888094' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: rbd cache: true rbd cache max dirty: 0 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: b0d82736d7e74c3301ced0a9a1f1715342226ca2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: b0d82736d7e74c3301ced0a9a1f1715342226ca2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: bba65b233b90d20d9ab694d2201126759501459c owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 3321 sha1: b0d82736d7e74c3301ced0a9a1f1715342226ca2 sleep_before_teardown: 0 subset: 62/128 suite: rbd suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_bba65b233b90d20d9ab694d2201126759501459c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: bba65b233b90d20d9ab694d2201126759501459c targets: smithi050.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDihWcWz01nw4U8p6giJTf/TR3XCC8R5FFWh5mleVvN4IN0OF4iEywZffmOmIVnPWnLChp0BgBKuV9cNj2gs0Jw= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNBh4HronDqgiVsaM+BQe3p6hKjnjAd7Lij4E0+Mo/DxdsJzZcUWkXZ302mc66HV6hcHwXj8wF/Or9V5Y8iSTik= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-03_20:16:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-05T17:16:39.934 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_bba65b233b90d20d9ab694d2201126759501459c/qa; will attempt to use it 2024-09-05T17:16:39.935 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_bba65b233b90d20d9ab694d2201126759501459c/qa/tasks 2024-09-05T17:16:39.935 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-05T17:16:39.936 INFO:teuthology.task.internal:Checking packages... 2024-09-05T17:16:39.958 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b0d82736d7e74c3301ced0a9a1f1715342226ca2' 2024-09-05T17:16:39.958 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-05T17:16:39.958 INFO:teuthology.packaging:ref: None 2024-09-05T17:16:39.958 INFO:teuthology.packaging:tag: None 2024-09-05T17:16:39.959 INFO:teuthology.packaging:branch: main 2024-09-05T17:16:39.959 INFO:teuthology.packaging:sha1: b0d82736d7e74c3301ced0a9a1f1715342226ca2 2024-09-05T17:16:39.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-05T17:16:40.208 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4702-g4dc4e366-1jammy 2024-09-05T17:16:40.210 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-05T17:16:40.215 INFO:teuthology.task.internal:no buildpackages task found 2024-09-05T17:16:40.215 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-05T17:16:40.231 INFO:teuthology.task.internal:Saving configuration 2024-09-05T17:16:40.244 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-05T17:16:40.250 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-05T17:16:40.270 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 17:11:05.678648', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGKqp/bSSZZO82IpY1Rjy7K4FAuu8ZeSPZsN877dwCeK'} 2024-09-05T17:16:40.292 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 17:11:05.676854', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDY+zbWgRdouXQf0AgnoUZ/4KHFGm2m5TftrEQepkRN1'} 2024-09-05T17:16:40.292 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-05T17:16:40.298 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-05T17:16:40.298 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-05T17:16:40.298 INFO:teuthology.run_tasks:Running task console_log... 2024-09-05T17:16:40.350 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ba121b400>, signals=[15]) 2024-09-05T17:16:40.350 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-05T17:16:40.355 INFO:teuthology.task.internal:Opening connections... 2024-09-05T17:16:40.355 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:16:40.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:16:40.439 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:16:40.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:16:40.516 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-05T17:16:40.522 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-09-05T17:16:40.527 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-09-05T17:16:40.527 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-09-05T17:16:40.572 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Ubuntu" 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="22.04" 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_CODENAME=jammy 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:ID=ubuntu 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE=debian 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-05T17:16:40.573 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-05T17:16:40.574 INFO:teuthology.orchestra.run.smithi050.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-05T17:16:40.574 INFO:teuthology.orchestra.run.smithi050.stdout:UBUNTU_CODENAME=jammy 2024-09-05T17:16:40.574 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-09-05T17:16:40.595 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-09-05T17:16:40.600 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-09-05T17:16:40.600 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-05T17:16:40.652 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-05T17:16:40.653 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-05T17:16:40.653 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-05T17:16:40.653 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2024-09-05T17:16:40.653 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-09-05T17:16:40.678 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-05T17:16:40.686 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-05T17:16:40.691 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-05T17:16:40.691 DEBUG:teuthology.orchestra.run.smithi050:> test '!' -e /home/ubuntu/cephtest 2024-09-05T17:16:40.693 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-09-05T17:16:40.701 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-05T17:16:40.706 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-05T17:16:40.707 DEBUG:teuthology.orchestra.run.smithi050:> test -z $(ls -A /var/lib/ceph) 2024-09-05T17:16:40.738 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-09-05T17:16:40.759 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-05T17:16:40.815 INFO:teuthology.run_tasks:Running task kernel... 2024-09-05T17:16:40.829 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-05T17:16:40.829 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-05T17:16:40.830 DEBUG:teuthology.orchestra.run.smithi050:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T17:16:40.830 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T17:16:40.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:16:40.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:16:40.835 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-05T17:16:40.836 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-05T17:16:40.880 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-56-generic 2024-09-05T17:16:40.881 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.15.0-56-generic 2024-09-05T17:16:40.881 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-09-05T17:16:40.882 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-56-generic 2024-09-05T17:16:40.882 INFO:teuthology.task.kernel:Running kernel on smithi050: 5.15.0-56-generic 2024-09-05T17:16:40.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-09-05T17:16:41.006 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-09-05T17:16:41.012 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-05T17:16:41.162 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T17:16:41.169 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-05T17:16:41.169 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-05T17:16:41.238 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-05T17:16:41.294 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T17:16:41.294 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-05T17:16:41.354 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-05T17:16:41.387 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-05T17:16:41.470 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-05T17:16:41.488 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-05T17:16:41.492 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-05T17:16:41.495 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-05T17:16:41.495 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-05T17:16:41.515 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-05T17:16:41.516 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-05T17:16:41.525 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-05T17:16:41.525 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-05T17:16:41.530 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-05T17:16:41.535 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-05T17:16:41.537 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-05T17:16:41.537 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-05T17:16:41.537 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-05T17:16:41.546 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-05T17:16:41.566 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-05T17:16:41.566 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-05T17:16:41.570 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-05T17:16:41.573 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-05T17:16:41.573 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-05T17:16:41.574 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-05T17:16:41.592 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-05T17:16:41.595 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-05T17:16:41.595 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-05T17:16:41.602 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-05T17:16:41.609 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-05T17:16:41.611 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-05T17:16:41.612 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-05T17:16:41.612 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-05T17:16:41.612 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-05T17:16:41.627 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-05T17:16:41.627 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-05T17:16:41.628 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-05T17:16:41.628 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-05T17:16:41.641 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-05T17:16:41.642 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-05T17:16:41.642 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-05T17:16:41.642 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-05T17:16:41.658 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-05T17:16:41.708 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-05T17:16:41.729 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-05T17:16:41.846 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-05T17:16:42.037 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-05T17:16:42.161 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-05T17:16:42.196 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-05T17:16:42.208 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-05T17:16:42.210 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-05T17:16:42.211 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-05T17:16:42.220 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-05T17:16:42.221 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-05T17:16:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-05T17:16:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-05T17:16:42.296 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-05T17:16:42.297 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-05T17:16:42.315 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-05T17:16:42.316 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-05T17:16:42.318 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-05T17:16:42.325 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-05T17:16:42.325 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-05T17:16:42.338 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-05T17:16:42.347 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-05T17:16:42.353 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-05T17:16:42.354 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-05T17:16:42.355 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-05T17:16:42.366 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-05T17:16:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-05T17:16:42.396 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-05T17:16:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-05T17:16:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-05T17:16:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-05T17:16:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-05T17:16:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-05T17:16:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-05T17:16:42.453 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-05T17:16:42.453 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-05T17:16:42.486 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-05T17:16:42.487 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-05T17:16:42.487 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-05T17:16:42.488 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-05T17:16:42.489 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-05T17:16:48.188 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 15.8 MB in 2s (7,092 kB/s) 2024-09-05T17:16:48.635 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 15.8 MB in 3s (5,718 kB/s) 2024-09-05T17:16:49.669 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-05T17:16:49.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-05T17:16:49.755 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-05T17:16:49.970 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-05T17:16:49.971 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-05T17:16:50.037 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-05T17:16:50.054 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-05T17:16:50.108 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-05T17:16:50.164 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T17:16:50.164 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T17:16:50.164 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T17:16:50.164 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T17:16:50.165 INFO:teuthology.orchestra.run.smithi050.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-05T17:16:50.165 INFO:teuthology.orchestra.run.smithi050.stdout: python2.7-minimal 2024-09-05T17:16:50.165 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T17:16:50.166 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-09-05T17:16:50.166 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-05T17:16:50.166 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-05T17:16:50.167 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-05T17:16:50.168 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-09-05T17:16:50.168 INFO:teuthology.orchestra.run.smithi050.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-05T17:16:50.169 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-09-05T17:16:50.169 INFO:teuthology.orchestra.run.smithi050.stdout: thermald 2024-09-05T17:16:50.220 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-09-05T17:16:50.220 INFO:teuthology.orchestra.run.smithi050.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-05T17:16:50.220 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-05T17:16:50.221 INFO:teuthology.orchestra.run.smithi050.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-05T17:16:50.222 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages will be upgraded: 2024-09-05T17:16:50.223 INFO:teuthology.orchestra.run.smithi050.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-05T17:16:50.297 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-09-05T17:16:50.297 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-09-05T17:16:50.324 INFO:teuthology.orchestra.run.smithi050.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-05T17:16:50.324 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 113 MB of archives. 2024-09-05T17:16:50.324 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-05T17:16:50.325 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-05T17:16:50.462 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T17:16:50.462 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T17:16:50.462 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T17:16:50.463 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T17:16:50.463 INFO:teuthology.orchestra.run.smithi110.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-05T17:16:50.463 INFO:teuthology.orchestra.run.smithi110.stdout: python2.7-minimal 2024-09-05T17:16:50.463 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T17:16:50.464 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-09-05T17:16:50.464 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-05T17:16:50.464 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-05T17:16:50.465 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-05T17:16:50.466 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-09-05T17:16:50.466 INFO:teuthology.orchestra.run.smithi110.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-05T17:16:50.466 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-09-05T17:16:50.466 INFO:teuthology.orchestra.run.smithi110.stdout: thermald 2024-09-05T17:16:50.523 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-09-05T17:16:50.523 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-05T17:16:50.523 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-05T17:16:50.524 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-05T17:16:50.525 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-09-05T17:16:50.526 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-05T17:16:50.707 INFO:teuthology.orchestra.run.smithi110.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-05T17:16:50.707 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 113 MB of archives. 2024-09-05T17:16:50.707 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-05T17:16:50.707 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-05T17:16:50.781 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-05T17:16:50.894 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-05T17:16:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-05T17:16:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-05T17:16:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-05T17:16:51.847 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-05T17:16:51.870 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-05T17:16:52.093 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-05T17:16:52.281 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 113 MB in 2s (69.2 MB/s) 2024-09-05T17:16:52.429 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-05T17:16:52.487 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-05T17:16:54.531 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-05T17:16:54.536 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T17:16:54.648 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-05T17:16:54.648 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-05T17:16:54.649 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-05T17:16:54.703 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:16:55.065 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-05T17:16:55.120 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-05T17:16:55.507 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-09-05T17:16:55.675 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-05T17:16:57.180 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-05T17:16:57.201 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T17:16:57.317 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:16:57.659 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-05T17:16:57.664 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T17:16:57.699 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-05T17:16:57.720 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T17:16:57.731 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:16:57.749 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:00.084 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-05T17:17:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T17:17:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:00.637 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-05T17:17:00.657 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T17:17:00.695 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:03.616 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T17:17:03.742 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T17:17:04.067 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T17:17:04.171 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T17:17:04.465 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-05T17:17:04.488 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-05T17:17:04.532 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-05T17:17:06.507 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T17:17:06.609 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T17:17:06.917 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T17:17:07.038 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T17:17:07.325 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-05T17:17:07.347 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-05T17:17:07.391 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-05T17:17:10.532 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-05T17:17:10.569 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T17:17:10.606 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:12.988 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-05T17:17:13.007 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-05T17:17:13.046 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:13.318 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T17:17:13.442 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T17:17:13.734 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-05T17:17:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:13.981 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-05T17:17:14.110 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:15.446 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-05T17:17:15.446 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-05T17:17:15.446 INFO:teuthology.orchestra.run.smithi050.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-05T17:17:15.446 INFO:teuthology.orchestra.run.smithi050.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-05T17:17:15.595 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:15.612 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-05T17:17:15.735 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-05T17:17:16.084 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-05T17:17:16.206 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:16.332 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-05T17:17:16.470 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:17.464 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:17.791 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-05T17:17:17.791 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-05T17:17:17.791 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-05T17:17:17.791 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-05T17:17:17.962 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:18.890 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-05T17:17:19.016 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-05T17:17:19.142 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:19.212 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-05T17:17:19.212 INFO:teuthology.orchestra.run.smithi050.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-05T17:17:19.349 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:20.725 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-05T17:17:20.851 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-05T17:17:20.978 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-05T17:17:21.048 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-05T17:17:21.048 INFO:teuthology.orchestra.run.smithi110.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-05T17:17:33.804 INFO:teuthology.orchestra.run.smithi050.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-05T17:17:33.804 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub' 2024-09-05T17:17:33.814 INFO:teuthology.orchestra.run.smithi050.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-05T17:17:33.833 INFO:teuthology.orchestra.run.smithi050.stdout:Generating grub configuration file ... 2024-09-05T17:17:34.209 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-05T17:17:34.222 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-05T17:17:34.578 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-05T17:17:34.583 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-05T17:17:34.657 INFO:teuthology.orchestra.run.smithi050.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-05T17:17:34.663 INFO:teuthology.orchestra.run.smithi050.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-05T17:17:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-05T17:17:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-05T17:17:34.826 INFO:teuthology.orchestra.run.smithi050.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-05T17:17:34.863 INFO:teuthology.orchestra.run.smithi050.stdout:done 2024-09-05T17:17:35.182 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-05T17:17:35.182 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub' 2024-09-05T17:17:35.186 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-05T17:17:35.211 INFO:teuthology.orchestra.run.smithi110.stdout:Generating grub configuration file ... 2024-09-05T17:17:35.380 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-09-05T17:17:35.401 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.119.119 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-05T17:17:35.402 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-09-05T17:17:35.403 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-09-05T17:17:35.403 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-09-05T17:17:35.403 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-09-05T17:17:35.403 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-05T17:17:35.403 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-05T17:17:35.403 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-05T17:17:35.403 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-05T17:17:35.403 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi050.front.sepia.ceph.com, path=None, version=distro) 2024-09-05T17:17:35.404 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get clean 2024-09-05T17:17:35.569 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-05T17:17:35.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-05T17:17:35.589 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-05T17:17:35.838 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T17:17:35.838 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-05T17:17:35.905 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-05T17:17:35.958 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-05T17:17:35.964 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-05T17:17:35.987 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-05T17:17:36.032 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-05T17:17:36.038 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-05T17:17:36.208 INFO:teuthology.orchestra.run.smithi110.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-05T17:17:36.209 INFO:teuthology.orchestra.run.smithi110.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-05T17:17:36.209 INFO:teuthology.orchestra.run.smithi110.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-05T17:17:36.249 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-09-05T17:17:36.646 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-09-05T17:17:36.664 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-09-05T17:17:36.664 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-09-05T17:17:36.664 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-09-05T17:17:36.664 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-09-05T17:17:36.664 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-09-05T17:17:36.664 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-09-05T17:17:36.664 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-09-05T17:17:36.665 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-09-05T17:17:36.665 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.119.119 2024-09-05T17:17:36.665 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-05T17:17:36.665 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-05T17:17:36.665 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-09-05T17:17:36.665 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-09-05T17:17:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-09-05T17:17:36.665 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-09-05T17:17:36.665 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-05T17:17:36.665 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-05T17:17:36.665 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-05T17:17:36.665 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-05T17:17:36.666 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-09-05T17:17:36.666 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-09-05T17:17:36.831 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-09-05T17:17:37.081 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T17:17:37.081 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-05T17:17:37.153 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-05T17:17:37.234 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-05T17:17:37.303 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-05T17:17:37.321 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-05T17:17:37.376 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-05T17:17:37.567 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-05T17:17:37.568 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-05T17:17:37.740 INFO:teuthology.orchestra.run.smithi050.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-05T17:17:37.741 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T17:17:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T17:17:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T17:17:37.741 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T17:17:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T17:17:37.742 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T17:17:37.742 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T17:17:37.784 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-05T17:17:37.786 DEBUG:teuthology.orchestra.run.smithi050:> dpkg -s linux-image-generic 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Package: linux-image-generic 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Status: install ok installed 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Priority: optional 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Section: kernel 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Installed-Size: 21 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Maintainer: Ubuntu Kernel Team 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Architecture: amd64 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Source: linux-meta 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Version: 5.15.0.119.119 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Recommends: thermald 2024-09-05T17:17:37.802 INFO:teuthology.orchestra.run.smithi050.stdout:Description: Generic Linux kernel image 2024-09-05T17:17:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: This package will always depend on the latest generic kernel image 2024-09-05T17:17:37.803 INFO:teuthology.orchestra.run.smithi050.stdout: available. 2024-09-05T17:17:37.803 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-05T17:17:37.850 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.lrweMZDr6k 2024-09-05T17:17:37.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lrweMZDr6k 2024-09-05T17:17:37.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.lrweMZDr6k 2024-09-05T17:17:38.017 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.lrweMZDr6k is 10KB 2024-09-05T17:17:38.029 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.lrweMZDr6k 2024-09-05T17:17:38.035 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-05T17:17:38.093 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:17:38.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-05T17:17:38.094 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-05T17:17:38.166 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-05T17:17:38.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo update-grub 2024-09-05T17:17:38.516 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-05T17:17:38.532 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-05T17:17:38.598 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-05T17:17:38.808 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-09-05T17:17:38.809 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-09-05T17:17:39.000 INFO:teuthology.orchestra.run.smithi110.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-05T17:17:39.000 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T17:17:39.000 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T17:17:39.001 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T17:17:39.001 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T17:17:39.001 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T17:17:39.001 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T17:17:39.001 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T17:17:39.044 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-05T17:17:39.046 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-09-05T17:17:39.064 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-09-05T17:17:39.064 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-09-05T17:17:39.064 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-09-05T17:17:39.064 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-09-05T17:17:39.064 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.119.119 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-09-05T17:17:39.065 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-09-05T17:17:39.065 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-05T17:17:39.109 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.Deze25ovr9 2024-09-05T17:17:39.109 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Deze25ovr9 2024-09-05T17:17:39.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.Deze25ovr9 2024-09-05T17:17:39.302 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.Deze25ovr9 is 10KB 2024-09-05T17:17:39.315 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.Deze25ovr9 2024-09-05T17:17:39.321 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-05T17:17:39.325 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub' 2024-09-05T17:17:39.327 INFO:teuthology.orchestra.run.smithi050.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-05T17:17:39.329 INFO:teuthology.orchestra.run.smithi050.stderr:Generating grub configuration file ... 2024-09-05T17:17:39.377 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:17:39.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-05T17:17:39.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-05T17:17:39.444 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-05T17:17:39.445 DEBUG:teuthology.orchestra.run.smithi110:> sudo update-grub 2024-09-05T17:17:39.570 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-05T17:17:39.575 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-05T17:17:39.851 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-05T17:17:39.856 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-05T17:17:39.904 INFO:teuthology.orchestra.run.smithi050.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-05T17:17:39.910 INFO:teuthology.orchestra.run.smithi050.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-05T17:17:40.038 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-05T17:17:40.038 INFO:teuthology.orchestra.run.smithi050.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-05T17:17:40.038 INFO:teuthology.orchestra.run.smithi050.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-05T17:17:40.048 INFO:teuthology.orchestra.run.smithi050.stderr:done 2024-09-05T17:17:40.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo shutdown -r now 2024-09-05T17:17:40.653 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2024-09-05T17:17:40.654 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-05T17:17:40.655 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-09-05T17:17:40.805 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-05T17:17:40.810 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-05T17:17:41.117 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-05T17:17:41.122 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-05T17:17:41.160 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-05T17:17:41.164 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-05T17:17:41.286 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-05T17:17:41.287 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-05T17:17:41.287 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-05T17:17:41.308 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-09-05T17:17:41.314 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-09-05T17:18:10.092 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-05T17:18:10.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-05T17:18:10.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:18:11.317 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-05T17:18:11.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-05T17:18:11.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:18:28.417 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-09-05T17:18:29.693 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-05T17:18:37.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-05T17:18:37.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:18:38.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-05T17:18:38.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:18:41.757 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-05T17:18:53.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-05T17:18:53.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:19:12.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-05T17:19:27.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-05T17:19:27.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:19:27.491 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-05T17:19:27.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-05T17:19:27.985 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-05T17:19:27.985 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-05T17:19:28.033 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-119-generic 2024-09-05T17:19:28.033 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-05T17:19:28.033 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-05T17:19:28.033 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-05T17:19:29.035 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-05T17:19:29.035 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-05T17:19:29.394 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-09-05T17:19:29.427 DEBUG:teuthology.parallel:result is None 2024-09-05T17:19:37.428 DEBUG:teuthology.orchestra.remote:timed out 2024-09-05T17:19:49.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-05T17:19:49.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:19:49.628 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-05T17:19:50.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-05T17:19:50.135 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-05T17:19:50.135 DEBUG:teuthology.orchestra.run.smithi050:> uname -r 2024-09-05T17:19:50.183 INFO:teuthology.orchestra.run.smithi050.stdout:5.15.0-119-generic 2024-09-05T17:19:50.184 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-05T17:19:50.184 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-05T17:19:50.184 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-05T17:19:51.185 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-05T17:19:51.185 DEBUG:teuthology.orchestra.run.smithi050:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-05T17:19:51.261 INFO:teuthology.orchestra.run.smithi050.stdout:ttyS1 2024-09-05T17:19:51.289 DEBUG:teuthology.parallel:result is None 2024-09-05T17:19:51.289 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-05T17:19:51.296 INFO:teuthology.task.internal:Creating test directory... 2024-09-05T17:19:51.296 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T17:19:51.299 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T17:19:51.305 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-05T17:19:51.312 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-05T17:19:51.322 INFO:teuthology.task.internal:Creating archive directory... 2024-09-05T17:19:51.322 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T17:19:51.348 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T17:19:51.369 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-05T17:19:51.375 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-05T17:19:51.375 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T17:19:51.405 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T17:19:51.421 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T17:19:51.427 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T17:19:51.429 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T17:19:51.435 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T17:19:51.437 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-05T17:19:51.445 INFO:teuthology.task.internal:Configuring sudo... 2024-09-05T17:19:51.445 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T17:19:51.484 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T17:19:51.498 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-05T17:19:51.508 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-05T17:19:51.508 DEBUG:teuthology.orchestra.run.smithi050:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T17:19:51.545 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T17:19:51.550 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T17:19:51.596 DEBUG:teuthology.orchestra.run.smithi050:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T17:19:51.646 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:19:51.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T17:19:51.705 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T17:19:51.711 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T17:19:51.758 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:19:51.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T17:19:51.830 DEBUG:teuthology.orchestra.run.smithi050:> sudo service rsyslog restart 2024-09-05T17:19:51.833 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-09-05T17:19:51.907 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-05T17:19:51.914 INFO:teuthology.task.internal:Starting timer... 2024-09-05T17:19:51.915 INFO:teuthology.run_tasks:Running task pcp... 2024-09-05T17:19:51.934 INFO:teuthology.run_tasks:Running task selinux... 2024-09-05T17:19:51.941 DEBUG:teuthology.task.selinux:Excluding smithi050: OS 'ubuntu' does not support SELinux 2024-09-05T17:19:51.941 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2024-09-05T17:19:51.941 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-05T17:19:51.941 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-05T17:19:51.941 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-05T17:19:51.942 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-05T17:19:51.950 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-05T17:19:51.953 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-05T17:19:52.072 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-05T17:19:52.084 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-05T17:19:52.085 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi050.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-05T17:27:27.093 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi050.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-09-05T17:27:27.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-05T17:27:27.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:27:27.200 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-09-05T17:27:27.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-09-05T17:27:27.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-05T17:27:27.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T17:27:27.361 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-05T17:27:27.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-05T17:27:27.441 INFO:teuthology.run_tasks:Running task clock... 2024-09-05T17:27:27.451 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-05T17:27:27.451 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T17:27:27.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T17:27:27.454 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T17:27:27.455 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T17:27:27.480 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-05T17:27:27.481 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Command line: ntpd -gq 2024-09-05T17:27:27.481 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: ---------------------------------------------------- 2024-09-05T17:27:27.481 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: ntp-4 is maintained by Network Time Foundation, 2024-09-05T17:27:27.481 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-05T17:27:27.481 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: corporation. Support and training for ntp-4 are 2024-09-05T17:27:27.481 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: available at https://www.nwtime.org/support 2024-09-05T17:27:27.481 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: ---------------------------------------------------- 2024-09-05T17:27:27.482 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: proto: precision = 0.046 usec (-24) 2024-09-05T17:27:27.482 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: basedate set to 2022-02-04 2024-09-05T17:27:27.482 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: gps base set to 2022-02-06 (week 2196) 2024-09-05T17:27:27.482 INFO:teuthology.orchestra.run.smithi050.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-05T17:27:27.482 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-05T17:27:27.483 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: restrict ::: KOD does nothing without LIMITED. 2024-09-05T17:27:27.483 INFO:teuthology.orchestra.run.smithi050.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-05T17:27:27.484 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Listen and drop on 0 v6wildcard [::]:123 2024-09-05T17:27:27.484 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-05T17:27:27.484 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Listen normally on 2 lo 127.0.0.1:123 2024-09-05T17:27:27.484 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Listen normally on 3 ens1f0 172.21.15.50:123 2024-09-05T17:27:27.484 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Listen normally on 4 lo [::1]:123 2024-09-05T17:27:27.484 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1584%4]:123 2024-09-05T17:27:27.484 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:27 ntpd[18364]: Listening on routing socket on fd #22 for interface updates 2024-09-05T17:27:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-05T17:27:27.513 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Command line: ntpd -gq 2024-09-05T17:27:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: ---------------------------------------------------- 2024-09-05T17:27:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: ntp-4 is maintained by Network Time Foundation, 2024-09-05T17:27:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-05T17:27:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: corporation. Support and training for ntp-4 are 2024-09-05T17:27:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: available at https://www.nwtime.org/support 2024-09-05T17:27:27.514 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: ---------------------------------------------------- 2024-09-05T17:27:27.515 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: proto: precision = 0.059 usec (-24) 2024-09-05T17:27:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: basedate set to 2022-02-04 2024-09-05T17:27:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: gps base set to 2022-02-06 (week 2196) 2024-09-05T17:27:27.517 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-05T17:27:27.517 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-05T17:27:27.518 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-05T17:27:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: restrict ::: KOD does nothing without LIMITED. 2024-09-05T17:27:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Listen and drop on 0 v6wildcard [::]:123 2024-09-05T17:27:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-05T17:27:27.520 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Listen normally on 2 lo 127.0.0.1:123 2024-09-05T17:27:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2024-09-05T17:27:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Listen normally on 4 lo [::1]:123 2024-09-05T17:27:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2024-09-05T17:27:27.521 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:27 ntpd[18449]: Listening on routing socket on fd #22 for interface updates 2024-09-05T17:27:28.481 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:28 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:28.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:28 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:28.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:28 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:28.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:28 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:28.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:28 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:28.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:28 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:28.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:28 ntpd[18364]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:28.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:28 ntpd[18364]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:28.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:28.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:28.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:28 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:29.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:29 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:29.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:29 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:29.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:29 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:29.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:29 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:29.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:29 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:29.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:29 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:30.481 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:30 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:30.481 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:30 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:30.481 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:30 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.328 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:30 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.328 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:30 ntpd[18364]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.328 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:30 ntpd[18364]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.332 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.333 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.334 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.334 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.334 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.334 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.334 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:32 ntpd[18364]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.336 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:30 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:31 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:31 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:31 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:31 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:31 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:31 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.337 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:32 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:33 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:33 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:33 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:33 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.338 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:33 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.339 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:33 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.482 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.483 INFO:teuthology.orchestra.run.smithi050.stdout: 5 Sep 17:27:34 ntpd[18364]: ntpd: time slew -0.000389 s 2024-09-05T17:27:34.484 INFO:teuthology.orchestra.run.smithi050.stdout:ntpd: time slew -0.000389s 2024-09-05T17:27:34.484 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-05T17:27:34.484 INFO:teuthology.orchestra.run.smithi050.stderr: 5 Sep 17:27:34 ntpd[18364]: can't open /var/log/ntpstats/loopstats.20240905: Permission denied 2024-09-05T17:27:34.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.514 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-05T17:27:34.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: can't open /var/log/ntpstats/rawstats.20240905: Permission denied 2024-09-05T17:27:34.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-05T17:27:34.515 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: can't open /var/log/ntpstats/peerstats.20240905: Permission denied 2024-09-05T17:27:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: 5 Sep 17:27:34 ntpd[18449]: ntpd: time slew -0.000452 s 2024-09-05T17:27:34.515 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew -0.000452s 2024-09-05T17:27:34.516 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-05T17:27:34.516 INFO:teuthology.orchestra.run.smithi110.stderr: 5 Sep 17:27:34 ntpd[18449]: can't open /var/log/ntpstats/loopstats.20240905: Permission denied 2024-09-05T17:27:34.531 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-09-05T17:27:34.531 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-09-05T17:27:34.531 INFO:teuthology.orchestra.run.smithi050.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:27:34.531 INFO:teuthology.orchestra.run.smithi050.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:27:34.531 INFO:teuthology.orchestra.run.smithi050.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:27:34.532 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:27:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-09-05T17:27:34.562 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-09-05T17:27:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:27:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:27:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:27:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:27:34.563 INFO:teuthology.run_tasks:Running task install... 2024-09-05T17:27:34.571 DEBUG:teuthology.task.install:project ceph 2024-09-05T17:27:34.571 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0d82736d7e74c3301ced0a9a1f1715342226ca2'}} 2024-09-05T17:27:34.571 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b0d82736d7e74c3301ced0a9a1f1715342226ca2'} 2024-09-05T17:27:34.571 INFO:teuthology.task.install:Using flavor: default 2024-09-05T17:27:34.578 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-05T17:27:34.578 INFO:teuthology.task.install:extra packages: [] 2024-09-05T17:27:34.578 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-key list | grep Ceph 2024-09-05T17:27:34.579 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-key list | grep Ceph 2024-09-05T17:27:34.636 INFO:teuthology.orchestra.run.smithi050.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-05T17:27:34.663 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-05T17:27:34.663 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-05T17:27:34.664 INFO:teuthology.orchestra.run.smithi050.stdout:uid [ unknown] Ceph.com (release key) 2024-09-05T17:27:34.664 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-05T17:27:34.664 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0d82736d7e74c3301ced0a9a1f1715342226ca2 2024-09-05T17:27:34.690 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-05T17:27:34.690 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph.com (release key) 2024-09-05T17:27:34.691 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-05T17:27:34.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0d82736d7e74c3301ced0a9a1f1715342226ca2 2024-09-05T17:27:34.815 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default/ 2024-09-05T17:27:34.816 INFO:teuthology.task.install.deb:Package version is 19.3.0-4648-gb0d82736-1jammy 2024-09-05T17:27:34.835 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default/ 2024-09-05T17:27:34.836 INFO:teuthology.task.install.deb:Package version is 19.3.0-4648-gb0d82736-1jammy 2024-09-05T17:27:34.925 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:27:34.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-05T17:27:34.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo apt-get update 2024-09-05T17:27:34.943 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:27:34.943 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-05T17:27:34.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-09-05T17:27:35.114 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T17:27:35.114 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-05T17:27:35.121 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-05T17:27:35.121 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-05T17:27:35.124 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-05T17:27:35.131 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-05T17:27:35.141 INFO:teuthology.orchestra.run.smithi050.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-05T17:27:35.148 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-05T17:27:35.168 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy InRelease 2024-09-05T17:27:35.178 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy InRelease 2024-09-05T17:27:35.191 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-05T17:27:35.200 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-05T17:27:35.213 INFO:teuthology.orchestra.run.smithi050.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-05T17:27:35.221 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-05T17:27:35.339 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-05T17:27:35.344 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-09-05T17:27:35.368 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-05T17:27:35.369 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-09-05T17:27:35.462 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 29.2 kB in 0s (89.9 kB/s) 2024-09-05T17:27:35.492 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 29.2 kB in 0s (80.2 kB/s) 2024-09-05T17:27:36.463 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-05T17:27:36.480 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4648-gb0d82736-1jammy cephadm=19.3.0-4648-gb0d82736-1jammy ceph-mds=19.3.0-4648-gb0d82736-1jammy ceph-mgr=19.3.0-4648-gb0d82736-1jammy ceph-common=19.3.0-4648-gb0d82736-1jammy ceph-fuse=19.3.0-4648-gb0d82736-1jammy ceph-test=19.3.0-4648-gb0d82736-1jammy ceph-volume=19.3.0-4648-gb0d82736-1jammy radosgw=19.3.0-4648-gb0d82736-1jammy python3-rados=19.3.0-4648-gb0d82736-1jammy python3-rgw=19.3.0-4648-gb0d82736-1jammy python3-cephfs=19.3.0-4648-gb0d82736-1jammy python3-rbd=19.3.0-4648-gb0d82736-1jammy libcephfs2=19.3.0-4648-gb0d82736-1jammy libcephfs-dev=19.3.0-4648-gb0d82736-1jammy librados2=19.3.0-4648-gb0d82736-1jammy librbd1=19.3.0-4648-gb0d82736-1jammy rbd-fuse=19.3.0-4648-gb0d82736-1jammy 2024-09-05T17:27:42.823 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-05T17:27:42.823 DEBUG:teuthology.orchestra.run.smithi050:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4648-gb0d82736-1jammy cephadm=19.3.0-4648-gb0d82736-1jammy ceph-mds=19.3.0-4648-gb0d82736-1jammy ceph-mgr=19.3.0-4648-gb0d82736-1jammy ceph-common=19.3.0-4648-gb0d82736-1jammy ceph-fuse=19.3.0-4648-gb0d82736-1jammy ceph-test=19.3.0-4648-gb0d82736-1jammy ceph-volume=19.3.0-4648-gb0d82736-1jammy radosgw=19.3.0-4648-gb0d82736-1jammy python3-rados=19.3.0-4648-gb0d82736-1jammy python3-rgw=19.3.0-4648-gb0d82736-1jammy python3-cephfs=19.3.0-4648-gb0d82736-1jammy python3-rbd=19.3.0-4648-gb0d82736-1jammy libcephfs2=19.3.0-4648-gb0d82736-1jammy libcephfs-dev=19.3.0-4648-gb0d82736-1jammy librados2=19.3.0-4648-gb0d82736-1jammy librbd1=19.3.0-4648-gb0d82736-1jammy rbd-fuse=19.3.0-4648-gb0d82736-1jammy 2024-09-05T17:27:42.892 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-05T17:27:42.896 INFO:teuthology.orchestra.run.smithi050.stdout:Reading package lists... 2024-09-05T17:27:43.105 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-09-05T17:27:43.105 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-09-05T17:27:43.112 INFO:teuthology.orchestra.run.smithi050.stdout:Building dependency tree... 2024-09-05T17:27:43.113 INFO:teuthology.orchestra.run.smithi050.stdout:Reading state information... 2024-09-05T17:27:43.298 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T17:27:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T17:27:43.298 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T17:27:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T17:27:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T17:27:43.299 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T17:27:43.299 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T17:27:43.300 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-09-05T17:27:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-05T17:27:43.300 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-05T17:27:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-05T17:27:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-05T17:27:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-05T17:27:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-05T17:27:43.301 INFO:teuthology.orchestra.run.smithi110.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-05T17:27:43.302 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet zip 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-05T17:27:43.303 INFO:teuthology.orchestra.run.smithi110.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-05T17:27:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-05T17:27:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-05T17:27:43.304 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-09-05T17:27:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: btrfs-tools 2024-09-05T17:27:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:The following packages were automatically installed and are no longer required: 2024-09-05T17:27:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-05T17:27:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-05T17:27:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-05T17:27:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-05T17:27:43.329 INFO:teuthology.orchestra.run.smithi050.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-05T17:27:43.329 INFO:teuthology.orchestra.run.smithi050.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-05T17:27:43.331 INFO:teuthology.orchestra.run.smithi050.stdout:The following additional packages will be installed: 2024-09-05T17:27:43.331 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-05T17:27:43.331 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-05T17:27:43.331 INFO:teuthology.orchestra.run.smithi050.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-05T17:27:43.331 INFO:teuthology.orchestra.run.smithi050.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-05T17:27:43.332 INFO:teuthology.orchestra.run.smithi050.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-05T17:27:43.332 INFO:teuthology.orchestra.run.smithi050.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-05T17:27:43.332 INFO:teuthology.orchestra.run.smithi050.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-05T17:27:43.332 INFO:teuthology.orchestra.run.smithi050.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-05T17:27:43.332 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-05T17:27:43.332 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-05T17:27:43.333 INFO:teuthology.orchestra.run.smithi050.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout: xmlstarlet zip 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:Suggested packages: 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-05T17:27:43.334 INFO:teuthology.orchestra.run.smithi050.stdout:Recommended packages: 2024-09-05T17:27:43.335 INFO:teuthology.orchestra.run.smithi050.stdout: btrfs-tools 2024-09-05T17:27:43.406 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-09-05T17:27:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-05T17:27:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-05T17:27:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-05T17:27:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-05T17:27:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-05T17:27:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-05T17:27:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-05T17:27:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-05T17:27:43.442 INFO:teuthology.orchestra.run.smithi050.stdout:The following NEW packages will be installed: 2024-09-05T17:27:43.442 INFO:teuthology.orchestra.run.smithi050.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-05T17:27:43.442 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-05T17:27:43.442 INFO:teuthology.orchestra.run.smithi050.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-05T17:27:43.442 INFO:teuthology.orchestra.run.smithi050.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-05T17:27:43.442 INFO:teuthology.orchestra.run.smithi050.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-05T17:27:43.443 INFO:teuthology.orchestra.run.smithi050.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-05T17:27:43.444 INFO:teuthology.orchestra.run.smithi050.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-05T17:27:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-05T17:27:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-05T17:27:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-05T17:27:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-05T17:27:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-05T17:27:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-05T17:27:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-05T17:27:43.445 INFO:teuthology.orchestra.run.smithi050.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-05T17:27:43.506 INFO:teuthology.orchestra.run.smithi050.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-05T17:27:43.506 INFO:teuthology.orchestra.run.smithi050.stdout:Need to get 251 MB of archives. 2024-09-05T17:27:43.506 INFO:teuthology.orchestra.run.smithi050.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-05T17:27:43.506 INFO:teuthology.orchestra.run.smithi050.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-05T17:27:43.578 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-05T17:27:43.578 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 251 MB of archives. 2024-09-05T17:27:43.578 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-05T17:27:43.578 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4648-gb0d82736-1jammy [3,631 kB] 2024-09-05T17:27:43.593 INFO:teuthology.orchestra.run.smithi050.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-05T17:27:43.596 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-05T17:27:43.596 INFO:teuthology.orchestra.run.smithi050.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-05T17:27:43.613 INFO:teuthology.orchestra.run.smithi050.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-05T17:27:43.628 INFO:teuthology.orchestra.run.smithi050.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4648-gb0d82736-1jammy [3,631 kB] 2024-09-05T17:27:43.671 INFO:teuthology.orchestra.run.smithi050.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-05T17:27:43.675 INFO:teuthology.orchestra.run.smithi050.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-05T17:27:43.688 INFO:teuthology.orchestra.run.smithi050.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-05T17:27:43.692 INFO:teuthology.orchestra.run.smithi050.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-05T17:27:43.693 INFO:teuthology.orchestra.run.smithi050.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-05T17:27:43.694 INFO:teuthology.orchestra.run.smithi050.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-05T17:27:43.702 INFO:teuthology.orchestra.run.smithi050.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-05T17:27:43.705 INFO:teuthology.orchestra.run.smithi050.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-05T17:27:43.707 INFO:teuthology.orchestra.run.smithi050.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-05T17:27:43.708 INFO:teuthology.orchestra.run.smithi050.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-05T17:27:43.709 INFO:teuthology.orchestra.run.smithi050.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-05T17:27:43.711 INFO:teuthology.orchestra.run.smithi050.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-05T17:27:43.729 INFO:teuthology.orchestra.run.smithi050.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-05T17:27:43.730 INFO:teuthology.orchestra.run.smithi050.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-05T17:27:43.730 INFO:teuthology.orchestra.run.smithi050.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-05T17:27:43.730 INFO:teuthology.orchestra.run.smithi050.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-05T17:27:43.730 INFO:teuthology.orchestra.run.smithi050.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-05T17:27:43.731 INFO:teuthology.orchestra.run.smithi050.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-05T17:27:43.731 INFO:teuthology.orchestra.run.smithi050.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-05T17:27:43.731 INFO:teuthology.orchestra.run.smithi050.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-05T17:27:43.743 INFO:teuthology.orchestra.run.smithi050.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-05T17:27:43.744 INFO:teuthology.orchestra.run.smithi050.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-05T17:27:43.760 INFO:teuthology.orchestra.run.smithi050.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-05T17:27:43.763 INFO:teuthology.orchestra.run.smithi050.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-05T17:27:43.763 INFO:teuthology.orchestra.run.smithi050.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-05T17:27:43.763 INFO:teuthology.orchestra.run.smithi050.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-05T17:27:43.764 INFO:teuthology.orchestra.run.smithi050.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-05T17:27:43.765 INFO:teuthology.orchestra.run.smithi050.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-05T17:27:43.766 INFO:teuthology.orchestra.run.smithi050.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-05T17:27:43.766 INFO:teuthology.orchestra.run.smithi050.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-05T17:27:43.777 INFO:teuthology.orchestra.run.smithi050.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-05T17:27:43.778 INFO:teuthology.orchestra.run.smithi050.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-05T17:27:43.794 INFO:teuthology.orchestra.run.smithi050.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-05T17:27:43.799 INFO:teuthology.orchestra.run.smithi050.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-05T17:27:43.800 INFO:teuthology.orchestra.run.smithi050.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-05T17:27:43.800 INFO:teuthology.orchestra.run.smithi050.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-05T17:27:43.801 INFO:teuthology.orchestra.run.smithi050.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-05T17:27:43.802 INFO:teuthology.orchestra.run.smithi050.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-05T17:27:43.804 INFO:teuthology.orchestra.run.smithi050.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-05T17:27:43.805 INFO:teuthology.orchestra.run.smithi050.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-05T17:27:43.811 INFO:teuthology.orchestra.run.smithi050.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-05T17:27:43.811 INFO:teuthology.orchestra.run.smithi050.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-05T17:27:43.828 INFO:teuthology.orchestra.run.smithi050.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-05T17:27:43.828 INFO:teuthology.orchestra.run.smithi050.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-05T17:27:43.829 INFO:teuthology.orchestra.run.smithi050.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-05T17:27:43.832 INFO:teuthology.orchestra.run.smithi050.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-05T17:27:43.886 INFO:teuthology.orchestra.run.smithi050.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-05T17:27:43.887 INFO:teuthology.orchestra.run.smithi050.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-05T17:27:43.888 INFO:teuthology.orchestra.run.smithi050.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-05T17:27:43.889 INFO:teuthology.orchestra.run.smithi050.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-05T17:27:43.890 INFO:teuthology.orchestra.run.smithi050.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-05T17:27:43.907 INFO:teuthology.orchestra.run.smithi050.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-05T17:27:43.909 INFO:teuthology.orchestra.run.smithi050.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-05T17:27:43.910 INFO:teuthology.orchestra.run.smithi050.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-05T17:27:43.919 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4648-gb0d82736-1jammy [3,320 kB] 2024-09-05T17:27:43.924 INFO:teuthology.orchestra.run.smithi050.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-05T17:27:43.925 INFO:teuthology.orchestra.run.smithi050.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-05T17:27:43.925 INFO:teuthology.orchestra.run.smithi050.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-05T17:27:43.925 INFO:teuthology.orchestra.run.smithi050.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-05T17:27:43.926 INFO:teuthology.orchestra.run.smithi050.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-05T17:27:43.926 INFO:teuthology.orchestra.run.smithi050.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-05T17:27:43.939 INFO:teuthology.orchestra.run.smithi050.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-05T17:27:43.940 INFO:teuthology.orchestra.run.smithi050.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-05T17:27:43.943 INFO:teuthology.orchestra.run.smithi050.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-05T17:27:43.956 INFO:teuthology.orchestra.run.smithi050.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-05T17:27:43.957 INFO:teuthology.orchestra.run.smithi050.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-05T17:27:43.958 INFO:teuthology.orchestra.run.smithi050.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-05T17:27:43.961 INFO:teuthology.orchestra.run.smithi050.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-05T17:27:43.963 INFO:teuthology.orchestra.run.smithi050.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-05T17:27:43.964 INFO:teuthology.orchestra.run.smithi050.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-05T17:27:43.964 INFO:teuthology.orchestra.run.smithi050.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-05T17:27:43.973 INFO:teuthology.orchestra.run.smithi050.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-05T17:27:43.973 INFO:teuthology.orchestra.run.smithi050.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-05T17:27:43.976 INFO:teuthology.orchestra.run.smithi050.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4648-gb0d82736-1jammy [3,320 kB] 2024-09-05T17:27:43.976 INFO:teuthology.orchestra.run.smithi050.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-05T17:27:43.990 INFO:teuthology.orchestra.run.smithi050.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-05T17:27:43.991 INFO:teuthology.orchestra.run.smithi050.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-05T17:27:43.991 INFO:teuthology.orchestra.run.smithi050.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-05T17:27:43.992 INFO:teuthology.orchestra.run.smithi050.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-05T17:27:43.993 INFO:teuthology.orchestra.run.smithi050.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-05T17:27:43.999 INFO:teuthology.orchestra.run.smithi050.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-05T17:27:43.999 INFO:teuthology.orchestra.run.smithi050.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-05T17:27:44.007 INFO:teuthology.orchestra.run.smithi050.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-05T17:27:44.009 INFO:teuthology.orchestra.run.smithi050.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-05T17:27:44.009 INFO:teuthology.orchestra.run.smithi050.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-05T17:27:44.015 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-05T17:27:44.028 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-05T17:27:44.064 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4648-gb0d82736-1jammy [722 kB] 2024-09-05T17:27:44.094 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4648-gb0d82736-1jammy [356 kB] 2024-09-05T17:27:44.101 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4648-gb0d82736-1jammy [32.8 kB] 2024-09-05T17:27:44.109 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-05T17:27:44.133 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4648-gb0d82736-1jammy [180 kB] 2024-09-05T17:27:44.146 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4648-gb0d82736-1jammy [71.2 kB] 2024-09-05T17:27:44.166 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4648-gb0d82736-1jammy [338 kB] 2024-09-05T17:27:44.197 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4648-gb0d82736-1jammy [7,980 kB] 2024-09-05T17:27:44.260 INFO:teuthology.orchestra.run.smithi050.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4648-gb0d82736-1jammy [722 kB] 2024-09-05T17:27:44.282 INFO:teuthology.orchestra.run.smithi050.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4648-gb0d82736-1jammy [356 kB] 2024-09-05T17:27:44.289 INFO:teuthology.orchestra.run.smithi050.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4648-gb0d82736-1jammy [32.8 kB] 2024-09-05T17:27:44.290 INFO:teuthology.orchestra.run.smithi050.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4648-gb0d82736-1jammy [180 kB] 2024-09-05T17:27:44.300 INFO:teuthology.orchestra.run.smithi050.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4648-gb0d82736-1jammy [71.2 kB] 2024-09-05T17:27:44.302 INFO:teuthology.orchestra.run.smithi050.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4648-gb0d82736-1jammy [338 kB] 2024-09-05T17:27:44.309 INFO:teuthology.orchestra.run.smithi050.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4648-gb0d82736-1jammy [7,980 kB] 2024-09-05T17:27:44.338 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-05T17:27:44.349 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-05T17:27:44.379 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-05T17:27:44.388 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-05T17:27:44.388 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-05T17:27:44.389 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-05T17:27:44.407 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-05T17:27:44.411 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-05T17:27:44.416 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-05T17:27:44.420 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-05T17:27:44.425 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4648-gb0d82736-1jammy [112 kB] 2024-09-05T17:27:44.427 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4648-gb0d82736-1jammy [473 kB] 2024-09-05T17:27:44.444 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4648-gb0d82736-1jammy [28.2 MB] 2024-09-05T17:27:44.502 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-05T17:27:44.505 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-05T17:27:44.509 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-05T17:27:44.513 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-05T17:27:44.514 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-05T17:27:44.514 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-05T17:27:44.517 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-05T17:27:44.517 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-05T17:27:44.518 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-05T17:27:44.583 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-05T17:27:44.600 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-05T17:27:44.601 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-05T17:27:44.601 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-05T17:27:44.607 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-05T17:27:44.608 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-05T17:27:44.665 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-05T17:27:44.665 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-05T17:27:44.667 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-05T17:27:44.668 INFO:teuthology.orchestra.run.smithi110.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-05T17:27:44.749 INFO:teuthology.orchestra.run.smithi110.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-05T17:27:44.749 INFO:teuthology.orchestra.run.smithi110.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-05T17:27:44.750 INFO:teuthology.orchestra.run.smithi110.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-05T17:27:44.751 INFO:teuthology.orchestra.run.smithi110.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-05T17:27:44.762 INFO:teuthology.orchestra.run.smithi110.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-05T17:27:44.827 INFO:teuthology.orchestra.run.smithi110.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-05T17:27:44.829 INFO:teuthology.orchestra.run.smithi110.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-05T17:27:44.834 INFO:teuthology.orchestra.run.smithi110.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-05T17:27:44.837 INFO:teuthology.orchestra.run.smithi110.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-05T17:27:44.841 INFO:teuthology.orchestra.run.smithi110.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-05T17:27:44.908 INFO:teuthology.orchestra.run.smithi110.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-05T17:27:44.911 INFO:teuthology.orchestra.run.smithi110.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-05T17:27:44.912 INFO:teuthology.orchestra.run.smithi110.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-05T17:27:44.917 INFO:teuthology.orchestra.run.smithi110.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-05T17:27:44.918 INFO:teuthology.orchestra.run.smithi110.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-05T17:27:44.990 INFO:teuthology.orchestra.run.smithi110.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-05T17:27:45.016 INFO:teuthology.orchestra.run.smithi110.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-05T17:27:45.241 INFO:teuthology.orchestra.run.smithi110.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-05T17:27:45.315 INFO:teuthology.orchestra.run.smithi110.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-05T17:27:45.366 INFO:teuthology.orchestra.run.smithi110.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-05T17:27:45.367 INFO:teuthology.orchestra.run.smithi110.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-05T17:27:45.398 INFO:teuthology.orchestra.run.smithi110.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-05T17:27:45.452 INFO:teuthology.orchestra.run.smithi110.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-05T17:27:45.595 INFO:teuthology.orchestra.run.smithi110.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-05T17:27:45.596 INFO:teuthology.orchestra.run.smithi110.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-05T17:27:45.597 INFO:teuthology.orchestra.run.smithi110.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4648-gb0d82736-1jammy [5,203 kB] 2024-09-05T17:27:45.629 INFO:teuthology.orchestra.run.smithi050.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4648-gb0d82736-1jammy [112 kB] 2024-09-05T17:27:45.643 INFO:teuthology.orchestra.run.smithi050.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4648-gb0d82736-1jammy [473 kB] 2024-09-05T17:27:45.643 INFO:teuthology.orchestra.run.smithi050.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4648-gb0d82736-1jammy [28.2 MB] 2024-09-05T17:27:45.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-05T17:27:45.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-05T17:27:45.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-05T17:27:45.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-05T17:27:45.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-05T17:27:45.645 INFO:teuthology.orchestra.run.smithi110.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-05T17:27:45.645 INFO:teuthology.orchestra.run.smithi110.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-05T17:27:45.678 INFO:teuthology.orchestra.run.smithi110.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4648-gb0d82736-1jammy [251 kB] 2024-09-05T17:27:45.681 INFO:teuthology.orchestra.run.smithi110.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-05T17:27:45.681 INFO:teuthology.orchestra.run.smithi110.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4648-gb0d82736-1jammy [124 kB] 2024-09-05T17:27:45.683 INFO:teuthology.orchestra.run.smithi110.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4648-gb0d82736-1jammy [1,561 kB] 2024-09-05T17:27:45.704 INFO:teuthology.orchestra.run.smithi110.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4648-gb0d82736-1jammy [6,311 kB] 2024-09-05T17:27:45.727 INFO:teuthology.orchestra.run.smithi110.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-05T17:27:45.731 INFO:teuthology.orchestra.run.smithi110.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-05T17:27:45.735 INFO:teuthology.orchestra.run.smithi110.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-05T17:27:45.736 INFO:teuthology.orchestra.run.smithi110.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-05T17:27:45.745 INFO:teuthology.orchestra.run.smithi110.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-05T17:27:45.767 INFO:teuthology.orchestra.run.smithi110.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-05T17:27:45.769 INFO:teuthology.orchestra.run.smithi110.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-05T17:27:45.770 INFO:teuthology.orchestra.run.smithi110.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-05T17:27:45.781 INFO:teuthology.orchestra.run.smithi110.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-05T17:27:45.844 INFO:teuthology.orchestra.run.smithi110.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-05T17:27:45.851 INFO:teuthology.orchestra.run.smithi110.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-05T17:27:45.852 INFO:teuthology.orchestra.run.smithi110.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-05T17:27:45.854 INFO:teuthology.orchestra.run.smithi110.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-05T17:27:45.854 INFO:teuthology.orchestra.run.smithi110.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-05T17:27:45.860 INFO:teuthology.orchestra.run.smithi110.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4648-gb0d82736-1jammy [23.1 MB] 2024-09-05T17:27:45.925 INFO:teuthology.orchestra.run.smithi110.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-05T17:27:45.927 INFO:teuthology.orchestra.run.smithi110.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-05T17:27:45.944 INFO:teuthology.orchestra.run.smithi110.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-05T17:27:45.945 INFO:teuthology.orchestra.run.smithi110.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-05T17:27:45.946 INFO:teuthology.orchestra.run.smithi110.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-05T17:27:46.007 INFO:teuthology.orchestra.run.smithi110.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-05T17:27:46.008 INFO:teuthology.orchestra.run.smithi110.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-05T17:27:46.660 INFO:teuthology.orchestra.run.smithi110.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4648-gb0d82736-1jammy [14.0 kB] 2024-09-05T17:27:46.661 INFO:teuthology.orchestra.run.smithi110.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4648-gb0d82736-1jammy [880 kB] 2024-09-05T17:27:46.678 INFO:teuthology.orchestra.run.smithi110.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4648-gb0d82736-1jammy [2,436 kB] 2024-09-05T17:27:46.719 INFO:teuthology.orchestra.run.smithi110.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4648-gb0d82736-1jammy [812 kB] 2024-09-05T17:27:46.729 INFO:teuthology.orchestra.run.smithi110.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4648-gb0d82736-1jammy [160 kB] 2024-09-05T17:27:46.731 INFO:teuthology.orchestra.run.smithi110.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4648-gb0d82736-1jammy [61.4 MB] 2024-09-05T17:27:49.033 INFO:teuthology.orchestra.run.smithi110.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4648-gb0d82736-1jammy [8,625 kB] 2024-09-05T17:27:49.147 INFO:teuthology.orchestra.run.smithi110.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4648-gb0d82736-1jammy [14.2 kB] 2024-09-05T17:27:49.148 INFO:teuthology.orchestra.run.smithi110.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4648-gb0d82736-1jammy [55.7 MB] 2024-09-05T17:27:51.172 INFO:teuthology.orchestra.run.smithi110.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4648-gb0d82736-1jammy [130 kB] 2024-09-05T17:27:51.289 INFO:teuthology.orchestra.run.smithi110.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4648-gb0d82736-1jammy [38.9 kB] 2024-09-05T17:27:51.290 INFO:teuthology.orchestra.run.smithi110.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4648-gb0d82736-1jammy [15.9 MB] 2024-09-05T17:27:51.506 INFO:teuthology.orchestra.run.smithi110.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4648-gb0d82736-1jammy [91.2 kB] 2024-09-05T17:27:51.834 INFO:teuthology.orchestra.run.smithi050.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4648-gb0d82736-1jammy [5,203 kB] 2024-09-05T17:27:51.914 INFO:teuthology.orchestra.run.smithi050.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4648-gb0d82736-1jammy [251 kB] 2024-09-05T17:27:51.917 INFO:teuthology.orchestra.run.smithi050.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4648-gb0d82736-1jammy [124 kB] 2024-09-05T17:27:51.918 INFO:teuthology.orchestra.run.smithi050.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4648-gb0d82736-1jammy [1,561 kB] 2024-09-05T17:27:51.932 INFO:teuthology.orchestra.run.smithi050.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4648-gb0d82736-1jammy [6,311 kB] 2024-09-05T17:27:52.024 INFO:teuthology.orchestra.run.smithi050.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4648-gb0d82736-1jammy [23.1 MB] 2024-09-05T17:27:52.077 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 251 MB in 8s (31.0 MB/s) 2024-09-05T17:27:52.215 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-05T17:27:52.307 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-05T17:27:52.313 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-05T17:27:52.397 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-05T17:27:52.483 INFO:teuthology.orchestra.run.smithi050.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4648-gb0d82736-1jammy [14.0 kB] 2024-09-05T17:27:52.484 INFO:teuthology.orchestra.run.smithi050.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4648-gb0d82736-1jammy [880 kB] 2024-09-05T17:27:52.494 INFO:teuthology.orchestra.run.smithi050.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4648-gb0d82736-1jammy [2,436 kB] 2024-09-05T17:27:52.523 INFO:teuthology.orchestra.run.smithi050.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4648-gb0d82736-1jammy [812 kB] 2024-09-05T17:27:52.532 INFO:teuthology.orchestra.run.smithi050.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4648-gb0d82736-1jammy [160 kB] 2024-09-05T17:27:52.534 INFO:teuthology.orchestra.run.smithi050.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4648-gb0d82736-1jammy [61.4 MB] 2024-09-05T17:27:52.734 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-05T17:27:52.760 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-05T17:27:52.800 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-05T17:27:53.103 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-05T17:27:53.130 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-05T17:27:53.162 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-05T17:27:53.591 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-05T17:27:53.617 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T17:27:53.665 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:27:53.773 INFO:teuthology.orchestra.run.smithi050.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4648-gb0d82736-1jammy [8,625 kB] 2024-09-05T17:27:53.882 INFO:teuthology.orchestra.run.smithi050.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4648-gb0d82736-1jammy [14.2 kB] 2024-09-05T17:27:53.883 INFO:teuthology.orchestra.run.smithi050.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4648-gb0d82736-1jammy [55.7 MB] 2024-09-05T17:27:54.085 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-05T17:27:54.112 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T17:27:54.152 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:27:54.463 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-05T17:27:54.489 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T17:27:54.521 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:27:55.058 INFO:teuthology.orchestra.run.smithi050.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4648-gb0d82736-1jammy [130 kB] 2024-09-05T17:27:55.061 INFO:teuthology.orchestra.run.smithi050.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4648-gb0d82736-1jammy [38.9 kB] 2024-09-05T17:27:55.062 INFO:teuthology.orchestra.run.smithi050.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4648-gb0d82736-1jammy [15.9 MB] 2024-09-05T17:27:55.092 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-05T17:27:55.118 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-05T17:27:55.150 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-05T17:27:55.363 INFO:teuthology.orchestra.run.smithi050.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/main/b0d82736d7e74c3301ced0a9a1f1715342226ca2/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4648-gb0d82736-1jammy [91.2 kB] 2024-09-05T17:27:55.461 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librados2. 2024-09-05T17:27:55.487 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../007-librados2_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:27:55.527 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:55.969 INFO:teuthology.orchestra.run.smithi050.stdout:Fetched 251 MB in 12s (21.1 MB/s) 2024-09-05T17:27:55.980 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librbd1. 2024-09-05T17:27:56.007 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../008-librbd1_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:27:56.048 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:56.117 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-05T17:27:56.216 INFO:teuthology.orchestra.run.smithi050.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-05T17:27:56.221 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-05T17:27:56.315 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-05T17:27:56.483 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2. 2024-09-05T17:27:56.510 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:27:56.550 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:56.653 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-05T17:27:56.679 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-05T17:27:56.719 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-05T17:27:56.860 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rados. 2024-09-05T17:27:56.876 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:27:56.919 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rados (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:57.055 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-05T17:27:57.082 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-05T17:27:57.121 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-05T17:27:57.238 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-05T17:27:57.265 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:27:57.305 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-argparse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:57.492 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-05T17:27:57.519 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T17:27:57.566 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cephfs. 2024-09-05T17:27:57.582 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:27:57.583 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:27:57.624 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cephfs (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:57.935 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-05T17:27:57.962 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:27:57.995 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-05T17:27:58.002 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-common (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:58.022 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T17:27:58.061 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:27:58.338 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-05T17:27:58.365 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-05T17:27:58.398 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-05T17:27:58.425 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-05T17:27:58.438 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-05T17:27:58.464 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:27:58.741 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-prettytable. 2024-09-05T17:27:58.767 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-05T17:27:58.808 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-05T17:27:58.818 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-05T17:27:58.845 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-05T17:27:58.884 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-05T17:27:59.060 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rbd. 2024-09-05T17:27:59.076 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:27:59.119 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rbd (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:59.163 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librados2. 2024-09-05T17:27:59.189 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../007-librados2_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:27:59.229 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librados2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:59.447 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-05T17:27:59.473 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-05T17:27:59.513 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-05T17:27:59.790 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librbd1. 2024-09-05T17:27:59.816 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-05T17:27:59.817 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../008-librbd1_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:27:59.843 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-05T17:27:59.856 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librbd1 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:27:59.883 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-05T17:28:00.326 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs2. 2024-09-05T17:28:00.352 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:00.361 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-05T17:28:00.388 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-05T17:28:00.401 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:00.427 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-05T17:28:00.678 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rados. 2024-09-05T17:28:00.694 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:00.722 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua5.1. 2024-09-05T17:28:00.737 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rados (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:00.749 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-05T17:28:00.780 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-05T17:28:01.077 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-any. 2024-09-05T17:28:01.104 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-05T17:28:01.144 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-05T17:28:01.256 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-05T17:28:01.283 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:01.323 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-argparse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:01.388 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package zip. 2024-09-05T17:28:01.417 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-05T17:28:01.455 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking zip (3.0-12build2) ... 2024-09-05T17:28:01.583 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cephfs. 2024-09-05T17:28:01.610 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:01.658 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cephfs (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:01.724 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package unzip. 2024-09-05T17:28:01.751 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-05T17:28:01.783 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-05T17:28:01.970 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-05T17:28:01.997 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:02.036 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-ceph-common (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:02.129 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package luarocks. 2024-09-05T17:28:02.155 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-05T17:28:02.187 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-05T17:28:02.339 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-05T17:28:02.366 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-05T17:28:02.406 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-05T17:28:02.570 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2. 2024-09-05T17:28:02.596 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../025-librgw2_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:02.636 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:02.717 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-prettytable. 2024-09-05T17:28:02.744 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-05T17:28:02.784 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-05T17:28:03.045 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rbd. 2024-09-05T17:28:03.060 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:03.103 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rbd (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:03.247 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rgw. 2024-09-05T17:28:03.262 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:03.305 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rgw (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:03.473 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-05T17:28:03.500 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-05T17:28:03.539 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-05T17:28:03.650 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-05T17:28:03.677 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-05T17:28:03.716 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-05T17:28:03.817 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-05T17:28:03.844 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-05T17:28:03.883 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-05T17:28:04.045 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1. 2024-09-05T17:28:04.071 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:04.111 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:04.186 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-05T17:28:04.202 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-05T17:28:04.245 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-05T17:28:04.539 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common. 2024-09-05T17:28:04.566 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:04.606 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:04.614 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua5.1. 2024-09-05T17:28:04.641 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-05T17:28:04.689 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-05T17:28:05.034 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-any. 2024-09-05T17:28:05.058 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-05T17:28:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-05T17:28:05.353 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package zip. 2024-09-05T17:28:05.380 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-05T17:28:05.420 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking zip (3.0-12build2) ... 2024-09-05T17:28:05.690 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package unzip. 2024-09-05T17:28:05.705 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-05T17:28:05.740 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-05T17:28:06.127 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package luarocks. 2024-09-05T17:28:06.145 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-base. 2024-09-05T17:28:06.154 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-05T17:28:06.171 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:06.194 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-05T17:28:06.212 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-base (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:06.576 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package librgw2. 2024-09-05T17:28:06.603 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../025-librgw2_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:06.643 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking librgw2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:06.824 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-05T17:28:06.850 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-05T17:28:06.890 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-05T17:28:07.202 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cheroot. 2024-09-05T17:28:07.228 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-05T17:28:07.262 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rgw. 2024-09-05T17:28:07.268 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-05T17:28:07.285 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:07.320 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rgw (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:07.580 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-05T17:28:07.607 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-05T17:28:07.640 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-05T17:28:07.646 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-05T17:28:07.667 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-05T17:28:07.706 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-05T17:28:07.949 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-05T17:28:07.975 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-05T17:28:08.017 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libradosstriper1. 2024-09-05T17:28:08.024 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-05T17:28:08.044 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:08.084 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libradosstriper1 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:08.344 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-05T17:28:08.370 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-05T17:28:08.410 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-05T17:28:08.546 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-common. 2024-09-05T17:28:08.573 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:08.612 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-common (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:08.722 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempora. 2024-09-05T17:28:08.748 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-05T17:28:08.788 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-05T17:28:09.091 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-portend. 2024-09-05T17:28:09.117 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-05T17:28:09.158 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-05T17:28:09.486 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-05T17:28:09.512 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-05T17:28:09.552 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-05T17:28:09.864 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-05T17:28:09.890 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-05T17:28:09.930 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-05T17:28:10.101 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-base. 2024-09-05T17:28:10.128 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:10.177 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-base (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:10.276 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-natsort. 2024-09-05T17:28:10.302 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-05T17:28:10.342 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-05T17:28:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-logutils. 2024-09-05T17:28:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-05T17:28:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-05T17:28:10.730 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-05T17:28:10.758 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-05T17:28:10.797 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-05T17:28:11.040 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-05T17:28:11.066 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-05T17:28:11.100 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cheroot. 2024-09-05T17:28:11.106 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-05T17:28:11.126 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-05T17:28:11.166 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-05T17:28:11.384 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-mako. 2024-09-05T17:28:11.410 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-05T17:28:11.451 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-05T17:28:11.678 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-05T17:28:11.705 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-05T17:28:11.744 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-05T17:28:11.746 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-05T17:28:11.761 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-05T17:28:11.796 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-05T17:28:12.014 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-05T17:28:12.030 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-05T17:28:12.063 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-05T17:28:12.082 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-05T17:28:12.108 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-05T17:28:12.149 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-05T17:28:12.366 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-05T17:28:12.394 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-05T17:28:12.433 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-05T17:28:12.451 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webob. 2024-09-05T17:28:12.477 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-05T17:28:12.518 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-05T17:28:12.728 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempora. 2024-09-05T17:28:12.755 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-05T17:28:12.794 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-05T17:28:12.854 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-waitress. 2024-09-05T17:28:12.881 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-05T17:28:12.924 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-05T17:28:13.072 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-portend. 2024-09-05T17:28:13.088 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-05T17:28:13.122 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-05T17:28:13.182 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempita. 2024-09-05T17:28:13.197 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-05T17:28:13.232 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-05T17:28:13.400 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-05T17:28:13.426 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-05T17:28:13.466 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-05T17:28:13.518 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-paste. 2024-09-05T17:28:13.544 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-05T17:28:13.585 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-05T17:28:13.828 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-05T17:28:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-05T17:28:13.894 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-05T17:28:13.921 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-05T17:28:13.948 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-05T17:28:13.988 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-05T17:28:14.223 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-natsort. 2024-09-05T17:28:14.250 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-05T17:28:14.289 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-05T17:28:14.291 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-05T17:28:14.317 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-05T17:28:14.357 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-05T17:28:14.567 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-logutils. 2024-09-05T17:28:14.594 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-05T17:28:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webtest. 2024-09-05T17:28:14.625 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-05T17:28:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-05T17:28:14.686 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-05T17:28:14.912 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-05T17:28:14.939 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-05T17:28:14.978 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-05T17:28:15.005 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pecan. 2024-09-05T17:28:15.031 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-05T17:28:15.072 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-05T17:28:15.281 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-mako. 2024-09-05T17:28:15.308 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-05T17:28:15.348 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-05T17:28:15.435 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-certifi. 2024-09-05T17:28:15.461 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-05T17:28:15.501 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-05T17:28:15.718 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-05T17:28:15.744 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-05T17:28:15.784 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-05T17:28:15.821 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-idna. 2024-09-05T17:28:15.847 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-05T17:28:15.887 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-05T17:28:16.054 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-05T17:28:16.081 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-05T17:28:16.112 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-05T17:28:16.391 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-urllib3. 2024-09-05T17:28:16.406 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webob. 2024-09-05T17:28:16.417 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-05T17:28:16.433 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-05T17:28:16.449 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-05T17:28:16.473 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-05T17:28:16.735 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests. 2024-09-05T17:28:16.750 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-05T17:28:16.785 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-05T17:28:16.868 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-waitress. 2024-09-05T17:28:16.894 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-05T17:28:16.937 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-05T17:28:17.055 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-05T17:28:17.081 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-05T17:28:17.122 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-05T17:28:17.254 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-tempita. 2024-09-05T17:28:17.281 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-05T17:28:17.320 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-05T17:28:17.374 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-05T17:28:17.390 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:17.424 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:17.631 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-paste. 2024-09-05T17:28:17.658 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-05T17:28:17.698 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-05T17:28:17.804 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-05T17:28:17.831 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:17.871 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:18.026 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-05T17:28:18.053 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-05T17:28:18.093 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-05T17:28:18.140 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-05T17:28:18.159 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-05T17:28:18.192 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-05T17:28:18.379 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-05T17:28:18.406 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-05T17:28:18.443 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-openssl. 2024-09-05T17:28:18.445 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-05T17:28:18.456 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-05T17:28:18.485 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-05T17:28:18.715 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-webtest. 2024-09-05T17:28:18.742 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-05T17:28:18.773 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-05T17:28:18.830 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr. 2024-09-05T17:28:18.856 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:18.904 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:19.093 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pecan. 2024-09-05T17:28:19.120 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-05T17:28:19.176 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-05T17:28:19.299 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon. 2024-09-05T17:28:19.326 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:19.366 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:19.539 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-certifi. 2024-09-05T17:28:19.567 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-05T17:28:19.605 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-05T17:28:19.911 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd. 2024-09-05T17:28:19.917 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-idna. 2024-09-05T17:28:19.933 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-05T17:28:19.937 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:19.975 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-05T17:28:19.978 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:20.270 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-urllib3. 2024-09-05T17:28:20.297 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-05T17:28:20.336 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-05T17:28:20.631 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests. 2024-09-05T17:28:20.659 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-05T17:28:20.698 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-05T17:28:21.009 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-05T17:28:21.037 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-05T17:28:21.073 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph. 2024-09-05T17:28:21.075 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-05T17:28:21.088 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../066-ceph_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:21.131 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:21.347 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-05T17:28:21.375 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:21.414 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:21.459 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse. 2024-09-05T17:28:21.485 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:21.525 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:21.879 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds. 2024-09-05T17:28:21.905 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:21.935 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-05T17:28:21.936 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:21.963 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:21.993 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:22.288 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-05T17:28:22.315 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephadm. 2024-09-05T17:28:22.315 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-05T17:28:22.341 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../069-cephadm_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:22.354 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-05T17:28:22.381 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephadm (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:22.674 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-openssl. 2024-09-05T17:28:22.701 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-05T17:28:22.701 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-05T17:28:22.727 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-05T17:28:22.741 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-05T17:28:22.767 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-05T17:28:23.094 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr. 2024-09-05T17:28:23.112 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-05T17:28:23.121 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:23.138 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-05T17:28:23.160 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:23.178 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-05T17:28:23.505 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mon. 2024-09-05T17:28:23.521 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:23.555 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mon (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:24.175 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-osd. 2024-09-05T17:28:24.202 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:24.216 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-babel. 2024-09-05T17:28:24.242 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-osd (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:24.243 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-05T17:28:24.283 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-05T17:28:24.578 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jinja2. 2024-09-05T17:28:24.604 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-05T17:28:24.644 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-05T17:28:24.972 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-05T17:28:24.988 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:25.022 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:25.318 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-05T17:28:25.328 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph. 2024-09-05T17:28:25.344 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-05T17:28:25.355 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../066-ceph_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:25.375 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-05T17:28:25.394 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:25.662 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-routes. 2024-09-05T17:28:25.681 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-fuse. 2024-09-05T17:28:25.688 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-05T17:28:25.708 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:25.736 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-05T17:28:25.739 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-fuse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:26.067 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mds. 2024-09-05T17:28:26.073 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-05T17:28:26.094 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:26.100 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:26.133 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mds (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:26.139 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:26.570 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package cephadm. 2024-09-05T17:28:26.597 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../069-cephadm_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:26.636 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking cephadm (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:26.931 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-05T17:28:26.947 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-05T17:28:27.064 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-05T17:28:27.476 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-05T17:28:27.503 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-05T17:28:27.542 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-05T17:28:28.564 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-babel. 2024-09-05T17:28:28.591 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-05T17:28:28.622 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-05T17:28:28.933 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-jinja2. 2024-09-05T17:28:28.961 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-05T17:28:29.000 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-05T17:28:29.270 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-05T17:28:29.300 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-05T17:28:29.353 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-05T17:28:29.419 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-05T17:28:29.447 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:29.486 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:29.807 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-joblib. 2024-09-05T17:28:29.814 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-05T17:28:29.834 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-05T17:28:29.841 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-05T17:28:29.873 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-05T17:28:29.881 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-05T17:28:30.167 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-routes. 2024-09-05T17:28:30.195 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-05T17:28:30.233 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-05T17:28:30.243 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-05T17:28:30.271 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-05T17:28:30.310 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-05T17:28:30.580 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-05T17:28:30.606 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:30.629 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn. 2024-09-05T17:28:30.644 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:30.657 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-05T17:28:30.696 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-05T17:28:31.405 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-05T17:28:31.433 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:31.557 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:32.602 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cachetools. 2024-09-05T17:28:32.618 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-05T17:28:32.660 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-05T17:28:32.972 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-05T17:28:32.999 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-05T17:28:33.038 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-05T17:28:33.375 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-05T17:28:33.403 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-05T17:28:33.433 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-05T17:28:33.444 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-05T17:28:33.451 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-05T17:28:33.491 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-05T17:28:33.936 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rsa. 2024-09-05T17:28:33.964 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-05T17:28:33.995 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-joblib. 2024-09-05T17:28:34.003 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-05T17:28:34.023 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-05T17:28:34.061 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-05T17:28:34.290 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-google-auth. 2024-09-05T17:28:34.317 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-05T17:28:34.348 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-05T17:28:34.398 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-05T17:28:34.426 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-05T17:28:34.464 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-05T17:28:34.601 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-05T17:28:34.617 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-05T17:28:34.659 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-05T17:28:34.767 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-sklearn. 2024-09-05T17:28:34.795 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-05T17:28:34.833 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-05T17:28:34.979 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-websocket. 2024-09-05T17:28:35.008 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-05T17:28:35.046 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-05T17:28:35.341 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-05T17:28:35.369 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-05T17:28:35.399 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-05T17:28:35.567 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-05T17:28:35.596 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:35.719 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:36.055 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-05T17:28:36.072 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:36.105 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:36.408 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-05T17:28:36.436 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-05T17:28:36.474 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-05T17:28:36.698 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-cachetools. 2024-09-05T17:28:36.726 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-05T17:28:36.765 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-05T17:28:36.802 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-05T17:28:36.830 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-05T17:28:36.868 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-05T17:28:37.076 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-05T17:28:37.104 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-05T17:28:37.105 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package jq. 2024-09-05T17:28:37.121 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-05T17:28:37.142 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-05T17:28:37.163 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-05T17:28:37.391 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package socat. 2024-09-05T17:28:37.419 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-05T17:28:37.457 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-05T17:28:37.687 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-05T17:28:37.704 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-05T17:28:37.745 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-05T17:28:37.777 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package xmlstarlet. 2024-09-05T17:28:37.793 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-05T17:28:37.835 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-05T17:28:38.074 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-rsa. 2024-09-05T17:28:38.102 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-05T17:28:38.141 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-05T17:28:38.165 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test. 2024-09-05T17:28:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:38.223 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:38.444 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-google-auth. 2024-09-05T17:28:38.472 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-05T17:28:38.510 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-05T17:28:38.839 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-05T17:28:38.867 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-05T17:28:38.905 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-05T17:28:39.217 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-websocket. 2024-09-05T17:28:39.246 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-05T17:28:39.350 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-05T17:28:39.670 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-05T17:28:39.698 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-05T17:28:39.736 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-05T17:28:40.358 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-05T17:28:40.376 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:40.408 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:40.761 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-05T17:28:40.790 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-05T17:28:40.811 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-volume. 2024-09-05T17:28:40.839 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:40.844 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-05T17:28:40.877 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-volume (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:41.164 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-05T17:28:41.192 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-05T17:28:41.208 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-05T17:28:41.224 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:41.230 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-05T17:28:41.266 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs-dev (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:41.475 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package jq. 2024-09-05T17:28:41.492 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-05T17:28:41.525 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-05T17:28:41.577 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-05T17:28:41.606 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-05T17:28:41.644 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-05T17:28:41.727 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package socat. 2024-09-05T17:28:41.756 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-05T17:28:41.794 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-05T17:28:41.940 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-05T17:28:41.968 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-05T17:28:42.006 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-05T17:28:42.114 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package xmlstarlet. 2024-09-05T17:28:42.139 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-05T17:28:42.180 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-05T17:28:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package nvme-cli. 2024-09-05T17:28:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-05T17:28:42.445 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-05T17:28:42.535 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-test. 2024-09-05T17:28:42.551 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:42.593 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-test (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:42.857 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pkg-config. 2024-09-05T17:28:42.885 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-05T17:28:42.931 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-05T17:28:43.192 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-05T17:28:43.209 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-05T17:28:43.251 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-05T17:28:43.696 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-05T17:28:43.723 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-05T17:28:43.762 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-05T17:28:44.065 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastescript. 2024-09-05T17:28:44.092 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-05T17:28:44.131 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-05T17:28:44.460 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pluggy. 2024-09-05T17:28:44.488 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-05T17:28:44.526 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-05T17:28:44.812 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-psutil. 2024-09-05T17:28:44.840 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-05T17:28:44.879 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-05T17:28:45.215 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-py. 2024-09-05T17:28:45.243 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-05T17:28:45.282 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-05T17:28:45.297 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package ceph-volume. 2024-09-05T17:28:45.326 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4648-gb0d82736-1jammy_all.deb ... 2024-09-05T17:28:45.363 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking ceph-volume (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:45.577 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pygments. 2024-09-05T17:28:45.605 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-05T17:28:45.643 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-05T17:28:45.659 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-05T17:28:45.677 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:45.726 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking libcephfs-dev (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:46.045 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-05T17:28:46.074 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-05T17:28:46.080 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-05T17:28:46.109 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-05T17:28:46.111 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-05T17:28:46.147 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-05T17:28:46.450 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-05T17:28:46.466 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-toml. 2024-09-05T17:28:46.478 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-05T17:28:46.495 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-05T17:28:46.516 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-05T17:28:46.532 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-05T17:28:46.812 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package nvme-cli. 2024-09-05T17:28:46.835 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pytest. 2024-09-05T17:28:46.840 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-05T17:28:46.864 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-05T17:28:46.870 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-05T17:28:46.902 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-05T17:28:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplejson. 2024-09-05T17:28:47.275 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-05T17:28:47.292 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package pkg-config. 2024-09-05T17:28:47.313 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-05T17:28:47.321 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-05T17:28:47.358 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-05T17:28:47.600 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-05T17:28:47.620 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-05T17:28:47.628 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-05T17:28:47.636 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-05T17:28:47.666 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-05T17:28:47.677 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-05T17:28:48.123 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-05T17:28:48.151 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-05T17:28:48.189 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-05T17:28:48.395 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw. 2024-09-05T17:28:48.423 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../116-radosgw_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:48.433 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pastescript. 2024-09-05T17:28:48.451 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-05T17:28:48.461 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:48.483 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-05T17:28:48.778 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pluggy. 2024-09-05T17:28:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-05T17:28:48.845 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-05T17:28:49.156 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-psutil. 2024-09-05T17:28:49.185 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-05T17:28:49.223 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-05T17:28:49.414 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse. 2024-09-05T17:28:49.442 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:49.568 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-py. 2024-09-05T17:28:49.596 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-05T17:28:49.597 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:49.634 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-05T17:28:49.885 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-05T17:28:49.954 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pygments. 2024-09-05T17:28:49.982 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-05T17:28:50.020 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-05T17:28:50.169 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-05T17:28:50.295 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-05T17:28:50.483 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-05T17:28:50.512 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-05T17:28:50.549 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-05T17:28:50.554 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-05T17:28:50.835 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-toml. 2024-09-05T17:28:50.852 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-05T17:28:50.874 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-05T17:28:50.885 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-05T17:28:51.180 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-pytest. 2024-09-05T17:28:51.209 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-05T17:28:51.246 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-05T17:28:51.315 INFO:teuthology.orchestra.run.smithi110.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-05T17:28:51.380 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephadm (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:51.591 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package python3-simplejson. 2024-09-05T17:28:51.620 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-05T17:28:51.658 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-05T17:28:51.910 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-05T17:28:51.927 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-05T17:28:51.929 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user cephadm....done 2024-09-05T17:28:51.960 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-05T17:28:52.085 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-05T17:28:52.345 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-05T17:28:52.596 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-05T17:28:52.639 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package radosgw. 2024-09-05T17:28:52.668 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../116-radosgw_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:52.697 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-05T17:28:52.705 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking radosgw (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:52.940 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-05T17:28:53.208 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-05T17:28:53.334 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-05T17:28:53.661 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-05T17:28:53.675 INFO:teuthology.orchestra.run.smithi050.stdout:Selecting previously unselected package rbd-fuse. 2024-09-05T17:28:53.693 INFO:teuthology.orchestra.run.smithi050.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4648-gb0d82736-1jammy_amd64.deb ... 2024-09-05T17:28:53.734 INFO:teuthology.orchestra.run.smithi050.stdout:Unpacking rbd-fuse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:54.029 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-05T17:28:54.048 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-05T17:28:54.280 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-05T17:28:54.297 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-05T17:28:54.423 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-05T17:28:54.548 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-05T17:28:54.693 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-05T17:28:54.841 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-05T17:28:55.046 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-05T17:28:55.092 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-05T17:28:55.352 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-05T17:28:55.458 INFO:teuthology.orchestra.run.smithi050.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-05T17:28:55.550 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up cephadm (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:55.586 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-argparse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:28:55.837 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-05T17:28:55.946 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-05T17:28:56.047 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-05T17:28:56.148 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-05T17:28:56.168 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user cephadm....done 2024-09-05T17:28:56.332 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-05T17:28:56.416 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-05T17:28:56.784 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-05T17:28:56.813 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-05T17:28:56.869 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-05T17:28:56.970 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-05T17:28:57.042 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-05T17:28:57.302 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-05T17:28:57.348 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-05T17:28:57.428 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-05T17:28:57.472 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-05T17:28:57.746 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-05T17:28:57.757 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-05T17:28:58.005 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-05T17:28:58.041 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-05T17:28:58.131 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-05T17:28:58.342 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up zip (3.0-12build2) ... 2024-09-05T17:28:58.450 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-05T17:28:58.468 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-05T17:28:58.852 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-05T17:28:59.111 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-05T17:28:59.112 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-05T17:28:59.354 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-05T17:28:59.395 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-05T17:28:59.455 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-05T17:28:59.556 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-05T17:28:59.614 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-05T17:28:59.890 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-05T17:28:59.948 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-05T17:29:00.141 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-05T17:29:00.392 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-argparse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:00.509 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-05T17:29:00.652 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-05T17:29:00.759 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-05T17:29:00.777 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-05T17:29:00.903 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-05T17:29:01.004 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-05T17:29:01.119 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-05T17:29:01.264 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-05T17:29:01.412 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-05T17:29:01.661 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-05T17:29:01.687 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-05T17:29:01.734 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-05T17:29:01.747 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-05T17:29:01.860 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-05T17:29:01.981 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-05T17:29:02.116 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-common (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:02.245 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-05T17:29:02.371 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-05T17:29:02.417 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-05T17:29:02.646 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-05T17:29:02.735 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-05T17:29:02.914 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-05T17:29:03.257 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up zip (3.0-12build2) ... 2024-09-05T17:29:03.384 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-05T17:29:03.890 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-05T17:29:04.085 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-05T17:29:04.175 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:29:04.309 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-05T17:29:04.345 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-05T17:29:04.446 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-05T17:29:04.560 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-05T17:29:04.563 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-05T17:29:04.661 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-05T17:29:04.787 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-05T17:29:04.873 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-05T17:29:05.072 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-05T17:29:05.258 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-05T17:29:05.314 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-05T17:29:05.509 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-05T17:29:05.566 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:29:05.692 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-05T17:29:05.902 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-05T17:29:06.001 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-05T17:29:06.195 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-05T17:29:06.244 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-05T17:29:06.503 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-05T17:29:06.546 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-05T17:29:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-05T17:29:06.831 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-05T17:29:06.957 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-ceph-common (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:06.980 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-05T17:29:07.223 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-05T17:29:07.285 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-05T17:29:07.358 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-05T17:29:07.603 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-05T17:29:07.651 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-05T17:29:07.776 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-05T17:29:08.061 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-05T17:29:08.337 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-05T17:29:08.588 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-05T17:29:08.714 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-05T17:29:08.834 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-05T17:29:08.840 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-05T17:29:08.929 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-05T17:29:09.094 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:29:09.158 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-05T17:29:09.254 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-05T17:29:09.284 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-05T17:29:09.513 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-05T17:29:09.639 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-05T17:29:09.668 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-05T17:29:09.765 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-05T17:29:09.920 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-05T17:29:10.037 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-05T17:29:10.058 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-05T17:29:10.272 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:29:10.326 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-05T17:29:10.398 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-05T17:29:10.578 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:29:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-05T17:29:10.703 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-05T17:29:11.000 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-05T17:29:11.030 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-05T17:29:11.276 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-05T17:29:11.306 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-05T17:29:11.402 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-05T17:29:11.591 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-05T17:29:11.653 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-05T17:29:11.858 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-05T17:29:11.921 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-05T17:29:12.126 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-05T17:29:12.249 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-05T17:29:12.436 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-05T17:29:12.545 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-05T17:29:12.626 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-05T17:29:12.838 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-05T17:29:12.902 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-05T17:29:12.965 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-05T17:29:13.221 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-05T17:29:13.257 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-05T17:29:13.332 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:13.431 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:13.550 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-05T17:29:13.557 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-05T17:29:13.793 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-05T17:29:13.894 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:13.919 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-05T17:29:14.020 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:14.020 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-05T17:29:14.110 INFO:teuthology.orchestra.run.smithi050.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-05T17:29:14.146 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-05T17:29:14.405 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:14.406 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-05T17:29:14.531 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-05T17:29:14.532 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-modules-core (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:14.880 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-05T17:29:14.880 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-05T17:29:14.916 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-05T17:29:15.184 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-05T17:29:15.311 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-05T17:29:15.334 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs-dev (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:15.451 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rados (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:15.553 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:15.570 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-05T17:29:15.653 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-05T17:29:15.704 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-05T17:29:16.055 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-05T17:29:16.365 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-05T17:29:16.658 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-05T17:29:16.784 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-05T17:29:16.865 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rbd (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:16.991 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:17.117 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rgw (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:17.118 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-05T17:29:17.243 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cephfs (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:17.386 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:17.386 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-05T17:29:17.748 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-05T17:29:17.878 INFO:teuthology.orchestra.run.smithi110.stdout:Adding group ceph....done 2024-09-05T17:29:18.150 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-05T17:29:18.238 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user ceph....done 2024-09-05T17:29:18.415 INFO:teuthology.orchestra.run.smithi110.stdout:Setting system user ceph properties....done 2024-09-05T17:29:18.431 INFO:teuthology.orchestra.run.smithi110.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-05T17:29:18.436 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-05T17:29:18.573 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-05T17:29:18.804 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-05T17:29:18.904 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-05T17:29:18.930 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librados2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:19.056 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:19.182 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-05T17:29:19.378 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:19.504 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:19.535 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:19.653 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libradosstriper1 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:19.763 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-05T17:29:19.962 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-05T17:29:19.962 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-05T17:29:20.031 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librbd1 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:20.157 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-modules-core (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:20.283 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-fuse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:20.414 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-base (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:20.499 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-05T17:29:20.500 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-05T17:29:20.726 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-05T17:29:20.984 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up libcephfs-dev (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:21.119 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rados (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:21.217 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:21.245 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up librgw2 (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:21.362 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-05T17:29:21.492 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-05T17:29:21.492 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-05T17:29:22.011 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:22.226 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-05T17:29:22.226 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-05T17:29:22.650 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rbd (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:22.728 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:22.776 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up rbd-fuse (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:22.927 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-rgw (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:23.050 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-05T17:29:23.050 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-05T17:29:23.053 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up python3-cephfs (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:23.163 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-common (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:23.558 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:23.676 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:23.802 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:23.998 INFO:teuthology.orchestra.run.smithi050.stdout:Adding group ceph....done 2024-09-05T17:29:23.999 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-05T17:29:23.999 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-05T17:29:24.374 INFO:teuthology.orchestra.run.smithi050.stdout:Adding system user ceph....done 2024-09-05T17:29:24.486 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-cephadm (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:24.535 INFO:teuthology.orchestra.run.smithi050.stdout:Setting system user ceph properties....done 2024-09-05T17:29:24.554 INFO:teuthology.orchestra.run.smithi050.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-05T17:29:24.637 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:24.699 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-05T17:29:24.755 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dashboard (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:24.881 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-volume (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:25.056 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-05T17:29:25.217 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-05T17:29:25.326 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-05T17:29:25.556 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-test (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:25.595 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-05T17:29:25.682 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up radosgw (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:26.173 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-05T17:29:26.173 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-05T17:29:26.642 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-base (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:26.721 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-05T17:29:27.004 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-05T17:29:27.358 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-05T17:29:27.364 DEBUG:teuthology.parallel:result is None 2024-09-05T17:29:27.486 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mds (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:27.716 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-05T17:29:27.716 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-05T17:29:28.196 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:28.411 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-05T17:29:28.411 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-05T17:29:28.856 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-osd (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:29.185 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-05T17:29:29.185 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-05T17:29:29.692 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:29.827 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:30.003 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mon (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:30.227 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-05T17:29:30.227 INFO:teuthology.orchestra.run.smithi050.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-05T17:29:30.679 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-cephadm (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:30.847 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:30.973 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-mgr-dashboard (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:31.124 INFO:teuthology.orchestra.run.smithi050.stdout:Setting up ceph-volume (19.3.0-4648-gb0d82736-1jammy) ... 2024-09-05T17:29:31.494 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-05T17:29:31.603 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-05T17:29:31.747 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-05T17:29:32.915 INFO:teuthology.orchestra.run.smithi050.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-05T17:29:33.601 INFO:teuthology.orchestra.run.smithi050.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-05T17:29:33.606 DEBUG:teuthology.parallel:result is None 2024-09-05T17:29:33.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0d82736d7e74c3301ced0a9a1f1715342226ca2 2024-09-05T17:29:33.758 DEBUG:teuthology.orchestra.run.smithi050:> dpkg-query -W -f '${Version}' ceph 2024-09-05T17:29:33.777 INFO:teuthology.orchestra.run.smithi050.stdout:19.3.0-4648-gb0d82736-1jammy 2024-09-05T17:29:33.778 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4648-gb0d82736-1jammy 2024-09-05T17:29:33.778 INFO:teuthology.task.install:The correct ceph version 19.3.0-4648-gb0d82736-1jammy is installed. 2024-09-05T17:29:33.780 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b0d82736d7e74c3301ced0a9a1f1715342226ca2 2024-09-05T17:29:33.919 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-query -W -f '${Version}' ceph 2024-09-05T17:29:33.940 INFO:teuthology.orchestra.run.smithi110.stdout:19.3.0-4648-gb0d82736-1jammy 2024-09-05T17:29:33.940 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4648-gb0d82736-1jammy 2024-09-05T17:29:33.940 INFO:teuthology.task.install:The correct ceph version 19.3.0-4648-gb0d82736-1jammy is installed. 2024-09-05T17:29:33.943 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-05T17:29:33.999 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:33.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T17:29:34.021 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:29:34.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T17:29:34.035 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-05T17:29:34.036 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:34.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T17:29:34.077 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T17:29:34.133 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:29:34.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T17:29:34.147 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T17:29:34.203 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-05T17:29:34.203 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:34.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T17:29:34.250 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T17:29:34.305 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:29:34.306 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T17:29:34.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T17:29:34.374 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-05T17:29:34.375 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:34.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T17:29:34.390 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T17:29:34.451 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:29:34.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T17:29:34.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T17:29:34.523 INFO:teuthology.run_tasks:Running task ceph... 2024-09-05T17:29:34.718 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-05T17:29:34.718 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 777 /var/log/ceph 2024-09-05T17:29:34.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-09-05T17:29:34.734 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-05T17:29:34.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-05T17:29:34.779 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-05T17:29:34.791 INFO:tasks.ceph:Creating extra log directories... 2024-09-05T17:29:34.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-05T17:29:34.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-05T17:29:34.866 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-05T17:29:34.866 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-05T17:29:34.866 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094', 'branch': 'main', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7888094', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b0d82736d7e74c3301ced0a9a1f1715342226ca2'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0d82736d7e74c3301ced0a9a1f1715342226ca2'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'bba65b233b90d20d9ab694d2201126759501459c'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 3321, 'sha1': 'b0d82736d7e74c3301ced0a9a1f1715342226ca2', 'sleep_before_teardown': 0, 'subset': '62/128', 'suite': 'rbd', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_bba65b233b90d20d9ab694d2201126759501459c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'bba65b233b90d20d9ab694d2201126759501459c', 'targets': {'smithi050.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDihWcWz01nw4U8p6giJTf/TR3XCC8R5FFWh5mleVvN4IN0OF4iEywZffmOmIVnPWnLChp0BgBKuV9cNj2gs0Jw=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNBh4HronDqgiVsaM+BQe3p6hKjnjAd7Lij4E0+Mo/DxdsJzZcUWkXZ302mc66HV6hcHwXj8wF/Or9V5Y8iSTik='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-03_20:16:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-05T17:29:34.867 DEBUG:teuthology.orchestra.run.smithi050:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-05T17:29:34.890 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-05T17:29:34.895 DEBUG:teuthology.orchestra.run.smithi050:> sudo install -d -m0777 -- /var/run/ceph 2024-09-05T17:29:34.938 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-09-05T17:29:34.951 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:34.951 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T17:29:34.997 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T17:29:34.997 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_1 2024-09-05T17:29:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T17:29:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T17:29:35.046 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-09-05T17:29:35.046 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T17:29:35.046 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-05 17:23:54.193211378 +0000 2024-09-05T17:29:35.046 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-05 17:23:53.921213793 +0000 2024-09-05T17:29:35.046 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-05 17:23:53.921213793 +0000 2024-09-05T17:29:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-05T17:29:35.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T17:29:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-05T17:29:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-05T17:29:35.100 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000316522 s, 1.6 MB/s 2024-09-05T17:29:35.102 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T17:29:35.151 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_2 2024-09-05T17:29:35.197 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T17:29:35.197 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T17:29:35.198 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-05T17:29:35.198 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T17:29:35.198 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-05 17:23:54.713206761 +0000 2024-09-05T17:29:35.198 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-05 17:23:54.449209105 +0000 2024-09-05T17:29:35.198 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-05 17:23:54.449209105 +0000 2024-09-05T17:29:35.198 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-05T17:29:35.198 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T17:29:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-05T17:29:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-05T17:29:35.252 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000310711 s, 1.6 MB/s 2024-09-05T17:29:35.253 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T17:29:35.302 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_3 2024-09-05T17:29:35.349 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T17:29:35.349 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T17:29:35.350 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-09-05T17:29:35.350 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T17:29:35.350 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-05 17:23:54.949204667 +0000 2024-09-05T17:29:35.350 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-05 17:23:54.945204702 +0000 2024-09-05T17:29:35.350 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-05 17:23:54.945204702 +0000 2024-09-05T17:29:35.350 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-05T17:29:35.350 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T17:29:35.404 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-05T17:29:35.404 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-05T17:29:35.404 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000208867 s, 2.5 MB/s 2024-09-05T17:29:35.405 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T17:29:35.454 DEBUG:teuthology.orchestra.run.smithi050:> stat /dev/vg_nvme/lv_4 2024-09-05T17:29:35.502 INFO:teuthology.orchestra.run.smithi050.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T17:29:35.502 INFO:teuthology.orchestra.run.smithi050.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T17:29:35.502 INFO:teuthology.orchestra.run.smithi050.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-09-05T17:29:35.502 INFO:teuthology.orchestra.run.smithi050.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T17:29:35.502 INFO:teuthology.orchestra.run.smithi050.stdout:Access: 2024-09-05 17:23:55.689198097 +0000 2024-09-05T17:29:35.502 INFO:teuthology.orchestra.run.smithi050.stdout:Modify: 2024-09-05 17:23:55.413200547 +0000 2024-09-05T17:29:35.502 INFO:teuthology.orchestra.run.smithi050.stdout:Change: 2024-09-05 17:23:55.413200547 +0000 2024-09-05T17:29:35.503 INFO:teuthology.orchestra.run.smithi050.stdout: Birth: - 2024-09-05T17:29:35.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T17:29:35.555 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records in 2024-09-05T17:29:35.555 INFO:teuthology.orchestra.run.smithi050.stderr:1+0 records out 2024-09-05T17:29:35.555 INFO:teuthology.orchestra.run.smithi050.stderr:512 bytes copied, 0.000230045 s, 2.2 MB/s 2024-09-05T17:29:35.556 DEBUG:teuthology.orchestra.run.smithi050:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T17:29:35.607 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:35.607 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:29:35.607 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T17:29:35.613 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T17:29:35.613 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-09-05T17:29:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T17:29:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T17:29:35.660 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-05T17:29:35.660 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T17:29:35.660 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-05 17:23:48.158031653 +0000 2024-09-05T17:29:35.660 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-05 17:23:48.154031689 +0000 2024-09-05T17:29:35.660 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-05 17:23:48.154031689 +0000 2024-09-05T17:29:35.660 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-05T17:29:35.661 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T17:29:35.714 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-05T17:29:35.715 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-05T17:29:35.715 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000315274 s, 1.6 MB/s 2024-09-05T17:29:35.716 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T17:29:35.766 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-09-05T17:29:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T17:29:35.812 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T17:29:35.812 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-09-05T17:29:35.812 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T17:29:35.813 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-05 17:23:48.642027330 +0000 2024-09-05T17:29:35.813 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-05 17:23:48.638027366 +0000 2024-09-05T17:29:35.813 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-05 17:23:48.638027366 +0000 2024-09-05T17:29:35.813 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-05T17:29:35.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T17:29:35.866 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-05T17:29:35.866 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-05T17:29:35.866 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000204554 s, 2.5 MB/s 2024-09-05T17:29:35.867 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T17:29:35.917 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-09-05T17:29:35.963 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T17:29:35.963 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T17:29:35.963 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-05T17:29:35.963 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T17:29:35.964 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-05 17:23:49.394020613 +0000 2024-09-05T17:29:35.964 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-05 17:23:49.122023043 +0000 2024-09-05T17:29:35.964 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-05 17:23:49.122023043 +0000 2024-09-05T17:29:35.964 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-05T17:29:35.964 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T17:29:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-05T17:29:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-05T17:29:36.018 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000312541 s, 1.6 MB/s 2024-09-05T17:29:36.019 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T17:29:36.069 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-09-05T17:29:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T17:29:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T17:29:36.116 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-09-05T17:29:36.116 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T17:29:36.116 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-05 17:23:49.658018255 +0000 2024-09-05T17:29:36.116 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-05 17:23:49.654018290 +0000 2024-09-05T17:29:36.116 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-05 17:23:49.654018290 +0000 2024-09-05T17:29:36.116 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-05T17:29:36.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T17:29:36.170 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-05T17:29:36.170 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-05T17:29:36.170 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000302548 s, 1.7 MB/s 2024-09-05T17:29:36.171 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T17:29:36.221 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:36.221 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-05T17:29:36.221 INFO:tasks.ceph:Generating config... 2024-09-05T17:29:36.224 INFO:tasks.ceph:[client] rbd cache = True 2024-09-05T17:29:36.224 INFO:tasks.ceph:[client] rbd cache max dirty = 0 2024-09-05T17:29:36.224 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-05T17:29:36.224 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-05T17:29:36.224 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-05T17:29:36.225 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-05T17:29:36.225 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-05T17:29:36.225 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-05T17:29:36.225 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-05T17:29:36.225 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-05T17:29:36.225 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-05T17:29:36.226 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-05T17:29:36.226 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-05T17:29:36.226 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-05T17:29:36.226 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-05T17:29:36.226 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-05T17:29:36.226 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-05T17:29:36.226 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-05T17:29:36.226 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-05T17:29:36.226 INFO:tasks.ceph:Setting up mon.a... 2024-09-05T17:29:36.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-05T17:29:36.261 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.keyring 2024-09-05T17:29:36.284 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-05T17:29:36.360 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T17:29:36.421 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.50'), ('mon.c', '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]'), ('mon.b', '172.21.15.110')] 2024-09-05T17:29:36.422 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.110', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache max dirty': 0}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-05T17:29:36.422 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:36.422 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-05T17:29:36.470 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.50 --addv c '[v2:172.21.15.50:3301,v1:172.21.15.50:6790]' --add b 172.21.15.110 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:36.557 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:36.558 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: generated fsid 229efc05-fdc4-4e1f-8246-413b49f3eeda 2024-09-05T17:29:36.558 INFO:teuthology.orchestra.run.smithi050.stdout:setting min_mon_release = quincy 2024-09-05T17:29:36.558 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 0 2024-09-05T17:29:36.558 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 229efc05-fdc4-4e1f-8246-413b49f3eeda 2024-09-05T17:29:36.558 INFO:teuthology.orchestra.run.smithi050.stdout:last_changed 2024-09-05T17:29:36.563366+0000 2024-09-05T17:29:36.558 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-09-05T17:29:36.563366+0000 2024-09-05T17:29:36.559 INFO:teuthology.orchestra.run.smithi050.stdout:min_mon_release 17 (quincy) 2024-09-05T17:29:36.559 INFO:teuthology.orchestra.run.smithi050.stdout:election_strategy: 1 2024-09-05T17:29:36.559 INFO:teuthology.orchestra.run.smithi050.stdout:0: [v2:172.21.15.50:3300/0,v1:172.21.15.50:6789/0] mon.a 2024-09-05T17:29:36.559 INFO:teuthology.orchestra.run.smithi050.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-05T17:29:36.559 INFO:teuthology.orchestra.run.smithi050.stdout:2: [v2:172.21.15.50:3301/0,v1:172.21.15.50:6790/0] mon.c 2024-09-05T17:29:36.559 INFO:teuthology.orchestra.run.smithi050.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-05T17:29:36.560 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-05T17:29:36.566 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 229efc05-fdc4-4e1f-8246-413b49f3eeda... 2024-09-05T17:29:36.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-05T17:29:36.611 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout:[global] 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: chdir = "" 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: auth supported = cephx 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: filestore xattr use omap = true 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: mon clock drift allowed = 1.000 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.639 INFO:teuthology.orchestra.run.smithi050.stdout: osd crush chooseleaf type = 0 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: auth debug = true 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on old message = true 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: ms die on bug = true 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: mon pg warn max object skew = 0 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: # disable pg_autoscaler by default for new pools 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default size = 2 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.640 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow primary affinity = true 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd allow pg remap = true 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on legacy crush tunables = false 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on crush straw calc version zero = false 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on no sortbitwise = false 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on osd down out interval zero = false 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on too few osds = false 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: mon_allow_pool_size_one = true 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.641 INFO:teuthology.orchestra.run.smithi050.stdout: osd default data pool replay window = 5 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: mon allow pool delete = true 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: mon cluster log file level = debug 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: debug asserts on shutdown = true 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: mon health detail to clog = false 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: mon host = "172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.110" 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: mon client directed command retry = 5 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: mon warn on pool no app = False 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: ms inject socket failures = 5000 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: fsid = 229efc05-fdc4-4e1f-8246-413b49f3eeda 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:[osd] 2024-09-05T17:29:36.642 INFO:teuthology.orchestra.run.smithi050.stdout: osd journal size = 100 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub load threshold = 5.0 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd scrub max interval = 600 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd mclock profile = high_recovery_ops 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd recover clone overlap = true 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd recovery max chunk = 1048576 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug shutdown = true 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug op order = true 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug verify stray on activate = true 2024-09-05T17:29:36.643 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug trim objects = true 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: osd open classes on start = true 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug pg log writeout = true 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: osd deep scrub update digest min age = 30 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: osd map max advance = 10 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: journal zero on create = true 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.644 INFO:teuthology.orchestra.run.smithi050.stdout: filestore ondisk finisher threads = 3 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: filestore apply finisher threads = 3 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: bdev debug aio = true 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: osd debug misdirected ops = true 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore block size = 96636764160 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore compression algorithm = zstd 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore compression mode = aggressive 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: bluestore fsck on mount = True 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluefs = 1/20 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: debug bluestore = 1/20 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: debug osd = 20 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: debug rocksdb = 4/10 2024-09-05T17:29:36.645 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd backfillfull_ratio = 0.85 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd full ratio = 0.9 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd nearfull ratio = 0.8 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: osd blocked scrub grace period = 3600 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: osd failsafe full ratio = 0.95 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: osd max markdown count = 1000 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: osd objectstore = bluestore 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: osd shutdown pgref assert = True 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr] 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: debug mgr = 20 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-05T17:29:36.646 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: mgr/telemetry/nag = false 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout:[mon] 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: debug ms = 1 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: debug mon = 20 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: debug paxos = 20 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: debug auth = 20 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: mon data avail warn = 5 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: mon mgr mkfs grace = 240 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min pgs per osd = 4 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd reporter subtree level = osd 2024-09-05T17:29:36.647 INFO:teuthology.orchestra.run.smithi050.stdout: mon osd prime pg temp = true 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: mon reweight min bytes per osd = 10 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: auth mon ticket ttl = 660 # 11m 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: auth service ticket ttl = 240 # 4m 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: # don't complain about insecure global_id in the test suite 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: # 1m isn't quite enough 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: mon_down_mkfs_grace = 2m 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.648 INFO:teuthology.orchestra.run.smithi050.stdout: mon_warn_on_filestore_osds = false 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:[client] 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: rgw cache enabled = true 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable ops log = true 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: rgw enable usage log = true 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: rbd cache = True 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout: rbd cache max dirty = 0 2024-09-05T17:29:36.649 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.a] 2024-09-05T17:29:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.c] 2024-09-05T17:29:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:[mon.b] 2024-09-05T17:29:36.650 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-09-05T17:29:36.650 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-09-05T17:29:36.651 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-09-05T17:29:36.652 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-09-05T17:29:36.653 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.110" 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: mon client directed command retry = 5 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on pool no app = False 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject socket failures = 5000 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 229efc05-fdc4-4e1f-8246-413b49f3eeda 2024-09-05T17:29:36.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-09-05T17:29:36.655 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-09-05T17:29:36.656 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore compression algorithm = zstd 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore compression mode = aggressive 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-09-05T17:29:36.657 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: osd blocked scrub grace period = 3600 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: osd max markdown count = 1000 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: osd shutdown pgref assert = True 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-09-05T17:29:36.658 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-09-05T17:29:36.659 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-05T17:29:36.660 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-05T17:29:36.661 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-05T17:29:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: rbd cache = True 2024-09-05T17:29:36.662 INFO:teuthology.orchestra.run.smithi110.stdout: rbd cache max dirty = 0 2024-09-05T17:29:36.662 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-09-05T17:29:36.662 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-09-05T17:29:36.662 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-09-05T17:29:36.663 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-05T17:29:36.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-05T17:29:36.755 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-05T17:29:36.755 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:36.755 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-05T17:29:36.761 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:36.761 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-05T17:29:36.809 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:29:36.809 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:36.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-05T17:29:36.809 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T17:29:36.877 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:29:36.878 DEBUG:teuthology.orchestra.run.smithi050:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:36.925 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:29:36.925 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:29:36.925 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-05T17:29:36.926 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-05T17:29:36.948 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:29:36.948 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:36.996 INFO:tasks.ceph:Setting up mon nodes... 2024-09-05T17:29:36.996 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-05T17:29:36.996 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-05T17:29:37.043 INFO:teuthology.orchestra.run.smithi050.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-05T17:29:37.046 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-05T17:29:37.090 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-05T17:29:37.103 INFO:tasks.ceph:Setting up mds nodes... 2024-09-05T17:29:37.103 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-05T17:29:37.103 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-05T17:29:37.139 INFO:teuthology.orchestra.run.smithi050.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-05T17:29:37.150 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-05T17:29:37.184 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-05T17:29:37.196 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-05T17:29:37.196 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi050.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-05T17:29:37.196 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-05T17:29:37.207 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:37.207 INFO:tasks.ceph:role: osd.0 2024-09-05T17:29:37.207 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:29:37.208 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-05T17:29:37.262 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T17:29:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T17:29:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T17:29:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T17:29:37.262 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T17:29:37.262 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-05T17:29:37.262 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T17:29:37.262 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T17:29:37.263 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T17:29:37.263 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T17:29:37.285 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-05T17:29:37.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-05T17:29:37.288 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-05T17:29:37.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-05T17:29:37.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:29:37.398 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T17:29:37.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-05T17:29:37.451 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:37.451 INFO:tasks.ceph:role: osd.1 2024-09-05T17:29:37.451 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:29:37.451 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-05T17:29:37.506 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T17:29:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T17:29:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T17:29:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T17:29:37.506 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T17:29:37.506 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-05T17:29:37.507 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T17:29:37.507 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T17:29:37.507 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T17:29:37.507 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T17:29:37.529 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-05T17:29:37.531 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-05T17:29:37.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-05T17:29:37.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-05T17:29:37.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:29:37.642 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T17:29:37.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-05T17:29:37.701 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:37.702 INFO:tasks.ceph:role: osd.2 2024-09-05T17:29:37.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:29:37.702 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-05T17:29:37.757 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T17:29:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T17:29:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T17:29:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T17:29:37.757 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T17:29:37.757 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-05T17:29:37.758 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T17:29:37.758 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T17:29:37.758 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T17:29:37.758 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T17:29:37.781 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-05T17:29:37.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-05T17:29:37.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-05T17:29:37.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-05T17:29:37.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:29:37.893 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T17:29:37.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-05T17:29:37.947 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:37.947 INFO:tasks.ceph:role: osd.3 2024-09-05T17:29:37.948 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:29:37.948 DEBUG:teuthology.orchestra.run.smithi050:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-05T17:29:38.001 INFO:teuthology.orchestra.run.smithi050.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T17:29:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T17:29:38.001 INFO:teuthology.orchestra.run.smithi050.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T17:29:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T17:29:38.002 INFO:teuthology.orchestra.run.smithi050.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T17:29:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: = sunit=0 swidth=0 blks 2024-09-05T17:29:38.002 INFO:teuthology.orchestra.run.smithi050.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T17:29:38.002 INFO:teuthology.orchestra.run.smithi050.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T17:29:38.002 INFO:teuthology.orchestra.run.smithi050.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T17:29:38.002 INFO:teuthology.orchestra.run.smithi050.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T17:29:38.025 INFO:teuthology.orchestra.run.smithi050.stdout:Discarding blocks...Done. 2024-09-05T17:29:38.027 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi050.front.sepia.ceph.com -o noatime 2024-09-05T17:29:38.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-05T17:29:38.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-05T17:29:38.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:29:38.139 INFO:teuthology.orchestra.run.smithi050.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T17:29:38.140 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:38.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:38.242+0000 7f4c237c37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-05T17:29:38.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:38.242+0000 7f4c237c37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-05T17:29:38.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:38.242+0000 7f4c237c37c0 -1 bdev(0x563cb72cd800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-05T17:29:38.242 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:38.242+0000 7f4c237c37c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-05T17:29:41.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-05T17:29:41.391 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:41.478+0000 7f1659b1d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-05T17:29:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:41.478+0000 7f1659b1d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-05T17:29:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:41.478+0000 7f1659b1d7c0 -1 bdev(0x55ca789c7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-05T17:29:41.477 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:41.478+0000 7f1659b1d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-05T17:29:44.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-05T17:29:44.682 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:44.762 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:44.766+0000 7f4debbde7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-05T17:29:44.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:44.766+0000 7f4debbde7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-05T17:29:44.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:44.766+0000 7f4debbde7c0 -1 bdev(0x55b7584df800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-05T17:29:44.763 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:44.766+0000 7f4debbde7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-05T17:29:47.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-05T17:29:47.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:48.046+0000 7f53e3f137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-05T17:29:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:48.046+0000 7f53e3f137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-05T17:29:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:48.046+0000 7f53e3f137c0 -1 bdev(0x55789cb17800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-05T17:29:48.042 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:29:48.046+0000 7f53e3f137c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-05T17:29:51.185 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-05T17:29:51.253 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-05T17:29:51.268 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:51.269 INFO:tasks.ceph:role: osd.4 2024-09-05T17:29:51.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:29:51.269 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-05T17:29:51.324 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T17:29:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T17:29:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T17:29:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T17:29:51.325 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T17:29:51.325 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-05T17:29:51.325 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T17:29:51.326 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T17:29:51.326 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T17:29:51.326 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T17:29:51.349 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-05T17:29:51.353 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-05T17:29:51.353 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-05T17:29:51.412 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-05T17:29:51.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:29:51.464 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T17:29:51.465 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-05T17:29:51.516 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:51.516 INFO:tasks.ceph:role: osd.5 2024-09-05T17:29:51.516 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:29:51.516 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T17:29:51.572 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T17:29:51.595 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-05T17:29:51.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-05T17:29:51.597 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-05T17:29:51.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-05T17:29:51.708 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T17:29:51.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:29:51.709 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-05T17:29:51.761 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:51.761 INFO:tasks.ceph:role: osd.6 2024-09-05T17:29:51.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:29:51.761 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T17:29:51.816 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T17:29:51.839 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-05T17:29:51.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-05T17:29:51.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-05T17:29:51.898 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-05T17:29:51.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:29:51.948 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T17:29:51.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-05T17:29:52.001 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-05T17:29:52.001 INFO:tasks.ceph:role: osd.7 2024-09-05T17:29:52.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:29:52.001 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-05T17:29:52.056 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-05T17:29:52.081 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-05T17:29:52.083 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-05T17:29:52.083 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-05T17:29:52.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-05T17:29:52.192 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-09-05T17:29:52.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:29:52.193 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:52.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:52.312+0000 7f73c69327c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-05T17:29:52.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:52.312+0000 7f73c69327c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-05T17:29:52.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:52.312+0000 7f73c69327c0 -1 bdev(0x55f63f7a7800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-05T17:29:52.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:52.312+0000 7f73c69327c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-05T17:29:55.468 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-05T17:29:55.483 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:55.564+0000 7f87e64157c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-05T17:29:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:55.564+0000 7f87e64157c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-05T17:29:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:55.564+0000 7f87e64157c0 -1 bdev(0x5617e3079800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-05T17:29:55.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:55.564+0000 7f87e64157c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-05T17:29:58.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-05T17:29:58.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:29:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:58.864+0000 7f2ac13a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-05T17:29:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:58.864+0000 7f2ac13a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-05T17:29:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:58.864+0000 7f2ac13a97c0 -1 bdev(0x55ab2fc11800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-05T17:29:58.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:29:58.864+0000 7f2ac13a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-05T17:30:02.010 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-05T17:30:02.064 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:30:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:30:02.144+0000 7f9472dc37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-05T17:30:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:30:02.144+0000 7f9472dc37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-05T17:30:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:30:02.144+0000 7f9472dc37c0 -1 bdev(0x561848d33800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-05T17:30:02.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-05T17:30:02.144+0000 7f9472dc37c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-05T17:30:05.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-05T17:30:05.344 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-05T17:30:05.344 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:05.344 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-05T17:30:05.359 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:05.359 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-05T17:30:05.417 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:05.417 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-05T17:30:05.473 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:05.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-05T17:30:05.528 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:05.529 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-05T17:30:05.584 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:05.584 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-05T17:30:05.598 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:05.599 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-05T17:30:05.656 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:05.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-05T17:30:05.710 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:05.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-05T17:30:05.763 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:05.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-05T17:30:05.818 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:05.818 DEBUG:teuthology.orchestra.run.smithi050:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-05T17:30:05.824 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:05.824 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-05T17:30:05.864 INFO:tasks.ceph:Adding keys to all mons... 2024-09-05T17:30:05.864 DEBUG:teuthology.orchestra.run.smithi050:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-05T17:30:05.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-05T17:30:05.909 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.y] 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCB6tlmLEHwAhAAKpjeoWRNLImC8mKNNWNuYA== 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.0] 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCC6tlmpUHEDhAAVvUwgHGjXELGwgkvS27SUQ== 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.1] 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCF6tlmrffHHBAA6ZeXulrierECyqr5ljv/xg== 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.2] 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCI6tlmihrMLRAAI948lp33AcNjSZivhWsUDg== 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.3] 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCM6tlmS6LbAhAAFZ0J3Xw3YfL2Kkykis+T4A== 2024-09-05T17:30:05.910 INFO:teuthology.orchestra.run.smithi050.stdout:[mgr.x] 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCB6tlmUl+SBRAAix5IbSOjCYWuhYNF6LpRPQ== 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.4] 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCQ6tlm4CrOEhAA3oRyB61qvQvD+fulXqOYEg== 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.5] 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCT6tlmsEzsIRAAcrvgrLMMb6eDS1umQgVQcA== 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.6] 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCW6tlmwGPVMxAAFQ/QJXU9GVjbGbXh0KIVWA== 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout:[osd.7] 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCa6tlmaw7kCBAAs2AxDY8B8DNqmLLGEXPO4g== 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout:[client.0] 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCB6tlmDqGkCBAAM2Du95aTmQby1ojbJiu6Yg== 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout:[client.1] 2024-09-05T17:30:05.911 INFO:teuthology.orchestra.run.smithi050.stdout: key = AQCB6tlm8swzCxAA4hQEU1AyTI55+9dusAmzzw== 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCB6tlmLEHwAhAAKpjeoWRNLImC8mKNNWNuYA== 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCC6tlmpUHEDhAAVvUwgHGjXELGwgkvS27SUQ== 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCF6tlmrffHHBAA6ZeXulrierECyqr5ljv/xg== 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCI6tlmihrMLRAAI948lp33AcNjSZivhWsUDg== 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCM6tlmS6LbAhAAFZ0J3Xw3YfL2Kkykis+T4A== 2024-09-05T17:30:05.918 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCB6tlmUl+SBRAAix5IbSOjCYWuhYNF6LpRPQ== 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCQ6tlm4CrOEhAA3oRyB61qvQvD+fulXqOYEg== 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCT6tlmsEzsIRAAcrvgrLMMb6eDS1umQgVQcA== 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCW6tlmwGPVMxAAFQ/QJXU9GVjbGbXh0KIVWA== 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-09-05T17:30:05.919 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCa6tlmaw7kCBAAs2AxDY8B8DNqmLLGEXPO4g== 2024-09-05T17:30:05.920 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-09-05T17:30:05.920 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCB6tlmDqGkCBAAM2Du95aTmQby1ojbJiu6Yg== 2024-09-05T17:30:05.920 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2024-09-05T17:30:05.920 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCB6tlm8swzCxAA4hQEU1AyTI55+9dusAmzzw== 2024-09-05T17:30:05.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T17:30:05.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T17:30:06.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.078 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.162 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.209 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.294 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T17:30:06.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-05T17:30:06.453 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.456 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.535 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.542 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.622 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.633 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.724 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-05T17:30:06.796 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T17:30:06.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T17:30:06.854 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T17:30:06.856 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-05T17:30:06.940 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-05T17:30:06.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-05T17:30:06.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T17:30:07.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-05T17:30:07.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-05T17:30:07.115 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T17:30:07.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-05T17:30:07.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-05T17:30:07.231 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-05T17:30:07.325 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-05T17:30:07.337 DEBUG:teuthology.orchestra.run.smithi050:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:30:07.339 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-05T17:30:07.383 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-05T17:30:07.383 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-05T17:30:07.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-05T17:30:07.386 INFO:tasks.ceph.mon.a:Started 2024-09-05T17:30:07.386 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-05T17:30:07.386 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-05T17:30:07.389 INFO:tasks.ceph.mon.c:Started 2024-09-05T17:30:07.389 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-05T17:30:07.389 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-05T17:30:07.428 INFO:tasks.ceph.mon.b:Started 2024-09-05T17:30:07.428 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-05T17:30:07.429 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-05T17:30:07.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-05T17:30:07.431 INFO:tasks.ceph.mgr.y:Started 2024-09-05T17:30:07.431 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-05T17:30:07.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-05T17:30:07.433 INFO:tasks.ceph.mgr.x:Started 2024-09-05T17:30:07.433 DEBUG:tasks.ceph:set 0 configs 2024-09-05T17:30:07.434 INFO:tasks.ceph:Setting crush tunables to default 2024-09-05T17:30:07.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd crush tunables default 2024-09-05T17:30:12.900 INFO:teuthology.orchestra.run.smithi050.stderr:adjusted tunables profile to default 2024-09-05T17:30:12.921 INFO:tasks.ceph:check_enable_crimson: False 2024-09-05T17:30:12.921 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-05T17:30:12.921 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:12.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-05T17:30:12.932 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:12.932 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-05T17:30:12.990 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:12.990 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-05T17:30:13.043 DEBUG:teuthology.orchestra.run.smithi050:> set -ex 2024-09-05T17:30:13.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-05T17:30:13.098 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:13.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-05T17:30:13.112 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:13.112 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-05T17:30:13.166 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:13.166 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-05T17:30:13.217 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-05T17:30:13.218 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-05T17:30:13.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 38dd1565-a37f-4055-acb3-aa82457cf9e7 0 2024-09-05T17:30:13.521 INFO:teuthology.orchestra.run.smithi110.stdout:0 2024-09-05T17:30:13.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new f5ef5f03-d714-4329-b14b-1881ad1e7358 1 2024-09-05T17:30:13.734 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-09-05T17:30:13.750 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 7b87b0cc-2484-4a66-be1b-232a7e36dc11 2 2024-09-05T17:30:13.946 INFO:teuthology.orchestra.run.smithi110.stdout:2 2024-09-05T17:30:13.962 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new f6d63b1e-2673-4542-a2e2-fbb0c4577864 3 2024-09-05T17:30:14.155 INFO:teuthology.orchestra.run.smithi110.stdout:3 2024-09-05T17:30:14.172 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 273ec4c6-0c2a-41d5-90c1-68b317365484 4 2024-09-05T17:30:14.362 INFO:teuthology.orchestra.run.smithi110.stdout:4 2024-09-05T17:30:14.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 5f6cf36b-2dd0-47de-97c4-42e98f849734 5 2024-09-05T17:30:14.569 INFO:teuthology.orchestra.run.smithi110.stdout:5 2024-09-05T17:30:14.585 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 2d6ed4a6-3d83-4c9d-9e96-2dbab049448a 6 2024-09-05T17:30:14.785 INFO:teuthology.orchestra.run.smithi110.stdout:6 2024-09-05T17:30:14.802 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new dbe1901b-5f78-419f-864a-89946452f4a6 7 2024-09-05T17:30:15.005 INFO:teuthology.orchestra.run.smithi110.stdout:7 2024-09-05T17:30:15.021 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-05T17:30:15.021 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-05T17:30:15.023 INFO:tasks.ceph.osd.0:Started 2024-09-05T17:30:15.023 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-05T17:30:15.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-05T17:30:15.025 INFO:tasks.ceph.osd.1:Started 2024-09-05T17:30:15.025 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-05T17:30:15.026 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-05T17:30:15.028 INFO:tasks.ceph.osd.2:Started 2024-09-05T17:30:15.028 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-05T17:30:15.028 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-05T17:30:15.030 INFO:tasks.ceph.osd.3:Started 2024-09-05T17:30:15.030 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-05T17:30:15.030 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-05T17:30:15.032 INFO:tasks.ceph.osd.4:Started 2024-09-05T17:30:15.032 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-05T17:30:15.032 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-05T17:30:15.034 INFO:tasks.ceph.osd.5:Started 2024-09-05T17:30:15.034 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-05T17:30:15.035 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-05T17:30:15.036 INFO:tasks.ceph.osd.6:Started 2024-09-05T17:30:15.036 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-05T17:30:15.037 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-05T17:30:15.038 INFO:tasks.ceph.osd.7:Started 2024-09-05T17:30:15.039 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T17:30:15.253 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:15.253 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":10,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:30:15.006059+0000","last_up_change":"0.000000","last_in_change":"2024-09-05T17:30:15.006059+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:30:15.269 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-05T17:30:15.270 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-05T17:30:15.779 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-05T17:30:15.779 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-05T17:30:15.779 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2024-09-05T17:30:15.832 INFO:tasks.ceph.mgr.y.smithi050.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-05T17:30:15.832 INFO:tasks.ceph.mgr.y.smithi050.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-05T17:30:15.832 INFO:tasks.ceph.mgr.y.smithi050.stderr: from numpy import show_config as show_numpy_config 2024-09-05T17:30:16.076 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T17:30:16.188 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:16.188+0000 7f4aac6887c0 -1 Falling back to public interface 2024-09-05T17:30:16.267 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-05T17:30:16.267 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":10,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:30:15.006059+0000","last_up_change":"0.000000","last_in_change":"2024-09-05T17:30:15.006059+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:30:16.283 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-05T17:30:16.408 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:16.408+0000 7fc126e5c7c0 -1 Falling back to public interface 2024-09-05T17:30:16.418 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:16.422+0000 7f2ccfa397c0 -1 Falling back to public interface 2024-09-05T17:30:16.440 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:16.440+0000 7fd30e9ab7c0 -1 Falling back to public interface 2024-09-05T17:30:16.441 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:16.446+0000 7f791878c7c0 -1 Falling back to public interface 2024-09-05T17:30:16.505 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:16.510+0000 7efd5afb27c0 -1 Falling back to public interface 2024-09-05T17:30:16.662 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:16.666+0000 7fef100e67c0 -1 Falling back to public interface 2024-09-05T17:30:16.688 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:16.688+0000 7f4f43bbd7c0 -1 Falling back to public interface 2024-09-05T17:30:18.780 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-05T17:30:18.779+0000 7f52749c0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-05T17:30:18.781 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-05T17:30:18.779+0000 7f52749c0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-05T17:30:20.263 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:20.259+0000 7f4aac6887c0 -1 osd.7 0 log_to_monitors true 2024-09-05T17:30:20.417 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:20.415+0000 7fc126e5c7c0 -1 osd.4 0 log_to_monitors true 2024-09-05T17:30:20.608 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:20.610+0000 7f791878c7c0 -1 osd.1 0 log_to_monitors true 2024-09-05T17:30:20.643 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:20.646+0000 7efd5afb27c0 -1 osd.3 0 log_to_monitors true 2024-09-05T17:30:20.693 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:20.691+0000 7f4f43bbd7c0 -1 osd.6 0 log_to_monitors true 2024-09-05T17:30:20.731 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:20.734+0000 7f2ccfa397c0 -1 osd.2 0 log_to_monitors true 2024-09-05T17:30:20.771 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:20.771+0000 7fd30e9ab7c0 -1 osd.5 0 log_to_monitors true 2024-09-05T17:30:21.214 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:21.218+0000 7fef100e67c0 -1 osd.0 0 log_to_monitors true 2024-09-05T17:30:22.943 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:22.946+0000 7efd56f5b640 -1 osd.3 0 waiting for initial osdmap 2024-09-05T17:30:22.961 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:22.966+0000 7f2ccb9e2640 -1 osd.2 0 waiting for initial osdmap 2024-09-05T17:30:22.965 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:22.970+0000 7efd4ed8d640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:30:22.973 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:22.978+0000 7f7914735640 -1 osd.1 0 waiting for initial osdmap 2024-09-05T17:30:22.993 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:22.998+0000 7f2cc3814640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:30:23.009 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:23.014+0000 7f790c567640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:30:23.078 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:23.075+0000 7f4f3fb66640 -1 osd.6 0 waiting for initial osdmap 2024-09-05T17:30:23.089 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:23.087+0000 7fc122e05640 -1 osd.4 0 waiting for initial osdmap 2024-09-05T17:30:23.090 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T17:30:23.099 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:23.095+0000 7f4aa8631640 -1 osd.7 0 waiting for initial osdmap 2024-09-05T17:30:23.103 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:23.103+0000 7f4f37998640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:30:23.119 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:23.119+0000 7fc11ac37640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:30:23.127 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:23.127+0000 7f4aa0463640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:30:23.161 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:23.159+0000 7fd30a954640 -1 osd.5 0 waiting for initial osdmap 2024-09-05T17:30:23.184 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:23.183+0000 7fd302786640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:30:23.457 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-05T17:30:23.457 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":13,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:30:22.826567+0000","last_up_change":"0.000000","last_in_change":"2024-09-05T17:30:15.006059+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:30:23.481 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-05T17:30:23.630 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:23.634+0000 7fef0c08f640 -1 osd.0 0 waiting for initial osdmap 2024-09-05T17:30:23.657 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:23.662+0000 7fef03ec1640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:30:30.288 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-05T17:30:30.600 INFO:teuthology.misc.health.smithi050.stdout: 2024-09-05T17:30:30.601 INFO:teuthology.misc.health.smithi050.stdout:{"epoch":18,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:30:28.008383+0000","last_up_change":"2024-09-05T17:30:23.981355+0000","last_in_change":"2024-09-05T17:30:15.006059+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T17:30:25.818485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6825","nonce":1446480840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6827","nonce":1446480840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6831","nonce":1446480840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6829","nonce":1446480840}]},"public_addr":"172.21.15.50:6825/1446480840","cluster_addr":"172.21.15.50:6827/1446480840","heartbeat_back_addr":"172.21.15.50:6831/1446480840","heartbeat_front_addr":"172.21.15.50:6829/1446480840","state":["exists","up"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6809","nonce":3885625462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6811","nonce":3885625462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6815","nonce":3885625462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6813","nonce":3885625462}]},"public_addr":"172.21.15.50:6809/3885625462","cluster_addr":"172.21.15.50:6811/3885625462","heartbeat_back_addr":"172.21.15.50:6815/3885625462","heartbeat_front_addr":"172.21.15.50:6813/3885625462","state":["exists","up"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6801","nonce":3027840955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6803","nonce":3027840955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6807","nonce":3027840955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6805","nonce":3027840955}]},"public_addr":"172.21.15.50:6801/3027840955","cluster_addr":"172.21.15.50:6803/3027840955","heartbeat_back_addr":"172.21.15.50:6807/3027840955","heartbeat_front_addr":"172.21.15.50:6805/3027840955","state":["exists","up"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6817","nonce":2889879466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6819","nonce":2889879466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6823","nonce":2889879466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6821","nonce":2889879466}]},"public_addr":"172.21.15.50:6817/2889879466","cluster_addr":"172.21.15.50:6819/2889879466","heartbeat_back_addr":"172.21.15.50:6823/2889879466","heartbeat_front_addr":"172.21.15.50:6821/2889879466","state":["exists","up"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6809","nonce":1774319792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6811","nonce":1774319792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6815","nonce":1774319792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6813","nonce":1774319792}]},"public_addr":"172.21.15.110:6809/1774319792","cluster_addr":"172.21.15.110:6811/1774319792","heartbeat_back_addr":"172.21.15.110:6815/1774319792","heartbeat_front_addr":"172.21.15.110:6813/1774319792","state":["exists","up"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6817","nonce":1348894681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6819","nonce":1348894681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6823","nonce":1348894681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6821","nonce":1348894681}]},"public_addr":"172.21.15.110:6817/1348894681","cluster_addr":"172.21.15.110:6819/1348894681","heartbeat_back_addr":"172.21.15.110:6823/1348894681","heartbeat_front_addr":"172.21.15.110:6821/1348894681","state":["exists","up"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6825","nonce":792585226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6827","nonce":792585226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6831","nonce":792585226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6829","nonce":792585226}]},"public_addr":"172.21.15.110:6825/792585226","cluster_addr":"172.21.15.110:6827/792585226","heartbeat_back_addr":"172.21.15.110:6831/792585226","heartbeat_front_addr":"172.21.15.110:6829/792585226","state":["exists","up"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6801","nonce":2161010500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6803","nonce":2161010500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6807","nonce":2161010500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6805","nonce":2161010500}]},"public_addr":"172.21.15.110:6801/2161010500","cluster_addr":"172.21.15.110:6803/2161010500","heartbeat_back_addr":"172.21.15.110:6807/2161010500","heartbeat_front_addr":"172.21.15.110:6805/2161010500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:22.246726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.638940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.694544+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.653253+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.467561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.797765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.649372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.242988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:30:30.619 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-05T17:30:30.619 INFO:tasks.ceph:Creating RBD pool 2024-09-05T17:30:30.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-05T17:30:31.025 INFO:teuthology.orchestra.run.smithi050.stderr:pool 'rbd' created 2024-09-05T17:30:31.051 DEBUG:teuthology.orchestra.run.smithi050:> rbd --cluster ceph pool init rbd 2024-09-05T17:30:34.085 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-05T17:30:34.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-05T17:30:34.086 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-05T17:30:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:34.430 INFO:teuthology.orchestra.run.smithi050.stdout:[{"version":9,"timestamp":"2024-09-05T17:30:23.637718+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"6740.430962"}]}] 2024-09-05T17:30:34.430 INFO:tasks.ceph_manager:config epoch is 9 2024-09-05T17:30:34.431 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-05T17:30:34.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-05T17:30:34.431 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-05T17:30:34.771 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:34.787 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1978048470},{"type":"v1","addr":"172.21.15.110:6833","nonce":1978048470}]},"active_addr":"172.21.15.110:6833/1978048470","active_change":"2024-09-05T17:30:17.761130+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1997373307}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1829326377}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3229212287}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3078719998}]}]} 2024-09-05T17:30:34.792 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-05T17:30:34.792 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-05T17:30:34.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T17:30:35.103 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:35.103 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":22,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:30:34.052001+0000","last_up_change":"2024-09-05T17:30:23.981355+0000","last_in_change":"2024-09-05T17:30:15.006059+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T17:30:25.818485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-05T17:30:30.943478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6825","nonce":1446480840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6827","nonce":1446480840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6831","nonce":1446480840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6829","nonce":1446480840}]},"public_addr":"172.21.15.50:6825/1446480840","cluster_addr":"172.21.15.50:6827/1446480840","heartbeat_back_addr":"172.21.15.50:6831/1446480840","heartbeat_front_addr":"172.21.15.50:6829/1446480840","state":["exists","up"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6809","nonce":3885625462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6811","nonce":3885625462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6815","nonce":3885625462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6813","nonce":3885625462}]},"public_addr":"172.21.15.50:6809/3885625462","cluster_addr":"172.21.15.50:6811/3885625462","heartbeat_back_addr":"172.21.15.50:6815/3885625462","heartbeat_front_addr":"172.21.15.50:6813/3885625462","state":["exists","up"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6801","nonce":3027840955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6803","nonce":3027840955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6807","nonce":3027840955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6805","nonce":3027840955}]},"public_addr":"172.21.15.50:6801/3027840955","cluster_addr":"172.21.15.50:6803/3027840955","heartbeat_back_addr":"172.21.15.50:6807/3027840955","heartbeat_front_addr":"172.21.15.50:6805/3027840955","state":["exists","up"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6817","nonce":2889879466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6819","nonce":2889879466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6823","nonce":2889879466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6821","nonce":2889879466}]},"public_addr":"172.21.15.50:6817/2889879466","cluster_addr":"172.21.15.50:6819/2889879466","heartbeat_back_addr":"172.21.15.50:6823/2889879466","heartbeat_front_addr":"172.21.15.50:6821/2889879466","state":["exists","up"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6809","nonce":1774319792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6811","nonce":1774319792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6815","nonce":1774319792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6813","nonce":1774319792}]},"public_addr":"172.21.15.110:6809/1774319792","cluster_addr":"172.21.15.110:6811/1774319792","heartbeat_back_addr":"172.21.15.110:6815/1774319792","heartbeat_front_addr":"172.21.15.110:6813/1774319792","state":["exists","up"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6817","nonce":1348894681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6819","nonce":1348894681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6823","nonce":1348894681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6821","nonce":1348894681}]},"public_addr":"172.21.15.110:6817/1348894681","cluster_addr":"172.21.15.110:6819/1348894681","heartbeat_back_addr":"172.21.15.110:6823/1348894681","heartbeat_front_addr":"172.21.15.110:6821/1348894681","state":["exists","up"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6825","nonce":792585226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6827","nonce":792585226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6831","nonce":792585226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6829","nonce":792585226}]},"public_addr":"172.21.15.110:6825/792585226","cluster_addr":"172.21.15.110:6827/792585226","heartbeat_back_addr":"172.21.15.110:6831/792585226","heartbeat_front_addr":"172.21.15.110:6829/792585226","state":["exists","up"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6801","nonce":2161010500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6803","nonce":2161010500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6807","nonce":2161010500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6805","nonce":2161010500}]},"public_addr":"172.21.15.110:6801/2161010500","cluster_addr":"172.21.15.110:6803/2161010500","heartbeat_back_addr":"172.21.15.110:6807/2161010500","heartbeat_front_addr":"172.21.15.110:6805/2161010500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:22.246726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.638940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.694544+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.653253+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.467561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.797765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.649372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.242988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:30:35.123 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-05T17:30:35.123 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T17:30:35.439 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:35.439 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":22,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:30:34.052001+0000","last_up_change":"2024-09-05T17:30:23.981355+0000","last_in_change":"2024-09-05T17:30:15.006059+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T17:30:25.818485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-05T17:30:30.943478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6825","nonce":1446480840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6827","nonce":1446480840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6831","nonce":1446480840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6829","nonce":1446480840}]},"public_addr":"172.21.15.50:6825/1446480840","cluster_addr":"172.21.15.50:6827/1446480840","heartbeat_back_addr":"172.21.15.50:6831/1446480840","heartbeat_front_addr":"172.21.15.50:6829/1446480840","state":["exists","up"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6809","nonce":3885625462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6811","nonce":3885625462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6815","nonce":3885625462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6813","nonce":3885625462}]},"public_addr":"172.21.15.50:6809/3885625462","cluster_addr":"172.21.15.50:6811/3885625462","heartbeat_back_addr":"172.21.15.50:6815/3885625462","heartbeat_front_addr":"172.21.15.50:6813/3885625462","state":["exists","up"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6801","nonce":3027840955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6803","nonce":3027840955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6807","nonce":3027840955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6805","nonce":3027840955}]},"public_addr":"172.21.15.50:6801/3027840955","cluster_addr":"172.21.15.50:6803/3027840955","heartbeat_back_addr":"172.21.15.50:6807/3027840955","heartbeat_front_addr":"172.21.15.50:6805/3027840955","state":["exists","up"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6817","nonce":2889879466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6819","nonce":2889879466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6823","nonce":2889879466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6821","nonce":2889879466}]},"public_addr":"172.21.15.50:6817/2889879466","cluster_addr":"172.21.15.50:6819/2889879466","heartbeat_back_addr":"172.21.15.50:6823/2889879466","heartbeat_front_addr":"172.21.15.50:6821/2889879466","state":["exists","up"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6809","nonce":1774319792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6811","nonce":1774319792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6815","nonce":1774319792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6813","nonce":1774319792}]},"public_addr":"172.21.15.110:6809/1774319792","cluster_addr":"172.21.15.110:6811/1774319792","heartbeat_back_addr":"172.21.15.110:6815/1774319792","heartbeat_front_addr":"172.21.15.110:6813/1774319792","state":["exists","up"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6817","nonce":1348894681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6819","nonce":1348894681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6823","nonce":1348894681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1348894681},{"type":"v1","addr":"172.21.15.110:6821","nonce":1348894681}]},"public_addr":"172.21.15.110:6817/1348894681","cluster_addr":"172.21.15.110:6819/1348894681","heartbeat_back_addr":"172.21.15.110:6823/1348894681","heartbeat_front_addr":"172.21.15.110:6821/1348894681","state":["exists","up"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6825","nonce":792585226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6827","nonce":792585226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6831","nonce":792585226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6829","nonce":792585226}]},"public_addr":"172.21.15.110:6825/792585226","cluster_addr":"172.21.15.110:6827/792585226","heartbeat_back_addr":"172.21.15.110:6831/792585226","heartbeat_front_addr":"172.21.15.110:6829/792585226","state":["exists","up"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6801","nonce":2161010500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6803","nonce":2161010500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6807","nonce":2161010500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6805","nonce":2161010500}]},"public_addr":"172.21.15.110:6801/2161010500","cluster_addr":"172.21.15.110:6803/2161010500","heartbeat_back_addr":"172.21.15.110:6807/2161010500","heartbeat_front_addr":"172.21.15.110:6805/2161010500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:22.246726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.638940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.694544+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.653253+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.467561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.797765+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.649372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.242988+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:30:35.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-05T17:30:35.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-05T17:30:35.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-05T17:30:35.460 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-05T17:30:35.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-05T17:30:35.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-05T17:30:35.461 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-05T17:30:35.462 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-05T17:30:35.731 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-05T17:30:35.732 INFO:teuthology.orchestra.run.smithi050.stdout:60129542148 2024-09-05T17:30:35.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-05T17:30:35.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-05T17:30:35.734 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-09-05T17:30:35.734 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-05T17:30:35.741 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-05T17:30:35.741 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-05T17:30:35.743 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-09-05T17:30:35.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-05T17:30:35.749 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-09-05T17:30:35.750 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T17:30:35.752 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-05T17:30:35.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-05T17:30:35.950 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-09-05T17:30:35.950 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T17:30:36.235 INFO:teuthology.orchestra.run.smithi050.stdout:60129542148 2024-09-05T17:30:36.244 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-09-05T17:30:36.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2024-09-05T17:30:36.264 DEBUG:teuthology.parallel:result is None 2024-09-05T17:30:36.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-05T17:30:36.273 DEBUG:teuthology.parallel:result is None 2024-09-05T17:30:36.274 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-05T17:30:36.285 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-05T17:30:36.299 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-05T17:30:36.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-05T17:30:36.302 DEBUG:teuthology.parallel:result is None 2024-09-05T17:30:36.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-05T17:30:36.314 DEBUG:teuthology.parallel:result is None 2024-09-05T17:30:36.318 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-09-05T17:30:36.323 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-09-05T17:30:36.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-05T17:30:36.325 DEBUG:teuthology.parallel:result is None 2024-09-05T17:30:36.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-05T17:30:36.338 DEBUG:teuthology.parallel:result is None 2024-09-05T17:30:36.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-05T17:30:36.343 DEBUG:teuthology.parallel:result is None 2024-09-05T17:30:36.405 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-05T17:30:36.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-05T17:30:37.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T17:30:37.743 INFO:teuthology.orchestra.run.smithi050.stdout:60129542149 2024-09-05T17:30:37.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.2 2024-09-05T17:30:38.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T17:30:39.088 INFO:teuthology.orchestra.run.smithi050.stdout:60129542150 2024-09-05T17:30:39.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-05T17:30:39.108 DEBUG:teuthology.parallel:result is None 2024-09-05T17:30:39.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-05T17:30:39.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:30:39.504 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:39.504 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:30:39.527 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-05T17:30:37.772563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251448,"kb_used_data":1880,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754723272,"statfs":{"total":773094113280,"available":772836630528,"internally_reserved":0,"allocated":1925120,"data_stored":1795734,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.740585"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.060553+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:30:34.060553+0000","last_peered":"2024-09-05T17:30:34.060553+0000","last_clean":"2024-09-05T17:30:34.060553+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:30:34.060553+0000","last_undegraded":"2024-09-05T17:30:34.060553+0000","last_fullsized":"2024-09-05T17:30:34.060553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.074353+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:30:34.074353+0000","last_peered":"2024-09-05T17:30:34.074353+0000","last_clean":"2024-09-05T17:30:34.074353+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:30:34.074353+0000","last_undegraded":"2024-09-05T17:30:34.074353+0000","last_fullsized":"2024-09-05T17:30:34.074353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.286740+0000","last_change":"2024-09-05T17:30:34.286740+0000","last_active":"2024-09-05T17:30:34.286740+0000","last_peered":"2024-09-05T17:30:34.286740+0000","last_clean":"2024-09-05T17:30:34.286740+0000","last_became_active":"2024-09-05T17:30:32.046860+0000","last_became_peered":"2024-09-05T17:30:32.046860+0000","last_unstale":"2024-09-05T17:30:34.286740+0000","last_undegraded":"2024-09-05T17:30:34.286740+0000","last_fullsized":"2024-09-05T17:30:34.286740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:00:40.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.074244+0000","last_change":"2024-09-05T17:30:34.074244+0000","last_active":"2024-09-05T17:30:34.074244+0000","last_peered":"2024-09-05T17:30:34.074244+0000","last_clean":"2024-09-05T17:30:34.074244+0000","last_became_active":"2024-09-05T17:30:32.050582+0000","last_became_peered":"2024-09-05T17:30:32.050582+0000","last_unstale":"2024-09-05T17:30:34.074244+0000","last_undegraded":"2024-09-05T17:30:34.074244+0000","last_fullsized":"2024-09-05T17:30:34.074244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:33:10.698117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.069657+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:30:34.069657+0000","last_peered":"2024-09-05T17:30:34.069657+0000","last_clean":"2024-09-05T17:30:34.069657+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:30:34.069657+0000","last_undegraded":"2024-09-05T17:30:34.069657+0000","last_fullsized":"2024-09-05T17:30:34.069657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.143473+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:30:34.143473+0000","last_peered":"2024-09-05T17:30:34.143473+0000","last_clean":"2024-09-05T17:30:34.143473+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:30:34.143473+0000","last_undegraded":"2024-09-05T17:30:34.143473+0000","last_fullsized":"2024-09-05T17:30:34.143473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.286855+0000","last_change":"2024-09-05T17:30:34.286855+0000","last_active":"2024-09-05T17:30:34.286855+0000","last_peered":"2024-09-05T17:30:34.286855+0000","last_clean":"2024-09-05T17:30:34.286855+0000","last_became_active":"2024-09-05T17:30:32.050265+0000","last_became_peered":"2024-09-05T17:30:32.050265+0000","last_unstale":"2024-09-05T17:30:34.286855+0000","last_undegraded":"2024-09-05T17:30:34.286855+0000","last_fullsized":"2024-09-05T17:30:34.286855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:22:54.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.067541+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:30:34.067541+0000","last_peered":"2024-09-05T17:30:34.067541+0000","last_clean":"2024-09-05T17:30:34.067541+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:30:34.067541+0000","last_undegraded":"2024-09-05T17:30:34.067541+0000","last_fullsized":"2024-09-05T17:30:34.067541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.285723+0000","last_change":"2024-09-05T17:30:27.328259+0000","last_active":"2024-09-05T17:30:34.285723+0000","last_peered":"2024-09-05T17:30:34.285723+0000","last_clean":"2024-09-05T17:30:34.285723+0000","last_became_active":"2024-09-05T17:30:27.326202+0000","last_became_peered":"2024-09-05T17:30:27.326202+0000","last_unstale":"2024-09-05T17:30:34.285723+0000","last_undegraded":"2024-09-05T17:30:34.285723+0000","last_fullsized":"2024-09-05T17:30:34.285723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:40.749016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":282624,"data_stored":667238,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":282624,"data_stored":667238,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:30:39.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:30:39.829 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:39.829 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:30:39.846 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-05T17:30:39.773113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251448,"kb_used_data":1880,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754723272,"statfs":{"total":773094113280,"available":772836630528,"internally_reserved":0,"allocated":1925120,"data_stored":1795734,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.729697"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.060553+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:30:34.060553+0000","last_peered":"2024-09-05T17:30:34.060553+0000","last_clean":"2024-09-05T17:30:34.060553+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:30:34.060553+0000","last_undegraded":"2024-09-05T17:30:34.060553+0000","last_fullsized":"2024-09-05T17:30:34.060553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.074353+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:30:34.074353+0000","last_peered":"2024-09-05T17:30:34.074353+0000","last_clean":"2024-09-05T17:30:34.074353+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:30:34.074353+0000","last_undegraded":"2024-09-05T17:30:34.074353+0000","last_fullsized":"2024-09-05T17:30:34.074353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.286740+0000","last_change":"2024-09-05T17:30:34.286740+0000","last_active":"2024-09-05T17:30:34.286740+0000","last_peered":"2024-09-05T17:30:34.286740+0000","last_clean":"2024-09-05T17:30:34.286740+0000","last_became_active":"2024-09-05T17:30:32.046860+0000","last_became_peered":"2024-09-05T17:30:32.046860+0000","last_unstale":"2024-09-05T17:30:34.286740+0000","last_undegraded":"2024-09-05T17:30:34.286740+0000","last_fullsized":"2024-09-05T17:30:34.286740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:00:40.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.074244+0000","last_change":"2024-09-05T17:30:34.074244+0000","last_active":"2024-09-05T17:30:34.074244+0000","last_peered":"2024-09-05T17:30:34.074244+0000","last_clean":"2024-09-05T17:30:34.074244+0000","last_became_active":"2024-09-05T17:30:32.050582+0000","last_became_peered":"2024-09-05T17:30:32.050582+0000","last_unstale":"2024-09-05T17:30:34.074244+0000","last_undegraded":"2024-09-05T17:30:34.074244+0000","last_fullsized":"2024-09-05T17:30:34.074244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:33:10.698117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.069657+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:30:34.069657+0000","last_peered":"2024-09-05T17:30:34.069657+0000","last_clean":"2024-09-05T17:30:34.069657+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:30:34.069657+0000","last_undegraded":"2024-09-05T17:30:34.069657+0000","last_fullsized":"2024-09-05T17:30:34.069657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.143473+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:30:34.143473+0000","last_peered":"2024-09-05T17:30:34.143473+0000","last_clean":"2024-09-05T17:30:34.143473+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:30:34.143473+0000","last_undegraded":"2024-09-05T17:30:34.143473+0000","last_fullsized":"2024-09-05T17:30:34.143473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.286855+0000","last_change":"2024-09-05T17:30:34.286855+0000","last_active":"2024-09-05T17:30:34.286855+0000","last_peered":"2024-09-05T17:30:34.286855+0000","last_clean":"2024-09-05T17:30:34.286855+0000","last_became_active":"2024-09-05T17:30:32.050265+0000","last_became_peered":"2024-09-05T17:30:32.050265+0000","last_unstale":"2024-09-05T17:30:34.286855+0000","last_undegraded":"2024-09-05T17:30:34.286855+0000","last_fullsized":"2024-09-05T17:30:34.286855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:22:54.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.067541+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:30:34.067541+0000","last_peered":"2024-09-05T17:30:34.067541+0000","last_clean":"2024-09-05T17:30:34.067541+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:30:34.067541+0000","last_undegraded":"2024-09-05T17:30:34.067541+0000","last_fullsized":"2024-09-05T17:30:34.067541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.285723+0000","last_change":"2024-09-05T17:30:27.328259+0000","last_active":"2024-09-05T17:30:34.285723+0000","last_peered":"2024-09-05T17:30:34.285723+0000","last_clean":"2024-09-05T17:30:34.285723+0000","last_became_active":"2024-09-05T17:30:27.326202+0000","last_became_peered":"2024-09-05T17:30:27.326202+0000","last_unstale":"2024-09-05T17:30:34.285723+0000","last_undegraded":"2024-09-05T17:30:34.285723+0000","last_fullsized":"2024-09-05T17:30:34.285723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:40.749016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":282624,"data_stored":667238,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":282624,"data_stored":667238,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:30:39.847 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-05T17:30:39.848 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-05T17:30:39.848 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-05T17:30:39.848 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-05T17:30:40.196 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:40.197 INFO:teuthology.orchestra.run.smithi050.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-05T17:30:40.216 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-05T17:30:40.217 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-05T17:30:40.241 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-05T17:30:40.242 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache max dirty': 0}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b0d82736d7e74c3301ced0a9a1f1715342226ca2'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0d82736d7e74c3301ced0a9a1f1715342226ca2'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'bba65b233b90d20d9ab694d2201126759501459c'}} 2024-09-05T17:30:40.242 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-05T17:30:40.243 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-05T17:30:40.573 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-05T17:30:40.573 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-05T17:30:40.573 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:30:40.873 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:40.874 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:30:40.893 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-05T17:30:39.773113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251448,"kb_used_data":1880,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754723272,"statfs":{"total":773094113280,"available":772836630528,"internally_reserved":0,"allocated":1925120,"data_stored":1795734,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.729697"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.060553+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:30:34.060553+0000","last_peered":"2024-09-05T17:30:34.060553+0000","last_clean":"2024-09-05T17:30:34.060553+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:30:34.060553+0000","last_undegraded":"2024-09-05T17:30:34.060553+0000","last_fullsized":"2024-09-05T17:30:34.060553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.074353+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:30:34.074353+0000","last_peered":"2024-09-05T17:30:34.074353+0000","last_clean":"2024-09-05T17:30:34.074353+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:30:34.074353+0000","last_undegraded":"2024-09-05T17:30:34.074353+0000","last_fullsized":"2024-09-05T17:30:34.074353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.286740+0000","last_change":"2024-09-05T17:30:34.286740+0000","last_active":"2024-09-05T17:30:34.286740+0000","last_peered":"2024-09-05T17:30:34.286740+0000","last_clean":"2024-09-05T17:30:34.286740+0000","last_became_active":"2024-09-05T17:30:32.046860+0000","last_became_peered":"2024-09-05T17:30:32.046860+0000","last_unstale":"2024-09-05T17:30:34.286740+0000","last_undegraded":"2024-09-05T17:30:34.286740+0000","last_fullsized":"2024-09-05T17:30:34.286740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:00:40.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.074244+0000","last_change":"2024-09-05T17:30:34.074244+0000","last_active":"2024-09-05T17:30:34.074244+0000","last_peered":"2024-09-05T17:30:34.074244+0000","last_clean":"2024-09-05T17:30:34.074244+0000","last_became_active":"2024-09-05T17:30:32.050582+0000","last_became_peered":"2024-09-05T17:30:32.050582+0000","last_unstale":"2024-09-05T17:30:34.074244+0000","last_undegraded":"2024-09-05T17:30:34.074244+0000","last_fullsized":"2024-09-05T17:30:34.074244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:33:10.698117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.069657+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:30:34.069657+0000","last_peered":"2024-09-05T17:30:34.069657+0000","last_clean":"2024-09-05T17:30:34.069657+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:30:34.069657+0000","last_undegraded":"2024-09-05T17:30:34.069657+0000","last_fullsized":"2024-09-05T17:30:34.069657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.143473+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:30:34.143473+0000","last_peered":"2024-09-05T17:30:34.143473+0000","last_clean":"2024-09-05T17:30:34.143473+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:30:34.143473+0000","last_undegraded":"2024-09-05T17:30:34.143473+0000","last_fullsized":"2024-09-05T17:30:34.143473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.286855+0000","last_change":"2024-09-05T17:30:34.286855+0000","last_active":"2024-09-05T17:30:34.286855+0000","last_peered":"2024-09-05T17:30:34.286855+0000","last_clean":"2024-09-05T17:30:34.286855+0000","last_became_active":"2024-09-05T17:30:32.050265+0000","last_became_peered":"2024-09-05T17:30:32.050265+0000","last_unstale":"2024-09-05T17:30:34.286855+0000","last_undegraded":"2024-09-05T17:30:34.286855+0000","last_fullsized":"2024-09-05T17:30:34.286855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:22:54.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.067541+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:30:34.067541+0000","last_peered":"2024-09-05T17:30:34.067541+0000","last_clean":"2024-09-05T17:30:34.067541+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:30:34.067541+0000","last_undegraded":"2024-09-05T17:30:34.067541+0000","last_fullsized":"2024-09-05T17:30:34.067541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.285723+0000","last_change":"2024-09-05T17:30:27.328259+0000","last_active":"2024-09-05T17:30:34.285723+0000","last_peered":"2024-09-05T17:30:34.285723+0000","last_clean":"2024-09-05T17:30:34.285723+0000","last_became_active":"2024-09-05T17:30:27.326202+0000","last_became_peered":"2024-09-05T17:30:27.326202+0000","last_unstale":"2024-09-05T17:30:34.285723+0000","last_undegraded":"2024-09-05T17:30:34.285723+0000","last_fullsized":"2024-09-05T17:30:34.285723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:40.749016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":282624,"data_stored":667238,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":282624,"data_stored":667238,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:30:40.894 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:30:41.199 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:41.200 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:30:41.217 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-05T17:30:39.773113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":251448,"kb_used_data":1880,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754723272,"statfs":{"total":773094113280,"available":772836630528,"internally_reserved":0,"allocated":1925120,"data_stored":1795734,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.729697"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.060553+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:30:34.060553+0000","last_peered":"2024-09-05T17:30:34.060553+0000","last_clean":"2024-09-05T17:30:34.060553+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:30:34.060553+0000","last_undegraded":"2024-09-05T17:30:34.060553+0000","last_fullsized":"2024-09-05T17:30:34.060553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.074353+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:30:34.074353+0000","last_peered":"2024-09-05T17:30:34.074353+0000","last_clean":"2024-09-05T17:30:34.074353+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:30:34.074353+0000","last_undegraded":"2024-09-05T17:30:34.074353+0000","last_fullsized":"2024-09-05T17:30:34.074353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.286740+0000","last_change":"2024-09-05T17:30:34.286740+0000","last_active":"2024-09-05T17:30:34.286740+0000","last_peered":"2024-09-05T17:30:34.286740+0000","last_clean":"2024-09-05T17:30:34.286740+0000","last_became_active":"2024-09-05T17:30:32.046860+0000","last_became_peered":"2024-09-05T17:30:32.046860+0000","last_unstale":"2024-09-05T17:30:34.286740+0000","last_undegraded":"2024-09-05T17:30:34.286740+0000","last_fullsized":"2024-09-05T17:30:34.286740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:00:40.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.074244+0000","last_change":"2024-09-05T17:30:34.074244+0000","last_active":"2024-09-05T17:30:34.074244+0000","last_peered":"2024-09-05T17:30:34.074244+0000","last_clean":"2024-09-05T17:30:34.074244+0000","last_became_active":"2024-09-05T17:30:32.050582+0000","last_became_peered":"2024-09-05T17:30:32.050582+0000","last_unstale":"2024-09-05T17:30:34.074244+0000","last_undegraded":"2024-09-05T17:30:34.074244+0000","last_fullsized":"2024-09-05T17:30:34.074244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:33:10.698117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.069657+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:30:34.069657+0000","last_peered":"2024-09-05T17:30:34.069657+0000","last_clean":"2024-09-05T17:30:34.069657+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:30:34.069657+0000","last_undegraded":"2024-09-05T17:30:34.069657+0000","last_fullsized":"2024-09-05T17:30:34.069657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.143473+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:30:34.143473+0000","last_peered":"2024-09-05T17:30:34.143473+0000","last_clean":"2024-09-05T17:30:34.143473+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:30:34.143473+0000","last_undegraded":"2024-09-05T17:30:34.143473+0000","last_fullsized":"2024-09-05T17:30:34.143473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.286855+0000","last_change":"2024-09-05T17:30:34.286855+0000","last_active":"2024-09-05T17:30:34.286855+0000","last_peered":"2024-09-05T17:30:34.286855+0000","last_clean":"2024-09-05T17:30:34.286855+0000","last_became_active":"2024-09-05T17:30:32.050265+0000","last_became_peered":"2024-09-05T17:30:32.050265+0000","last_unstale":"2024-09-05T17:30:34.286855+0000","last_undegraded":"2024-09-05T17:30:34.286855+0000","last_fullsized":"2024-09-05T17:30:34.286855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:22:54.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.067541+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:30:34.067541+0000","last_peered":"2024-09-05T17:30:34.067541+0000","last_clean":"2024-09-05T17:30:34.067541+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:30:34.067541+0000","last_undegraded":"2024-09-05T17:30:34.067541+0000","last_fullsized":"2024-09-05T17:30:34.067541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-05T17:30:34.285723+0000","last_change":"2024-09-05T17:30:27.328259+0000","last_active":"2024-09-05T17:30:34.285723+0000","last_peered":"2024-09-05T17:30:34.285723+0000","last_clean":"2024-09-05T17:30:34.285723+0000","last_became_active":"2024-09-05T17:30:27.326202+0000","last_became_peered":"2024-09-05T17:30:27.326202+0000","last_unstale":"2024-09-05T17:30:34.285723+0000","last_undegraded":"2024-09-05T17:30:34.285723+0000","last_fullsized":"2024-09-05T17:30:34.285723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:40.749016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":282624,"data_stored":667238,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":229376,"data_stored":76889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":282624,"data_stored":667238,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:30:41.217 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-05T17:30:41.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-05T17:30:41.506 INFO:teuthology.orchestra.run.smithi050.stdout:epoch 23 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:fsid 229efc05-fdc4-4e1f-8246-413b49f3eeda 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:created 2024-09-05T17:30:12.762369+0000 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2024-09-05T17:30:37.477303+0000 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:crush_version 5 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:full_ratio 0.95 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:backfillfull_ratio 0.9 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:nearfull_ratio 0.85 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:require_min_compat_client luminous 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:min_compat_client jewel 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:require_osd_release squid 2024-09-05T17:30:41.507 INFO:teuthology.orchestra.run.smithi050.stdout:stretch_mode_enabled false 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:max_osd 8 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6824/1446480840,v1:172.21.15.50:6825/1446480840] [v2:172.21.15.50:6826/1446480840,v1:172.21.15.50:6827/1446480840] exists,up 38dd1565-a37f-4055-acb3-aa82457cf9e7 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6808/3885625462,v1:172.21.15.50:6809/3885625462] [v2:172.21.15.50:6810/3885625462,v1:172.21.15.50:6811/3885625462] exists,up f5ef5f03-d714-4329-b14b-1881ad1e7358 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6800/3027840955,v1:172.21.15.50:6801/3027840955] [v2:172.21.15.50:6802/3027840955,v1:172.21.15.50:6803/3027840955] exists,up 7b87b0cc-2484-4a66-be1b-232a7e36dc11 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6816/2889879466,v1:172.21.15.50:6817/2889879466] [v2:172.21.15.50:6818/2889879466,v1:172.21.15.50:6819/2889879466] exists,up f6d63b1e-2673-4542-a2e2-fbb0c4577864 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6808/1774319792,v1:172.21.15.110:6809/1774319792] [v2:172.21.15.110:6810/1774319792,v1:172.21.15.110:6811/1774319792] exists,up 273ec4c6-0c2a-41d5-90c1-68b317365484 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6816/1348894681,v1:172.21.15.110:6817/1348894681] [v2:172.21.15.110:6818/1348894681,v1:172.21.15.110:6819/1348894681] exists,up 5f6cf36b-2dd0-47de-97c4-42e98f849734 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6824/792585226,v1:172.21.15.110:6825/792585226] [v2:172.21.15.110:6826/792585226,v1:172.21.15.110:6827/792585226] exists,up 2d6ed4a6-3d83-4c9d-9e96-2dbab049448a 2024-09-05T17:30:41.508 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/2161010500,v1:172.21.15.110:6801/2161010500] [v2:172.21.15.110:6802/2161010500,v1:172.21.15.110:6803/2161010500] exists,up dbe1901b-5f78-419f-864a-89946452f4a6 2024-09-05T17:30:41.524 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6824/1446480840,v1:172.21.15.50:6825/1446480840] [v2:172.21.15.50:6826/1446480840,v1:172.21.15.50:6827/1446480840] exists,up 38dd1565-a37f-4055-acb3-aa82457cf9e7', 'osd.1 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6808/3885625462,v1:172.21.15.50:6809/3885625462] [v2:172.21.15.50:6810/3885625462,v1:172.21.15.50:6811/3885625462] exists,up f5ef5f03-d714-4329-b14b-1881ad1e7358', 'osd.2 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6800/3027840955,v1:172.21.15.50:6801/3027840955] [v2:172.21.15.50:6802/3027840955,v1:172.21.15.50:6803/3027840955] exists,up 7b87b0cc-2484-4a66-be1b-232a7e36dc11', 'osd.3 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.50:6816/2889879466,v1:172.21.15.50:6817/2889879466] [v2:172.21.15.50:6818/2889879466,v1:172.21.15.50:6819/2889879466] exists,up f6d63b1e-2673-4542-a2e2-fbb0c4577864', 'osd.4 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6808/1774319792,v1:172.21.15.110:6809/1774319792] [v2:172.21.15.110:6810/1774319792,v1:172.21.15.110:6811/1774319792] exists,up 273ec4c6-0c2a-41d5-90c1-68b317365484', 'osd.5 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6816/1348894681,v1:172.21.15.110:6817/1348894681] [v2:172.21.15.110:6818/1348894681,v1:172.21.15.110:6819/1348894681] exists,up 5f6cf36b-2dd0-47de-97c4-42e98f849734', 'osd.6 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6824/792585226,v1:172.21.15.110:6825/792585226] [v2:172.21.15.110:6826/792585226,v1:172.21.15.110:6827/792585226] exists,up 2d6ed4a6-3d83-4c9d-9e96-2dbab049448a', 'osd.7 up in weight 1 up_from 14 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/2161010500,v1:172.21.15.110:6801/2161010500] [v2:172.21.15.110:6802/2161010500,v1:172.21.15.110:6803/2161010500] exists,up dbe1901b-5f78-419f-864a-89946452f4a6'] 2024-09-05T17:30:41.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-05T17:30:41.642 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:41.642 INFO:teuthology.orchestra.run.smithi050.stdout: "name": "mon.a", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster": "ceph", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "admin_socket_mode": "", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_client_required": "cephx, none", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_cluster_required": "cephx", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_debug": "true", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_service_required": "cephx", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-05T17:30:41.643 INFO:teuthology.orchestra.run.smithi050.stdout: "auth_supported": "cephx", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_aio": "true", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_aio_poll_ms": "250", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_aio_reap_max": "16", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_async_discard_threads": "0", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_block_size": "4096", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_debug_aio": "false", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_debug_inflight_ios": "false", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_enable_discard": "false", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_flock_retry": "3", 2024-09-05T17:30:41.644 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_inject_crash": "0", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_ioring": "false", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_ioring_hipri": "false", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bdev_type": "", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_alloc_size": "1048576", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_allocator": "hybrid", 2024-09-05T17:30:41.645 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_buffered_io": "true", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_check_for_zeros": "false", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_compact_log_sync": "false", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_max_log_runway": "4194304", 2024-09-05T17:30:41.646 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_max_prefetch": "1048576", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_min_flush_size": "524288", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_min_log_runway": "1048576", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_replay_recovery": "false", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluefs_sync_write": "false", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_allocation_from_file": "true", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_allocator": "hybrid", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_async_db_compaction": "true", 2024-09-05T17:30:41.647 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bdev_label_multi": "true", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_create": "true", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_db_create": "false", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_db_path": "", 2024-09-05T17:30:41.648 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_db_size": "0", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_path": "", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_preallocate_file": "false", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_size": "107374182400", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_wal_create": "false", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_wal_path": "", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_block_wal_size": "100663296", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bluefs": "true", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-05T17:30:41.649 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_autotune": "true", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_size": "0", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-05T17:30:41.650 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cache_type": "2q", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_clone_cow": "true", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_mode": "none", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_csum_type": "crc32c", 2024-09-05T17:30:41.651 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_freelist": "false", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-05T17:30:41.652 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_small_allocations": "0", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_default_buffered_read": "true", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_default_buffered_write": "false", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-05T17:30:41.653 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fail_eio": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_on_mount": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_on_umount": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-05T17:30:41.654 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_ignore_data_csum": "false", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_log_op_age": "5.000000", 2024-09-05T17:30:41.655 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_max_alloc_size": "0", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_max_blob_size": "0", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_max_deferred_txc": "32", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_min_alloc_size": "0", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_nid_prealloc": "1024", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-05T17:30:41.656 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_retry_disk_reads": "3", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_rocksdb_cf": "true", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_spdk_mem": "512", 2024-09-05T17:30:41.657 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_tracing": "false", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-05T17:30:41.658 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_write_v2": "false", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_write_v2_random": "false", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "bluestore_zero_block_detection": "false", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-05T17:30:41.659 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephx_cluster_require_signatures": "false", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephx_cluster_require_version": "2", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephx_require_signatures": "false", 2024-09-05T17:30:41.660 INFO:teuthology.orchestra.run.smithi050.stdout: "cephx_require_version": "2", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "cephx_service_require_signatures": "false", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "cephx_service_require_version": "2", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "cephx_sign_messages": "true", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "chdir": "", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_acl_type": "", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_asio_thread_count": "2", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_cache_mid": "0.750000", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_cache_size": "16384", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_caps_release_delay": "5", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_check_pool_perm": "true", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_debug_force_sync_read": "false", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_debug_getattr_caps": "false", 2024-09-05T17:30:41.661 INFO:teuthology.orchestra.run.smithi050.stdout: "client_debug_inject_features": "", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_debug_inject_tick_delay": "0", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_die_on_failed_remount": "false", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_dirsize_rbytes": "true", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_force_lazyio": "false", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_fs": "", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_inject_release_failure": "false", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_max_inline_size": "4096", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_mds_namespace": "", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_metadata": "", 2024-09-05T17:30:41.662 INFO:teuthology.orchestra.run.smithi050.stdout: "client_mount_gid": "-1", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_mount_timeout": "300", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_mount_uid": "-1", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_mountpoint": "/", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_notify_timeout": "10", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_oc": "true", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_oc_max_dirty": "104857600", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_oc_max_objects": "1000", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_oc_size": "209715200", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_oc_target_dirty": "8388608", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_permissions": "true", 2024-09-05T17:30:41.663 INFO:teuthology.orchestra.run.smithi050.stdout: "client_quota": "true", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_quota_df": "true", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_readahead_max_bytes": "0", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_readahead_max_periods": "4", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_readahead_min": "131072", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_reconnect_stale": "false", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_shutdown_timeout": "30", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_snapdir": ".snap", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_tick_interval": "1", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_trace": "", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_try_dentry_invalidate": "false", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_use_faked_inos": "false", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_use_random_mds": "false", 2024-09-05T17:30:41.664 INFO:teuthology.orchestra.run.smithi050.stdout: "clog_to_graylog": "false", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "clog_to_graylog_port": "12201", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "clog_to_monitors": "default=true", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "clog_to_syslog": "false", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "clog_to_syslog_level": "info", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "-", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_network": "", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_network_interface": "", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "compressor_zlib_isal": "false", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "compressor_zlib_level": "5", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "compressor_zlib_winsize": "-15", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "compressor_zstd_level": "1", 2024-09-05T17:30:41.665 INFO:teuthology.orchestra.run.smithi050.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crimson_alien_op_num_threads": "6", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crimson_osd_stat_interval": "0", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crimson_seastar_cpu_cores": "", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crimson_seastar_num_threads": "0", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_location": "", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_location_hook": "", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_location_hook_timeout": "10", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "daemonize": "false", 2024-09-05T17:30:41.666 INFO:teuthology.orchestra.run.smithi050.stdout: "daos_pool": "tank", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_alienstore": "0/5", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_allow_any_pool_priority": "false", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_asok": "1/5", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_asok_assert_abort": "false", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_asserts_on_shutdown": "true", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_auth": "20/20", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_bdev": "1/3", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_bluefs": "1/5", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_bluestore": "1/5", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_buffer": "0/1", 2024-09-05T17:30:41.667 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_ceph_dedup": "0/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_ceph_exporter": "1/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_cephfs_mirror": "0/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_cephsqlite": "0/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_client": "0/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_compressor": "1/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_context": "0/1", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_crimson_interrupt": "0/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_crush": "1/1", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_crypto": "1/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_cyanstore": "0/5", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_deliberately_leak_memory": "false", 2024-09-05T17:30:41.668 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_disable_randomized_ping": "false", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_dpdk": "1/5", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_eventtrace": "1/5", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_filer": "0/1", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_filestore": "1/3", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_finisher": "1/1", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_fuse": "1/5", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_heartbeat_testing_span": "0", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_heartbeatmap": "1/5", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_javaclient": "1/5", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_journal": "1/3", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_journaler": "0/5", 2024-09-05T17:30:41.669 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_kstore": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_lockdep": "0/1", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mclock": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mds": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mds_balancer": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mds_locker": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mds_log": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mds_log_expire": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mds_migrator": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mds_quiesce": "3/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_memstore": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mgr": "2/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mgrc": "1/5", 2024-09-05T17:30:41.670 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_mon": "20/20", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_monc": "0/10", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_ms": "1/1", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_none": "0/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_objclass": "0/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_objectcacher": "0/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_objecter": "0/1", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_optracker": "0/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_osd": "1/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_paxos": "20/20", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_perfcounter": "1/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_prioritycache": "1/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rados": "0/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rbd": "0/5", 2024-09-05T17:30:41.671 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rbd_mirror": "0/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rbd_pwl": "0/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rbd_replay": "0/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_refs": "0/0", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_reserver": "1/1", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rgw": "1/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rgw_access": "1/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rgw_datacache": "1/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rgw_dbstore": "1/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rgw_flight": "1/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rgw_notification": "1/5", 2024-09-05T17:30:41.672 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rgw_sync": "1/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_rocksdb": "4/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_backref": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_cache": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_cleaner": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_device": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_epm": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_journal": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_lba": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_odata": "0/5", 2024-09-05T17:30:41.673 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_omap": "0/5", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_onode": "0/5", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_t": "0/5", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_seastore_tm": "0/5", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_striper": "0/1", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_test": "0/5", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_throttle": "1/1", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_timer": "0/1", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_tp": "0/5", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "debug_trace": "1/5", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "device_failure_prediction_mode": "none", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-05T17:30:41.674 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "err_to_graylog": "false", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "err_to_journald": "false", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "err_to_stderr": "true", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "err_to_syslog": "false", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event_tracing": "false", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "exporter_addr": "0.0.0.0", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "exporter_cert_file": "", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "exporter_http_port": "9926", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "exporter_key_file": "", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "exporter_prio_limit": "5", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "exporter_sort_metrics": "true", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "exporter_stats_period": "5", 2024-09-05T17:30:41.675 INFO:teuthology.orchestra.run.smithi050.stdout: "fake_statfs_for_testing": "0", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "fatal_signal_handlers": "true", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filer_max_purge_ops": "10", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filer_max_truncate_ops": "128", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_apply_finisher_threads": "1", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_blackhole": "false", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_btrfs_clone_range": "true", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_btrfs_snap": "true", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_caller_concurrency": "10", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_collect_device_partition_information": "true", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_commit_timeout": "600.000000", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_debug_inject_read_err": "false", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_debug_omap_check": "false", 2024-09-05T17:30:41.676 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_debug_verify_split": "false", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_dump_file": "", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_fadvise": "true", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_fail_eio": "true", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_fd_cache_shards": "16", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_fd_cache_size": "128", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_fiemap": "false", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_fiemap_threshold": "4096", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_inject_stall": "0", 2024-09-05T17:30:41.677 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_journal_parallel": "false", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_journal_trailing": "false", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_journal_writeahead": "false", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_kill_at": "0", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_inline_xattrs": "0", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-05T17:30:41.678 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_xattr_value_size": "0", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_merge_threshold": "-10", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_odsync_write": "false", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_omap_backend": "rocksdb", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_omap_backend_path": "", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-05T17:30:41.679 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_op_thread_timeout": "60", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_op_threads": "2", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_punch_hole": "false", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_queue_max_ops": "50", 2024-09-05T17:30:41.680 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_seek_data_hole": "false", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_sloppy_crc": "false", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_splice": "false", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_split_multiple": "2", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_split_rand_factor": "20", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_update_to": "1000", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-05T17:30:41.681 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_enable": "true", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_xfs_extsize": "false", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "filestore_zfs_snap": "false", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "fio_dir": "/tmp/fio", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "229efc05-fdc4-4e1f-8246-413b49f3eeda", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_allow_other": "true", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_atomic_o_trunc": "true", 2024-09-05T17:30:41.682 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_big_writes": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_debug": "false", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_default_permissions": "false", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_disable_pagecache": "false", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_max_write": "0", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_multithreaded": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_require_active_mds": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_set_user_groups": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_splice_move": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_splice_read": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_splice_write": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "fuse_use_invalidate_cb": "true", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-05T17:30:41.683 INFO:teuthology.orchestra.run.smithi050.stdout: "gss_target_name": "ceph", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_file": "", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_inject_failure": "0", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_interval": "5", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "host": "smithi050", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-05T17:30:41.684 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "inject_early_sigterm": "false", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "jaeger_agent_port": "6799", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "jaeger_tracing_enable": "false", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_aio": "true", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_align_min_size": "65536", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_block_align": "true", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_block_size": "4096", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_dio": "true", 2024-09-05T17:30:41.685 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_discard": "false", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_force_aio": "false", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_ignore_corruption": "false", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_max_write_bytes": "10485760", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_max_write_entries": "100", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_replay_from": "0", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_write_header_frequency": "0", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journal_zero_on_create": "false", 2024-09-05T17:30:41.686 INFO:teuthology.orchestra.run.smithi050.stdout: "journaler_prefetch_periods": "10", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "journaler_prezero_periods": "5", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "journaler_write_head_interval": "15", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "key": "", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "keyfile": "", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_backend": "rocksdb", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_default_stripe_size": "65536", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_fsck_on_mount": "false", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_max_bytes": "67108864", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_max_ops": "512", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_nid_prealloc": "1024", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_onode_map_size": "1024", 2024-09-05T17:30:41.687 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_sync_submit_transaction": "false", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "kstore_sync_transaction": "false", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "librados_thread_count": "2", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "lockdep": "false", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "lockdep_force_backtrace": "false", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "log_coarse_timestamps": "true", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "log_flush_on_exit": "false", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "log_graylog_host": "127.0.0.1", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "log_graylog_port": "12201", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "log_max_new": "1000", 2024-09-05T17:30:41.688 INFO:teuthology.orchestra.run.smithi050.stdout: "log_max_recent": "10000", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "log_stderr_prefix": "", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "log_stop_at_utilization": "0.970000", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_file": "true", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_graylog": "false", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_journald": "false", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_stderr": "false", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "log_to_syslog": "false", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "max_rotating_auth_attempts": "10", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_action_on_write_error": "1", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_alternate_name_max": "8192", 2024-09-05T17:30:41.689 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_asio_thread_count": "2", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_export_pin": "true", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_fragment_dirs": "true", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_fragment_interval": "5", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_interval": "10", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_max": "-1", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_max_until": "-1", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_merge_size": "50", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_midchunk": "0.300000", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_min_start": "0.200000", 2024-09-05T17:30:41.690 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_minchunk": "0.001000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_mode": "0", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_need_max": "1.200000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_need_min": "0.800000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_overload_epochs": "2", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_split_bits": "3", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_split_size": "10000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_target_decay": "10.000000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-05T17:30:41.691 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_beacon_grace": "15.000000", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_beacon_interval": "4.000000", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_mid": "0.700000", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_quiesce_delay": "0", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_release_free_interval": "10", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_reservation": "0.050000", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_trim_interval": "1", 2024-09-05T17:30:41.692 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cache_trim_threshold": "262144", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_client_prealloc_inos": "1000", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_connect_bootstrapping": "false", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_damage_table_max_entries": "10000", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_debug_auth_pins": "false", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_debug_frag": "false", 2024-09-05T17:30:41.693 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_debug_scatterstat": "false", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_debug_subtrees": "false", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_decay_halflife": "5.000000", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_default_dir_hash": "2", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_defer_session_stale": "true", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_deny_all_reconnect": "false", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dir_keys_per_op": "16384", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dir_max_commit_size": "10", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dir_max_entries": "0", 2024-09-05T17:30:41.694 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dir_prefetch": "true", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dump_cache_on_map": "false", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_early_reply": "true", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_enable_op_tracker": "true", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_enforce_unique_name": "true", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_export_ephemeral_random": "true", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-05T17:30:41.695 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_health_summarize_threshold": "10", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_inject_health_dummy": "false", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_inject_migrator_session_race": "false", 2024-09-05T17:30:41.696 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_join_fs": "", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_journal_format": "1", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_create_at": "0", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_dirfrag_at": "0", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_export_at": "0", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_import_at": "0", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_journal_at": "0", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_journal_expire_at": "0", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_journal_replay_at": "0", 2024-09-05T17:30:41.697 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_link_at": "0", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_mdstable_at": "0", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_openc_at": "0", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_rename_at": "0", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_kill_shutdown_at": "0", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_event_large_threshold": "524288", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_events_per_segment": "1024", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_max_events": "-1", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_max_segments": "128", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_pause": "false", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_segment_size": "0", 2024-09-05T17:30:41.698 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_trim_threshold": "128", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_log_warn_factor": "2.000000", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_caps_per_client": "1048576", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_completed_flushes": "100000", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_completed_requests": "100000", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_export_size": "20971520", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_file_recover": "32", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_purge_files": "64", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_purge_ops": "8192", 2024-09-05T17:30:41.699 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_max_snaps_per_dir": "100", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_metrics_update_interval": "2", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_min_caps_per_client": "100", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_min_caps_working_set": "10000", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_numa_node": "-1", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_op_complaint_time": "30.000000", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_op_history_duration": "600", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_op_history_size": "20", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_op_history_slow_op_size": "20", 2024-09-05T17:30:41.700 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_op_log_threshold": "5", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_ping_grace": "15", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_ping_interval": "5", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_recall_max_caps": "30000", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_recall_warning_threshold": "262144", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_replay_interval": "1.000000", 2024-09-05T17:30:41.701 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_root_ino_gid": "0", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_root_ino_uid": "0", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-05T17:30:41.702 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_shutdown_check": "0", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_skip_ino": "0", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_snap_max_uid": "4294967294", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_snap_min_uid": "0", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_snap_rstat": "false", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_standby_replay_damaged": "false", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_symlink_recovery": "true", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_thrash_exports": "0", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_thrash_fragments": "0", 2024-09-05T17:30:41.703 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_tick_interval": "5.000000", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_valgrind_exit": "false", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_verify_backtrace": "1", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_verify_scatter": "false", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mds_wipe_sessions": "false", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mempool_debug": "false", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "memstore_device_bytes": "1073741824", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "memstore_page_set": "false", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "memstore_page_size": "65536", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_client_bytes": "134217728", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_client_messages": "512", 2024-09-05T17:30:41.704 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_disabled_modules": "", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_enable_op_tracker": "true", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_max_pg_creating": "1024", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_max_pg_num_change": "128", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_mds_bytes": "134217728", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_mds_messages": "128", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_mon_bytes": "134217728", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_mon_messages": "128", 2024-09-05T17:30:41.705 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_op_history_duration": "600", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_op_history_size": "20", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_op_log_threshold": "5", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_osd_bytes": "536870912", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_osd_messages": "8192", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_pool": "true", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_standby_modules": "true", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_stats_period": "5", 2024-09-05T17:30:41.706 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_stats_threshold": "5", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_tick_period": "2", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_allow_pool_delete": "true", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_allow_pool_size_one": "true", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_auth_validate_all_caps": "true", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_bytes": "104857600", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_directed_command_retry": "5", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-05T17:30:41.707 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_hunt_parallel": "3", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_log_interval": "1.000000", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_ping_interval": "10.000000", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_client_target_rank": "-1", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_level": "debug", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_to_file": "true", 2024-09-05T17:30:41.708 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_to_journald": "false", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_compact_on_bootstrap": "false", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_compact_on_start": "false", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_compact_on_trim": "true", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-05T17:30:41.709 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_cpu_threads": "4", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_crush_min_required_version": "hammer", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_daemon_bytes": "419430400", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_data_avail_crit": "5", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_data_avail_warn": "5", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_data_size_warn": "16106127360", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_dump_json": "false", 2024-09-05T17:30:41.710 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_dump_transactions": "false", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_extra_checks": "false", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_no_require_reef": "false", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_no_require_squid": "false", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_down_mkfs_grace": "120", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_down_uptime_grace": "60", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_election_default_strategy": "1", 2024-09-05T17:30:41.711 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_election_timeout": "5.000000", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_elector_ping_divisor": "2", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_enable_op_tracker": "true", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_fake_pool_delete": "false", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_force_quorum_join": "false", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_globalid_prealloc": "10000", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_health_detail_to_clog": "false", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_health_log_update_period": "5", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_health_max_detail": "50", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_health_to_clog": "true", 2024-09-05T17:30:41.712 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_health_to_clog_interval": "600", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_host": "172.21.15.50,[v2:172.21.15.50:3301,v1:172.21.15.50:6790],172.21.15.110", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_host_override": "", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_initial_members": "", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_lease": "5.000000", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-05T17:30:41.713 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_log_full_interval": "50", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_log_max": "10000", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_log_max_summary": "50", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_log_epochs": "500", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_osd": "10000", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_pg_per_osd": "10000", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_pool_pg_num": "65536", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-05T17:30:41.714 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mds_force_trim_to": "0", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mds_skip_sanity": "false", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_memory_autotune": "true", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_memory_target": "2147483648", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mgr_beacon_grace": "30", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mgr_digest_period": "5", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mgr_inactive_grace": "60", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_min_osdmap_epochs": "500", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_op_complaint_time": "30", 2024-09-05T17:30:41.715 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_op_history_duration": "600", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_op_history_size": "20", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_op_history_slow_op_size": "20", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_op_log_threshold": "5", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_auto_mark_in": "false", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_cache_size": "500", 2024-09-05T17:30:41.716 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_down_out_interval": "600", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_force_trim_to": "0", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-05T17:30:41.717 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_min_down_reporters": "2", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_report_timeout": "900", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-05T17:30:41.718 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_pg_stuck_threshold": "60", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-05T17:30:41.719 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_probe_timeout": "2.000000", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_reweight_max_change": "0.050000", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_reweight_max_osds": "4", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_scrub_interval": "86400", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_scrub_max_keys": "100", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_scrub_timeout": "300", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_session_timeout": "300", 2024-09-05T17:30:41.720 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_smart_report_timeout": "5", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_stat_smooth_intervals": "6", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_stretch_pool_min_size": "2", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_stretch_pool_size": "4", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_sync_debug": "false", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_sync_provider_kill_at": "0", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_sync_requester_kill_at": "0", 2024-09-05T17:30:41.721 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_sync_timeout": "60.000000", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_target_pg_per_osd": "100", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_tick_interval": "5", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_timecheck_interval": "300.000000", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_use_min_delay_socket": "false", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_older_version_delay": "604800", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-05T17:30:41.722 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_misplaced": "false", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_older_version": "true", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-05T17:30:41.723 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "monmap": "", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-05T17:30:41.724 INFO:teuthology.orchestra.run.smithi050.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "motr_tracing_enabled": "false", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_op_threads": "3", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_cm": "false", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_device_name": "", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_dscp": "96", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_local_gid": "", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_port_num": "1", 2024-09-05T17:30:41.725 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_sl": "3", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_support_srq": "true", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_rdma_type": "ib", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_async_reap_threshold": "5", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_before_connect": "false", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_ipv4": "true", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_ipv6": "false", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_msgr1": "true", 2024-09-05T17:30:41.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_msgr2": "true", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_port_max": "7568", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_port_min": "6800", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_retry_count": "3", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_bind_retry_delay": "5", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_blackhole_client": "false", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_blackhole_mds": "false", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_blackhole_mgr": "false", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_blackhole_mon": "false", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_blackhole_osd": "false", 2024-09-05T17:30:41.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_client_mode": "crc secure", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_cluster_mode": "crc secure", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_cluster_type": "", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_compress_secure": "false", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_connection_idle_timeout": "900", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_connection_ready_timeout": "10", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_crc_data": "true", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_crc_header": "true", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_die_on_bad_msg": "false", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_die_on_bug": "true", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_die_on_old_message": "true", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_die_on_skipped_message": "false", 2024-09-05T17:30:41.728 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_coremask": "0xF", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_enable_tso": "true", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_hugepages": "", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_lro": "true", 2024-09-05T17:30:41.729 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_memory_channel": "4", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_pmd": "", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_port_id": "0", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_dump_on_send": "false", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_initial_backoff": "0.200000", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_inject_delay_max": "1.000000", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_inject_delay_type": "", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_inject_network_congestion": "0", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_inject_socket_failures": "5000", 2024-09-05T17:30:41.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_learn_addr_from_peer": "true", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_max_accept_failures": "4", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_max_backoff": "15.000000", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_mon_client_mode": "secure crc", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_mon_service_mode": "secure crc", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_osd_compress_min_size": "1024", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_osd_compress_mode": "none", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_pq_min_cost": "65536", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_public_type": "", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_service_mode": "crc secure", 2024-09-05T17:30:41.731 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_tcp_listen_backlog": "512", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_tcp_nodelay": "true", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_tcp_rcvbuf": "0", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "ms_type": "async+posix", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "no_config_file": "false", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter_completion_locks_per_session": "32", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-05T17:30:41.732 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter_inflight_ops": "1024", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter_tick_interval": "5.000000", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "objecter_timeout": "10.000000", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "objectstore_blackhole": "false", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "openssl_engine_opts": "", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_agent_delay_time": "5.000000", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_agent_hist_halflife": "1000", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_agent_max_low_ops": "2", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_agent_max_ops": "4", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-05T17:30:41.733 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_agent_slop": "0.020000", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_asio_thread_count": "2", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_async_recovery_min_cost": "100", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_backfill_scan_max": "512", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_backfill_scan_min": "64", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_backoff_on_degraded": "false", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_backoff_on_peering": "false", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_backoff_on_unfound": "true", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_beacon_report_interval": "300", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bench_duration": "30", 2024-09-05T17:30:41.734 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bench_max_block_size": "67108864", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_blkin_trace_all": "false", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_check_for_log_corruption": "false", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-05T17:30:41.735 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_class_update_on_start": "true", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_client_message_cap": "256", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_client_message_size_cap": "524288000", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_client_op_priority": "63", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_client_watch_timeout": "30", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_command_max_records": "256", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_compact_on_start": "false", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_crush_update_on_start": "true", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_crush_update_weight_set": "true", 2024-09-05T17:30:41.736 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_feed_pullee": "-1", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_misdirected_ops": "false", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_no_acting_change": "false", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_no_purge_strays": "false", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_op_order": "false", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-05T17:30:41.737 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_shutdown": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_trim_objects": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_verify_snaps": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_deep_scrub_keys": "1024", 2024-09-05T17:30:41.738 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_deep_scrub_stride": "524288", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_default_notify_timeout": "30", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_delete_sleep": "0.000000", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_discard_disconnected_ops": "true", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_ec_partial_reads": "true", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_enable_op_tracker": "true", 2024-09-05T17:30:41.739 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_fast_info": "true", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_fast_shutdown": "true", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-05T17:30:41.740 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_function_tracing": "false", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_heartbeat_grace": "20", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_heartbeat_interval": "6", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_heartbeat_min_peers": "10", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_heartbeat_min_size": "2000", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_heartbeat_stale": "600", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_hit_set_max_size": "100000", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_hit_set_min_size": "1000", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-05T17:30:41.741 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_journal_size": "5120", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_kill_backfill_at": "0", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_map_cache_size": "50", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_map_dedup": "true", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_map_message_max": "40", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_map_share_max_epochs": "40", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_attr_name_len": "100", 2024-09-05T17:30:41.742 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_attr_size": "0", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_backfills": "1", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_markdown_count": "5", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_markdown_period": "600", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_object_name_len": "2048", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_object_namespace_len": "256", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_object_size": "134217728", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_pg_blocked_by": "16", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_pg_log_entries": "10000", 2024-09-05T17:30:41.743 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_pgls": "1024", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_push_cost": "8388608", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_push_objects": "10", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_scrubs": "3", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_trimming_pgs": "2", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_write_op_reply_len": "64", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_max_write_size": "90", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-05T17:30:41.744 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_profile": "balanced", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-05T17:30:41.745 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_memory_base": "805306368", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_memory_cache_min": "134217728", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_memory_target": "4294967296", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_memory_target_autotune": "false", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_min_pg_log_entries": "250", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_min_recovery_priority": "0", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mon_report_interval": "5", 2024-09-05T17:30:41.746 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_num_cache_shards": "32", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_num_op_tracker_shard": "32", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_numa_auto_affinity": "true", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_numa_node": "-1", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_numa_prefer_iface": "true", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_objecter_finishers": "1", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_objectstore": "bluestore", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_objectstore_fuse": "false", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_objectstore_tracing": "false", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_complaint_time": "30.000000", 2024-09-05T17:30:41.747 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_history_duration": "600", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_history_size": "20", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_history_slow_op_size": "20", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_log_threshold": "5", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_num_shards": "0", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_num_shards_hdd": "5", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_num_shards_ssd": "8", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-05T17:30:41.748 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_pq_min_cost": "65536", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_queue_cut_off": "high", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_op_thread_timeout": "15", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_open_classes_on_start": "true", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_os_flags": "0", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_peering_op_priority": "255", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_delete_cost": "1048576", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_delete_priority": "5", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-05T17:30:41.749 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_log_trim_max": "10000", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_log_trim_min": "100", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-05T17:30:41.750 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_crimson": "false", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_flags": "0", 2024-09-05T17:30:41.751 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_min_size": "0", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_pg_num": "32", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_pgp_num": "0", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_read_ratio": "70", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_size": "2", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_default_type": "replicated", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_push_per_object_cost": "1000", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-05T17:30:41.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recover_clone_overlap": "true", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_cost": "20971520", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_max_active": "0", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_max_single_start": "1", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_op_priority": "3", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_priority": "5", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-05T17:30:41.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_sleep": "0.000000", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_repair_during_recovery": "false", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_requested_scrub_priority": "120", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_auto_repair": "false", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-05T17:30:41.754 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_begin_hour": "0", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_begin_week_day": "0", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_chunk_max": "25", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_chunk_min": "5", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_cost": "52428800", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_during_recovery": "false", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_end_hour": "0", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_end_week_day": "0", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_event_cost": "4096", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_invalid_stats": "true", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-05T17:30:41.755 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_max_preemptions": "5", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_priority": "5", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_scrub_sleep": "0.000000", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_skip_data_digest": "false", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_smart_report_timeout": "5", 2024-09-05T17:30:41.756 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_snap_trim_cost": "1048576", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_snap_trim_priority": "5", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_target_transaction_size": "30", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-05T17:30:41.757 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_tracing": "false", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_use_stale_snap": "false", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osdc_blkin_trace_all": "false", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_kill_at": "0", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_max_join_drift": "10", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_min": "500", 2024-09-05T17:30:41.758 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_min_wait": "0.050000", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_propose_interval": "1.000000", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_service_trim_max": "500", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_service_trim_min": "250", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_stash_full_interval": "25", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_trim_max": "500", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "paxos_trim_min": "250", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "perf": "true", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "-", 2024-09-05T17:30:41.759 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrv": "", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "public_bind_addr": "-", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "public_network": "", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "public_network_interface": "", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "qat_compressor_busy_polling": "false", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "qat_compressor_enabled": "false", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "qat_compressor_session_max_number": "256", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "rados_mon_op_timeout": "0", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "rados_osd_op_timeout": "0", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "rados_tracing": "false", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_atime_update_interval": "60", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_balance_parent_reads": "false", 2024-09-05T17:30:41.760 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_balance_snap_reads": "false", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_blkin_trace_all": "false", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache": "true", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache_policy": "writearound", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache_size": "33554432", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_clone_copy_on_read": "false", 2024-09-05T17:30:41.761 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_compression_hint": "none", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_concurrent_management_ops": "10", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_clone_format": "auto", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_data_pool": "", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_features": "61", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_format": "2", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_map_options": "", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_order": "22", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_pool": "rbd", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_stripe_count": "0", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_default_stripe_unit": "0", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-05T17:30:41.762 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_enable_alloc_hint": "true", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_io_scheduler": "simple", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-05T17:30:41.763 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_order": "24", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_pool": "", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_journal_splay_width": "4", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_localize_parent_reads": "false", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_localize_snap_reads": "false", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-05T17:30:41.764 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-05T17:30:41.765 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-05T17:30:41.766 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_mtime_update_interval": "60", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_non_blocking_aio": "true", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_op_thread_timeout": "60", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_op_threads": "1", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_parent_cache_enabled": "false", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_plugins": "", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_bps_burst": "0", 2024-09-05T17:30:41.767 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_bps_limit": "0", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_exclude_ops": "0", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_iops_burst": "0", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_iops_limit": "0", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-05T17:30:41.768 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_read_from_replica_policy": "default", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-05T17:30:41.769 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_skip_partial_discard": "true", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_tracing": "false", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_validate_names": "true", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd_validate_pool": "true", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "restapi_base_url": "", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "restapi_log_level": "", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_acl_grants_max_num": "100", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_admin_entry": "admin", 2024-09-05T17:30:41.770 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_asio_assert_yielding": "false", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_backend_store": "rados", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_barbican_url": "", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_beast_enable_async": "true", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_counters_cache": "false", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-05T17:30:41.771 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_cache_enabled": "true", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_cache_expiry_interval": "900", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_cache_lru_size": "25000", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_config_store": "rados", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_content_length_compat": "false", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_copy_obj_progress": "true", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_cors_rules_max_num": "100", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_cross_domain_policy": "", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_kmip_addr": "", 2024-09-05T17:30:41.772 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_kmip_password": "", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_kmip_username": "", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_require_ssl": "true", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-05T17:30:41.773 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_addr": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_auth": "token", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_namespace": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_prefix": "", 2024-09-05T17:30:41.774 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_token_file": "", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_curl_buffersize": "524288", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_curl_low_speed_time": "300", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-05T17:30:41.775 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-05T17:30:41.776 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_data_log_changes_size": "1000", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_data_log_num_shards": "128", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_data_log_window": "30", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-05T17:30:41.777 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_disable_s3select": "false", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-05T17:30:41.778 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dns_name": "", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dns_s3website_name": "", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dynamic_resharding": "true", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enable_gc_threads": "true", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enable_lc_threads": "true", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enable_mdsearch": "true", 2024-09-05T17:30:41.779 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enable_ops_log": "false", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enable_quota_threads": "true", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enable_static_website": "false", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enable_usage_log": "false", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_enforce_swift_acls": "true", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_exit_timeout_secs": "120", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_expose_bucket": "false", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_extended_http_attrs": "", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_filter": "none", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_frontends": "beast port=7480", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_max_deferred": "50", 2024-09-05T17:30:41.780 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_max_objs": "32", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_gc_processor_period": "3600", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_init_timeout": "300", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-05T17:30:41.781 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_kafka_connection_idle": "300", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_admin_domain": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_admin_password": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_admin_password_path": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_admin_project": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_admin_tenant": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_admin_token": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_admin_token_path": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_admin_user": "", 2024-09-05T17:30:41.782 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_barbican_domain": "", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_barbican_password": "", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_barbican_project": "", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_barbican_user": "", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_url": "", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lc_debug_interval": "-1", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lc_lock_max_time": "90", 2024-09-05T17:30:41.783 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lc_max_objs": "32", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lc_max_rules": "1000", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lc_max_worker": "3", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lc_thread_delay": "0", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ldap_dnattr": "uid", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ldap_searchfilter": "", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ldap_uri": "", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-05T17:30:41.784 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_log_http_headers": "", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_log_object_name_utc": "false", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_attr_name_len": "0", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_attr_size": "0", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_chunk_size": "4194304", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-05T17:30:41.785 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_listing_results": "1000", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_notify_retries": "10", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_put_param_size": "1048576", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_put_size": "5368709120", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_max_slo_entries": "1000", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_md_log_max_shards": "64", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_mp_lock_max_time": "600", 2024-09-05T17:30:41.786 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_max_gc": "300", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-05T17:30:41.787 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_num_async_rados_threads": "32", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_num_control_oids": "8", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_numa_node": "-1", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_objexp_chunk_size": "100", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_objexp_gc_interval": "600", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-05T17:30:41.788 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_op_thread_timeout": "600", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_op_tracing": "false", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_opa_token": "", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_opa_url": "", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_opa_verify_ssl": "true", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ops_log_rados": "false", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_ops_log_socket_path": "", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_period_push_interval": "2.000000", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-05T17:30:41.789 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_posix_cache_lanes": "3", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_posix_cache_partitions": "3", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_print_continue": "true", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-05T17:30:41.790 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_rados_tracing": "false", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_realm": "", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_realm_id": "", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_region": "", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_request_uri": "", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_reshard_batch_size": "64", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-05T17:30:41.791 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_reshard_max_aio": "128", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_reshard_num_logs": "16", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_reshard_thread_interval": "600", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_resolve_cname": "false", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_run_sync_thread": "true", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-05T17:30:41.792 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_scheduler_type": "throttler", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_script_uri": "", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_service_provider_name": "", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sts_client_id": "", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sts_client_secret": "", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sts_entry": "sts", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sts_key": "sts", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sts_min_session_duration": "900", 2024-09-05T17:30:41.793 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sts_token_introspection_url": "", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_account_in_url": "false", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_auth_entry": "auth", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_auth_url": "", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_custom_header": "", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_need_stats": "true", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_tenant_name": "", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_token_expiration": "86400", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_url": "", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_url_prefix": "swift", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-05T17:30:41.794 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_lease_period": "120", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_thread_pool_size": "512", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-05T17:30:41.795 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_torrent_comment": "", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_torrent_createby": "", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_torrent_encoding": "", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_torrent_flag": "false", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_torrent_origin": "", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_torrent_tracker": "", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_trust_forwarded_https": "false", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-05T17:30:41.796 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_usage_max_shards": "32", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_usage_max_user_shards": "1", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_use_opa_authz": "false", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_counters_cache": "false", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_max_buckets": "1000", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_policies_max_num": "100", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-05T17:30:41.797 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_user_unique_email": "true", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_verify_ssl": "true", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_zone": "", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_zone_id": "", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_zonegroup": "", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_zonegroup_id": "", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgwlc_auto_session_clear": "true", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_block_size": "4096", 2024-09-05T17:30:41.798 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cache_size": "536870912", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-05T17:30:41.799 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_index_type": "binary_search", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_partition_filters": "false", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_perf": "false", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "run_dir": "/var/run/ceph", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_block_create": "true", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_cache_lru_size": "67108864", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-05T17:30:41.800 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_default_max_object_size": "16777216", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_device_size": "53687091200", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_full_integrity_check": "false", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_journal_batch_capacity": "16", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_main_device_type": "SSD", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-05T17:30:41.801 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "seastore_segment_size": "67108864", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "set_keepcaps": "false", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "setgroup": "", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "setuser": "", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "setuser_match_path": "", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "thp": "false", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "threadpool_default_timeout": "60", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "throttler_perf_counter": "true", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tmp_dir": "/tmp", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-05T17:30:41.802 INFO:teuthology.orchestra.run.smithi050.stdout: "uadk_compressor_enabled": "false", 2024-09-05T17:30:41.803 INFO:teuthology.orchestra.run.smithi050.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-05T17:30:41.803 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:41.805 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-05T17:30:41.946 INFO:teuthology.orchestra.run.smithi050.stdout:mon.a: {} 2024-09-05T17:30:41.947 INFO:teuthology.orchestra.run.smithi050.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-05T17:30:41.959 INFO:teuthology.orchestra.run.smithi050.stdout:mon.b: {} 2024-09-05T17:30:41.959 INFO:teuthology.orchestra.run.smithi050.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-05T17:30:41.968 INFO:teuthology.orchestra.run.smithi050.stdout:mon.c: {} 2024-09-05T17:30:41.969 INFO:teuthology.orchestra.run.smithi050.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-05T17:30:41.984 DEBUG:teuthology.orchestra.run.smithi050:> type ceph-objectstore-tool 2024-09-05T17:30:41.989 INFO:teuthology.orchestra.run.smithi050.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-05T17:30:41.989 DEBUG:teuthology.orchestra.run.smithi110:> type ceph-objectstore-tool 2024-09-05T17:30:41.995 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-05T17:30:41.996 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-05T17:30:42.012 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-05T17:30:42.012 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-05T17:30:42.012 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:30:42.012 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:30:42.012 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-05T17:30:42.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-05T17:30:42.013 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-05T17:30:42.013 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-05T17:30:42.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:30:42.014 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-05T17:30:42.014 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:30:42.014 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-05T17:30:42.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:30:42.015 DEBUG:teuthology.orchestra.run.smithi050:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-05T17:30:42.041 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:42.039+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:42.055 INFO:teuthology.orchestra.run.smithi050.stdout:mapped writes DISABLED 2024-09-05T17:30:42.055 INFO:teuthology.orchestra.run.smithi050.stdout:mapped reads DISABLED 2024-09-05T17:30:42.055 INFO:teuthology.orchestra.run.smithi050.stdout:Seed set to 2211 2024-09-05T17:30:42.117 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:42.115+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:42.176 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:42.177 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:42.186 INFO:teuthology.orchestra.run.smithi050.stderr:no valid command found; 10 closest matches: 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:0 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:1 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:2 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:abort 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:assert 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:bench [] [] [] [] 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs debug_inject_read_zeros 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs files list 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs stats 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:bluestore allocator dump block 2024-09-05T17:30:42.187 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: invalid command 2024-09-05T17:30:42.189 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:30:42.189 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-05T17:30:42.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-05T17:30:42.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:30:42.202 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:30:42.202 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:30:42.219 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:30:42.219 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:30:42.219 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:42.221+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:42.236 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:30:42.236 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:30:42.252 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:30:42.253 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:30:42.274 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:30:42.274 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:30:42.299 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:30:42.299 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:30:42.320 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:42.320 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:42.321 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:30:42.321 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:30:42.322 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:42.325+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:42.332 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:30:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:no valid command found; 10 closest matches: 2024-09-05T17:30:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:0 2024-09-05T17:30:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:1 2024-09-05T17:30:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:2 2024-09-05T17:30:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:abort 2024-09-05T17:30:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:assert 2024-09-05T17:30:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:bench [] [] [] [] 2024-09-05T17:30:42.340 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs debug_inject_read_zeros 2024-09-05T17:30:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs files list 2024-09-05T17:30:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs stats 2024-09-05T17:30:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:bluestore allocator dump block 2024-09-05T17:30:42.341 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: invalid command 2024-09-05T17:30:42.342 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:30:42.343 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-05T17:30:42.343 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-05T17:30:42.355 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:30:42.356 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:30:42.423 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:42.423+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:42.449 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:42.450 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:42.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:30:42.501 INFO:teuthology.orchestra.run.smithi050.stderr:no valid command found; 10 closest matches: 2024-09-05T17:30:42.501 INFO:teuthology.orchestra.run.smithi050.stderr:0 2024-09-05T17:30:42.501 INFO:teuthology.orchestra.run.smithi050.stderr:1 2024-09-05T17:30:42.501 INFO:teuthology.orchestra.run.smithi050.stderr:2 2024-09-05T17:30:42.502 INFO:teuthology.orchestra.run.smithi050.stderr:abort 2024-09-05T17:30:42.502 INFO:teuthology.orchestra.run.smithi050.stderr:assert 2024-09-05T17:30:42.502 INFO:teuthology.orchestra.run.smithi050.stderr:bench [] [] [] [] 2024-09-05T17:30:42.502 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs debug_inject_read_zeros 2024-09-05T17:30:42.502 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs files list 2024-09-05T17:30:42.502 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs stats 2024-09-05T17:30:42.503 INFO:teuthology.orchestra.run.smithi050.stderr:bluestore allocator dump block 2024-09-05T17:30:42.503 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: invalid command 2024-09-05T17:30:42.504 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:30:42.504 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-05T17:30:42.505 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-05T17:30:42.552 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:42.557+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:42.568 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:30:42.586 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:42.586 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:42.606 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:30:42.648 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:42.653+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:no valid command found; 10 closest matches: 2024-09-05T17:30:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:0 2024-09-05T17:30:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:1 2024-09-05T17:30:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:2 2024-09-05T17:30:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:abort 2024-09-05T17:30:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:assert 2024-09-05T17:30:42.710 INFO:teuthology.orchestra.run.smithi050.stderr:bench [] [] [] [] 2024-09-05T17:30:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs debug_inject_read_zeros 2024-09-05T17:30:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs files list 2024-09-05T17:30:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs stats 2024-09-05T17:30:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:bluestore allocator dump block 2024-09-05T17:30:42.711 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: invalid command 2024-09-05T17:30:42.713 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:30:42.713 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-05T17:30:42.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-05T17:30:42.760 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:42.765+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:42.761 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:42.775 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:30:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:no valid command found; 10 closest matches: 2024-09-05T17:30:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:0 2024-09-05T17:30:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:1 2024-09-05T17:30:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:2 2024-09-05T17:30:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:abort 2024-09-05T17:30:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:assert 2024-09-05T17:30:42.856 INFO:teuthology.orchestra.run.smithi050.stderr:bench [] [] [] [] 2024-09-05T17:30:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs debug_inject_read_zeros 2024-09-05T17:30:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs files list 2024-09-05T17:30:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs stats 2024-09-05T17:30:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:bluestore allocator dump block 2024-09-05T17:30:42.857 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: invalid command 2024-09-05T17:30:42.857 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:42.861+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:42.859 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:30:42.859 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-05T17:30:42.859 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-05T17:30:42.925 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:42.925 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:42.927 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:42.929+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:42.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:30:43.029 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:43.027+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:43.041 INFO:teuthology.orchestra.run.smithi050.stderr:no valid command found; 10 closest matches: 2024-09-05T17:30:43.041 INFO:teuthology.orchestra.run.smithi050.stderr:0 2024-09-05T17:30:43.041 INFO:teuthology.orchestra.run.smithi050.stderr:1 2024-09-05T17:30:43.041 INFO:teuthology.orchestra.run.smithi050.stderr:2 2024-09-05T17:30:43.041 INFO:teuthology.orchestra.run.smithi050.stderr:abort 2024-09-05T17:30:43.041 INFO:teuthology.orchestra.run.smithi050.stderr:assert 2024-09-05T17:30:43.042 INFO:teuthology.orchestra.run.smithi050.stderr:bench [] [] [] [] 2024-09-05T17:30:43.042 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs debug_inject_read_zeros 2024-09-05T17:30:43.042 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs files list 2024-09-05T17:30:43.042 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs stats 2024-09-05T17:30:43.042 INFO:teuthology.orchestra.run.smithi050.stderr:bluestore allocator dump block 2024-09-05T17:30:43.042 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: invalid command 2024-09-05T17:30:43.044 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:30:43.044 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-05T17:30:43.044 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-05T17:30:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:43.094 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:43.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:30:43.156 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:43.161+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:43.187 INFO:teuthology.orchestra.run.smithi050.stderr:no valid command found; 10 closest matches: 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:0 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:1 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:2 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:abort 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:assert 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:bench [] [] [] [] 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs debug_inject_read_zeros 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs files list 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs stats 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:bluestore allocator dump block 2024-09-05T17:30:43.188 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: invalid command 2024-09-05T17:30:43.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:30:43.190 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-05T17:30:43.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-05T17:30:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:43.228 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:43.230 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:43.227+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:43.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:30:43.336 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:43.341+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:43.369 INFO:teuthology.orchestra.run.smithi050.stderr:no valid command found; 10 closest matches: 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:0 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:1 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:2 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:abort 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:assert 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:bench [] [] [] [] 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs debug_inject_read_zeros 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs files list 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:bluefs stats 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:bluestore allocator dump block 2024-09-05T17:30:43.370 INFO:teuthology.orchestra.run.smithi050.stderr:Error EINVAL: invalid command 2024-09-05T17:30:43.373 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:30:43.373 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-05T17:30:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:43.398 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:43.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:30:43.456 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:43.461+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:43.533 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:43.535+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:43.578 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:43.632 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:43.633 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:30:43.634 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:43.637+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:43.734 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:43.731+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:43.801 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:43.801 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:43.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:30:43.835 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:43.835+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:43.936 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:43.935+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:43.940 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:43.940 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:43.954 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:30:44.037 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:44.035+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:44.087 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:44.087 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:44.101 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:30:44.138 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:44.141+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:44.239 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:44.241+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:44.272 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:44.272 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:44.286 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:30:44.340 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:44.339+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:44.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:30:44.403 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:44.403 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:44.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:30:44.459 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:44.459+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:44.534 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:30:44.534 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:30:44.542 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:44.539+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:44.550 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:30:44.550 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:30:44.567 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:30:44.567 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:30:44.580 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:44.580 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:44.586 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:30:44.586 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:30:44.591 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:30:44.593 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:30:44.606 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:30:44.607 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:30:44.625 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:30:44.671 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:30:44.671 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:30:44.672 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:30:44.672 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:30:44.672 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:30:44.673 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:44.671+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:44.775 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:44.775+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:44.797 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:30:44.797 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:30:44.797 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:44.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:30:44.899 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:44.899+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:44.977 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:44.975+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4257.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:32.042988+0000", 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.939548477000001, 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071416459999999998, 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:44.980 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4257", 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3597611725", 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.042988+0000", 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:44.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.042988+0000", 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.042998+0000", 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8230000000000006e-06 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:44.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.043010+0000", 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2177e-05 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.043041+0000", 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1727000000000003e-05 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.043095+0000", 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3726e-05 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.043402+0000", 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000307101 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.043424+0000", 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2082999999999998e-05 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.045716+0000", 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022917089999999998 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.045941+0000", 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022513500000000001 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.046219+0000", 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027752099999999997 2024-09-05T17:30:44.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.048295+0000", 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020765940000000002 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049869+0000", 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001573278 2024-09-05T17:30:44.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.050019+0000", 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015023900000000001 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.050129+0000", 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011053299999999999 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:44.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4257.0:1 2.3 e20/19 ondisk, result = 0)", 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:32.049559+0000", 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.932977487, 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00058418900000000004, 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049559+0000", 2024-09-05T17:30:44.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:44.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:44.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049559+0000", 2024-09-05T17:30:44.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:44.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049561+0000", 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1629999999999999e-06 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049573+0000", 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2084e-05 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049603+0000", 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9713000000000002e-05 2024-09-05T17:30:44.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049626+0000", 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3149000000000001e-05 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049829+0000", 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000203329 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:44.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.049851+0000", 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.156e-05 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.050143+0000", 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029219100000000002 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4257.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-05T17:30:44.995 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:32.055754+0000", 2024-09-05T17:30:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.926782565, 2024-09-05T17:30:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048053599999999999, 2024-09-05T17:30:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:30:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4257", 2024-09-05T17:30:44.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3597611725", 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.055754+0000", 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:44.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.055754+0000", 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.055756+0000", 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.667e-06 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.055769+0000", 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.271e-05 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.055801+0000", 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2385999999999998e-05 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:44.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.055824+0000", 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2583e-05 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.055950+0000", 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012618899999999999 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:45.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.056234+0000", 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028400099999999998 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4257.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e20)", 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:32.056680+0000", 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 12.925855942, 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037238700000000001, 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:45.001 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4257", 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3597611725", 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 3 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.056680+0000", 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:45.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.056680+0000", 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.056683+0000", 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4530000000000001e-06 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.056699+0000", 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6803000000000002e-05 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.056731+0000", 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1829999999999998e-05 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.056746+0000", 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4922999999999999e-05 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.056856+0000", 2024-09-05T17:30:45.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110213 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:32.057053+0000", 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019616499999999999 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4257.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:33.047545+0000", 2024-09-05T17:30:45.005 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.934991460999999, 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.007484999, 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4257", 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3597611725", 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 5 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.047545+0000", 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.047545+0000", 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.047549+0000", 2024-09-05T17:30:45.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8099999999999999e-06 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.047564+0000", 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5153e-05 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.047600+0000", 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6174000000000003e-05 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.047621+0000", 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1152999999999999e-05 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.047778+0000", 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015712199999999999 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.047789+0000", 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0746e-05 2024-09-05T17:30:45.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.051500+0000", 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037115479999999998 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.051813+0000", 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031298099999999999 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-09-05T17:30:45.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.052183+0000", 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036918399999999999 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054202+0000", 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020196509999999999 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054882+0000", 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067978099999999996 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054965+0000", 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2520000000000003e-05 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.055030+0000", 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5176000000000001e-05 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4257.0:5 2.2 e20/19 ondisk, result = 0)", 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:33.054700+0000", 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.927836276000001, 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000343934, 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054700+0000", 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054700+0000", 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054707+0000", 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.063e-06 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054717+0000", 2024-09-05T17:30:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8530000000000004e-06 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054741+0000", 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4153000000000001e-05 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054754+0000", 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-05 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054852+0000", 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.054869+0000", 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7056000000000001e-05 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:33.055044+0000", 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000174406 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4257.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:34.062796+0000", 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.919740003999999, 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069292199999999998, 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4257", 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3597611725", 2024-09-05T17:30:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.062796+0000", 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.062796+0000", 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.062800+0000", 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5039999999999998e-06 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.062816+0000", 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6595999999999998e-05 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.062853+0000", 2024-09-05T17:30:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6449999999999998e-05 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.062872+0000", 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8923000000000002e-05 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.063071+0000", 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199359 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.063082+0000", 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1456e-05 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.067016+0000", 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039338630000000001 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.067154+0000", 2024-09-05T17:30:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013793200000000001 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.067369+0000", 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000214558 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.068855+0000", 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014862090000000001 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069567+0000", 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00071242699999999996 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069655+0000", 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7083000000000006e-05 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069725+0000", 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0859999999999996e-05 2024-09-05T17:30:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4257.0:7 2.2 e21/19 ondisk, result = 0)", 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:34.069365+0000", 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.913171140999999, 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037337699999999999, 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069365+0000", 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069365+0000", 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069367+0000", 2024-09-05T17:30:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8700000000000001e-06 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069375+0000", 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7300000000000005e-06 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069398+0000", 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3816e-05 2024-09-05T17:30:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069420+0000", 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1449000000000001e-05 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069541+0000", 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012120000000000001 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069555+0000", 2024-09-05T17:30:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4372999999999999e-05 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:34.069738+0000", 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018293899999999999 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:45.028 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:45.030 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:30:45.078 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:45.081+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:45.179 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:45.179+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:45.194 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:45.194 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:45.194 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:30:45.194 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:45.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:30:45.280 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:45.281+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:45.376 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:45.376 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:45.377 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:30:45.377 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:30:45.377 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:45.380 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:45.379+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:45.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:30:45.481 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:45.479+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:45.559 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:45.559 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:30:45.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:30:45.559 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [] 2024-09-05T17:30:45.559 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:45.569 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:30:45.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:30:45.582 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:45.585+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:45.683 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:45.683+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:45.736 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:45.754 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:30:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:45.756 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:30:45.785 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:45.789+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:45.885 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:45.889+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:45.924 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:45.925 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:45.925 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:30:45.925 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:30:45.925 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:45.938 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:30:45.986 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:45.983+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.041549454999998, 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.596273423, 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014198443, 2024-09-05T17:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 45 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462128+0000", 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.277e-06 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462140+0000", 2024-09-05T17:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.189e-05 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462163+0000", 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2889000000000001e-05 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462182+0000", 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9193000000000001e-05 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.470719+0000", 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085367580000000002 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.470866+0000", 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000146706 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.471072+0000", 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020635099999999999 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.475968+0000", 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048962889999999998 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476144+0000", 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000175742 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476223+0000", 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8875999999999995e-05 2024-09-05T17:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476326+0000", 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102472 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.596168697, 2024-09-05T17:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016877395999999999, 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 46 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462233+0000", 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.356e-06 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462244+0000", 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0866999999999999e-05 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462271+0000", 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7399999999999999e-05 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462290+0000", 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8649000000000001e-05 2024-09-05T17:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.472814+0000", 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010523963000000001 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.473010+0000", 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000195525 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.473215+0000", 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020561099999999999 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476120+0000", 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029048619999999998 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478974+0000", 2024-09-05T17:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002853487 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479048+0000", 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3949999999999995e-05 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479109+0000", 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1725999999999998e-05 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.596073165, 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017239246999999999, 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 47 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462329+0000", 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7430000000000001e-06 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462484+0000", 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015445899999999999 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462503+0000", 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.942e-05 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462515+0000", 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2257e-05 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474087+0000", 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011572241 2024-09-05T17:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474359+0000", 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000271267 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474735+0000", 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037594800000000003 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479251+0000", 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004516351 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479442+0000", 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000190762 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479505+0000", 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3202999999999998e-05 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479567+0000", 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1595999999999998e-05 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.595863753, 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017251313000000001, 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 48 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462538+0000", 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462558+0000", 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9695999999999999e-05 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462573+0000", 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4873e-05 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462581+0000", 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4700000000000002e-06 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476438+0000", 2024-09-05T17:30:46.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013857236 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476683+0000", 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024466499999999998 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.477061+0000", 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037820699999999998 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479423+0000", 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023615749999999999 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479582+0000", 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000159383 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479688+0000", 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000106019 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479788+0000", 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100042 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.595781937000002, 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019256863999999999, 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.092 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 49 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462620+0000", 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462629+0000", 2024-09-05T17:30:46.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7099999999999996e-06 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462676+0000", 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7836000000000001e-05 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462686+0000", 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4630000000000007e-06 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.477921+0000", 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015235393 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478057+0000", 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013605600000000001 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478323+0000", 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026547400000000003 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481738+0000", 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034152700000000002 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481757+0000", 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9423e-05 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481821+0000", 2024-09-05T17:30:46.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3449999999999997e-05 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481875+0000", 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4589000000000002e-05 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.098 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.595688711000001, 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022237915, 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 50 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462713+0000", 2024-09-05T17:30:46.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462785+0000", 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2476000000000002e-05 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462799+0000", 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4153e-05 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462808+0000", 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5799999999999992e-06 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479896+0000", 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017088398000000001 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.480128+0000", 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023147200000000001 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.480501+0000", 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037334400000000001 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484611+0000", 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041101380000000002 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484754+0000", 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000142399 2024-09-05T17:30:46.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484829+0000", 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5155999999999997e-05 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484950+0000", 2024-09-05T17:30:46.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120939 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.595577106, 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022299985000000001, 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 51 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:46.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462824+0000", 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.47e-07 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462830+0000", 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4469999999999997e-06 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462848+0000", 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8280000000000001e-05 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462860+0000", 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.243e-05 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482009+0000", 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019148515000000001 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482292+0000", 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000282835 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482679+0000", 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038745300000000001 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484734+0000", 2024-09-05T17:30:46.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020550410000000001 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484963+0000", 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022876799999999999 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485036+0000", 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2819999999999997e-05 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485123+0000", 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7548999999999998e-05 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.595516371999999, 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022782574, 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.111 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 52 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462885+0000", 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1960000000000001e-06 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462896+0000", 2024-09-05T17:30:46.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0319999999999999e-05 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462917+0000", 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.173e-05 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.463002+0000", 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4462999999999994e-05 2024-09-05T17:30:46.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483583+0000", 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020581537 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483737+0000", 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153323 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483976+0000", 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023961100000000001 2024-09-05T17:30:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485145+0000", 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011682579999999999 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485394+0000", 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024987400000000003 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485544+0000", 2024-09-05T17:30:46.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000149123 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485667+0000", 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000123139 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.125732791000001, 2024-09-05T17:30:46.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012685699, 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.75e-07 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932744+0000", 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5193999999999999e-05 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932756+0000", 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1911e-05 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932764+0000", 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9080000000000001e-06 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934296+0000", 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001531267 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934357+0000", 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1545999999999997e-05 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934450+0000", 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2297000000000001e-05 2024-09-05T17:30:46.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936128+0000", 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016780289999999999 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945240+0000", 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00911264 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945303+0000", 2024-09-05T17:30:46.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2830000000000007e-05 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945353+0000", 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0402000000000003e-05 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:46.123 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.125617925, 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012856464, 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 67 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:46.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6300000000000004e-07 2024-09-05T17:30:46.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932789+0000", 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2290000000000002e-06 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932799+0000", 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0492999999999999e-05 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932807+0000", 2024-09-05T17:30:46.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9209999999999992e-06 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935086+0000", 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022789910000000002 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935139+0000", 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2639000000000002e-05 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935244+0000", 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105571 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940354+0000", 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051093309999999999 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945447+0000", 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050934109999999999 2024-09-05T17:30:46.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945565+0000", 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118239 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945639+0000", 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3776000000000007e-05 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.125304463999999, 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012727738000000001, 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 68 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.130 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933097+0000", 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933107+0000", 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8810000000000008e-06 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933126+0000", 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9230999999999999e-05 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933138+0000", 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1406999999999999e-05 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935553+0000", 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002415394 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935609+0000", 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6110999999999999e-05 2024-09-05T17:30:46.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935735+0000", 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012551399999999999 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940369+0000", 2024-09-05T17:30:46.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046339240000000002 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945709+0000", 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053400039999999998 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945767+0000", 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8041999999999998e-05 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945824+0000", 2024-09-05T17:30:46.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7098000000000001e-05 2024-09-05T17:30:46.136 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.136 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.136 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.136 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.136 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.125236986000001, 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012931031000000001, 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 69 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.137 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933224+0000", 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9184999999999997e-05 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933236+0000", 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2894999999999999e-05 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933265+0000", 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8138000000000001e-05 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936176+0000", 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029111269999999999 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936270+0000", 2024-09-05T17:30:46.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3851999999999995e-05 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936384+0000", 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011432199999999999 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940378+0000", 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039938029999999998 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945928+0000", 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055503269999999999 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946029+0000", 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010071199999999999 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946095+0000", 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5883000000000006e-05 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.142 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.125104731, 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012945537999999999, 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.143 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 70 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933297+0000", 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7000000000000003e-07 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933304+0000", 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7449999999999995e-06 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933317+0000", 2024-09-05T17:30:46.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2309e-05 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933327+0000", 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9850000000000001e-06 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937198+0000", 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038713459999999999 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937342+0000", 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014390900000000001 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220435 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942102+0000", 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045396179999999996 2024-09-05T17:30:46.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946168+0000", 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040662809999999997 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946210+0000", 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1650999999999998e-05 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946241+0000", 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1389000000000001e-05 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.125022773000001, 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013113009, 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.149 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4600000000000005e-07 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933383+0000", 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.549e-06 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933389+0000", 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3110000000000002e-06 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933393+0000", 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2590000000000002e-06 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938234+0000", 2024-09-05T17:30:46.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048408899999999996 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938317+0000", 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3096000000000005e-05 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938456+0000", 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013882599999999999 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942114+0000", 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036578190000000001 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946334+0000", 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042197770000000001 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946436+0000", 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101822 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946491+0000", 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5114000000000001e-05 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.124998892000001, 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01324849, 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.155 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5199999999999998e-07 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933461+0000", 2024-09-05T17:30:46.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8884000000000001e-05 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933469+0000", 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6260000000000003e-06 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933473+0000", 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5070000000000002e-06 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938866+0000", 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053928539999999999 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.939015+0000", 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014948300000000001 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.939244+0000", 2024-09-05T17:30:46.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022877100000000001 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943974+0000", 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047294399999999997 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946550+0000", 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0025768850000000001 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946589+0000", 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8050999999999999e-05 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946650+0000", 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1637000000000006e-05 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.161 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.124916298999999, 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013379528, 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 73 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933485+0000", 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.82e-07 2024-09-05T17:30:46.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933488+0000", 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1240000000000001e-06 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933493+0000", 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2070000000000003e-06 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933497+0000", 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8759999999999998e-06 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940436+0000", 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069388760000000001 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940528+0000", 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2517999999999997e-05 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940675+0000", 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014695600000000001 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943986+0000", 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033105019999999999 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946714+0000", 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027282220000000002 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946808+0000", 2024-09-05T17:30:46.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4369000000000004e-05 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946864+0000", 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5396000000000003e-05 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.124897008000001, 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013485855, 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:46.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4700000000000002e-07 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933507+0000", 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7319999999999998e-06 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933511+0000", 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3599999999999998e-06 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933514+0000", 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.36e-06 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941114+0000", 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0075993099999999997 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941245+0000", 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131669 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941471+0000", 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022618099999999999 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944147+0000", 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026750530000000002 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946920+0000", 2024-09-05T17:30:46.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00277349 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946960+0000", 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9786999999999997e-05 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946989+0000", 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9566000000000001e-05 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.124879239999999, 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013694682999999999, 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933522+0000", 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5400000000000002e-07 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933563+0000", 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1634000000000002e-05 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933571+0000", 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9109999999999993e-06 2024-09-05T17:30:46.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933575+0000", 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.155e-06 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942168+0000", 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085926839999999997 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942247+0000", 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9221000000000006e-05 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942374+0000", 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012631799999999999 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944157+0000", 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017829969999999999 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947060+0000", 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029038039999999998 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947162+0000", 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101346 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947216+0000", 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4258999999999997e-05 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.124816257999999, 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013750551999999999, 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:46.181 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 76 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933585+0000", 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933588+0000", 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.366e-06 2024-09-05T17:30:46.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933592+0000", 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3290000000000004e-06 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933596+0000", 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.41e-06 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943003+0000", 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094069459999999994 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943155+0000", 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015211900000000001 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943373+0000", 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021815800000000001 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944315+0000", 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00094195300000000004 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947265+0000", 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029501359999999999 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947306+0000", 2024-09-05T17:30:46.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0479000000000003e-05 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947335+0000", 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9263000000000001e-05 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:46.187 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:46.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:30:46.189 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:46.193+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:46.291 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:46.293+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:46.377 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:46.378 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:46.378 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:46.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:30:46.421 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:46.425+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:46.492 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:46.491+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:46.535 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:46.536 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:46.536 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:30:46.536 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:30:46.536 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:46.548 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:30:46.592 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:46.597+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:46.672 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:46.672 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:30:46.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:30:46.672 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:20 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'10, mlcod=17'8)", 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.367242+0000", 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.308031620000001, 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021152409999999999, 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.367242+0000", 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.367242+0000", 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.367244+0000", 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.917e-06 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.367488+0000", 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024377099999999999 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.367517+0000", 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8807e-05 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.367530+0000", 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.358e-05 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.367707+0000", 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000176601 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.367748+0000", 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1056999999999997e-05 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369286+0000", 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001537839 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369357+0000", 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1668999999999994e-05 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:22 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'12, mlcod=17'8)", 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.369408+0000", 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.305865299000001, 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019631230000000002, 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369408+0000", 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369408+0000", 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369410+0000", 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9929999999999998e-06 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369510+0000", 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9952999999999997e-05 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369540+0000", 2024-09-05T17:30:46.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9272999999999999e-05 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369553+0000", 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.314e-05 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369719+0000", 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000166069 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.369758+0000", 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9440000000000002e-05 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.371309+0000", 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015510949999999999 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.371371+0000", 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2160000000000001e-05 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.683 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.936833+0000", 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.738440369999999, 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.009089349, 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936833+0000", 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936833+0000", 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936835+0000", 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9300000000000002e-06 2024-09-05T17:30:46.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936847+0000", 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1533e-05 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936875+0000", 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8609999999999999e-05 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936892+0000", 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6526000000000001e-05 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936979+0000", 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7171999999999998e-05 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937011+0000", 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2393e-05 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945826+0000", 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088144160000000003 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945923+0000", 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6768999999999995e-05 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.688 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.737711445999999, 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010346731, 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937564+0000", 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0770000000000002e-06 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937719+0000", 2024-09-05T17:30:46.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015435199999999999 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937753+0000", 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4629999999999999e-05 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937771+0000", 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7544e-05 2024-09-05T17:30:46.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937897+0000", 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012583900000000001 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937982+0000", 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4948000000000001e-05 2024-09-05T17:30:46.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.947840+0000", 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098585610000000001 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.947909+0000", 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8780000000000002e-05 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.938263+0000", 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.737010464000001, 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0097423679999999995, 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.694 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938263+0000", 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938263+0000", 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938266+0000", 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5330000000000001e-06 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938275+0000", 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3570000000000004e-06 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938294+0000", 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8632999999999999e-05 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938304+0000", 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939348+0000", 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010431259999999999 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939399+0000", 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1702000000000001e-05 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.947916+0000", 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085169140000000004 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948006+0000", 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9419000000000006e-05 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.938751+0000", 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.736522533999999, 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093610340000000007, 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938751+0000", 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938751+0000", 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938753+0000", 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.567e-06 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938762+0000", 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.217e-06 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938779+0000", 2024-09-05T17:30:46.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6926e-05 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938791+0000", 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1727e-05 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940101+0000", 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001310383 2024-09-05T17:30:46.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940156+0000", 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4968e-05 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948012+0000", 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078563869999999994 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948112+0000", 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9858999999999994e-05 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'41)", 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.939534+0000", 2024-09-05T17:30:46.705 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.735740126, 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086702749999999999, 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939534+0000", 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939534+0000", 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939536+0000", 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5359999999999999e-06 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939610+0000", 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4239999999999994e-05 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939635+0000", 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4652999999999999e-05 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939650+0000", 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940863+0000", 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012129389999999999 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940917+0000", 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3897000000000003e-05 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948119+0000", 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072014180000000002 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948204+0000", 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5239000000000002e-05 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'41)", 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.940673+0000", 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.734600678, 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076093970000000004, 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940673+0000", 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940673+0000", 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940675+0000", 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.934e-06 2024-09-05T17:30:46.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940687+0000", 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1666e-05 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940714+0000", 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6999999999999999e-05 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940727+0000", 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.323e-05 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942127+0000", 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400168 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942182+0000", 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4857e-05 2024-09-05T17:30:46.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948210+0000", 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060284320000000002 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948282+0000", 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2109999999999999e-05 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'41)", 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.941563+0000", 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.733710259999999, 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067969550000000004, 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941563+0000", 2024-09-05T17:30:46.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941563+0000", 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941565+0000", 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9400000000000001e-06 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941577+0000", 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1419e-05 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941603+0000", 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5846999999999998e-05 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941616+0000", 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3376e-05 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942917+0000", 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001301204 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942969+0000", 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1502999999999998e-05 2024-09-05T17:30:46.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948289+0000", 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053202329999999997 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948360+0000", 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1433000000000005e-05 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.720 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'41)", 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.942368+0000", 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.732905626000001, 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00610342, 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.721 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942368+0000", 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942368+0000", 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942370+0000", 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0229999999999999e-06 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942443+0000", 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3308999999999999e-05 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942468+0000", 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.44e-05 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942481+0000", 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3443e-05 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943693+0000", 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012115030000000001 2024-09-05T17:30:46.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943743+0000", 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0093999999999998e-05 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948369+0000", 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046260720000000002 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948471+0000", 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102576 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'41)", 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.943737+0000", 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.731536255999998, 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048393990000000003, 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943737+0000", 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943737+0000", 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943739+0000", 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9400000000000001e-06 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943750+0000", 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.114e-05 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943777+0000", 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6846e-05 2024-09-05T17:30:46.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943812+0000", 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4270000000000002e-05 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945087+0000", 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001275177 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945142+0000", 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5025000000000003e-05 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948483+0000", 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033407620000000002 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948577+0000", 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4239000000000004e-05 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'41)", 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.944546+0000", 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.730727917999999, 2024-09-05T17:30:46.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041292280000000004, 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.944546+0000", 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.944546+0000", 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.944548+0000", 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9570000000000001e-06 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.944561+0000", 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.296e-05 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.944589+0000", 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8309e-05 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.944602+0000", 2024-09-05T17:30:46.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.278e-05 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946032+0000", 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001430511 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946089+0000", 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7204999999999999e-05 2024-09-05T17:30:46.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948585+0000", 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024951560000000001 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948675+0000", 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0350000000000001e-05 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'41)", 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.945475+0000", 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.729798805000001, 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00327488, 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945475+0000", 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945475+0000", 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945477+0000", 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.973e-06 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945536+0000", 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8687000000000002e-05 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945567+0000", 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1279999999999999e-05 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945580+0000", 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3665999999999999e-05 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946833+0000", 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001252862 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946875+0000", 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1213e-05 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948682+0000", 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001807723 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948750+0000", 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7476000000000002e-05 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:76 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'41)", 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.946414+0000", 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.728860041000001, 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035232449999999999, 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946414+0000", 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946414+0000", 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946415+0000", 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6300000000000001e-06 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946428+0000", 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2306999999999999e-05 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946452+0000", 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4839000000000001e-05 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.946464+0000", 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1576999999999999e-05 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948830+0000", 2024-09-05T17:30:46.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023658759999999998 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948881+0000", 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1635999999999998e-05 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.949881+0000", 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00099959700000000007 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.949937+0000", 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5782999999999998e-05 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.951062+0000", 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.724211577999998, 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019498499999999999, 2024-09-05T17:30:46.747 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951062+0000", 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951062+0000", 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951064+0000", 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.95e-06 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951178+0000", 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113696 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951207+0000", 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9227e-05 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951220+0000", 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3135999999999999e-05 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951339+0000", 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118876 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951397+0000", 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7701999999999997e-05 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.952935+0000", 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001538673 2024-09-05T17:30:46.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953012+0000", 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6589999999999997e-05 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:78 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'56, mlcod=17'53)", 2024-09-05T17:30:46.752 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.951971+0000", 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.723302568000001, 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023153969999999999, 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951971+0000", 2024-09-05T17:30:46.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951971+0000", 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.951973+0000", 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9599999999999999e-06 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.952071+0000", 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8122999999999995e-05 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.952103+0000", 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2262999999999999e-05 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.952117+0000", 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.396e-05 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.952275+0000", 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015735200000000001 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.952325+0000", 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0112999999999999e-05 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954190+0000", 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018656199999999999 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954286+0000", 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6006000000000002e-05 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:79 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'57, mlcod=17'53)", 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.953016+0000", 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.722257838000001, 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023595000000000001, 2024-09-05T17:30:46.758 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953016+0000", 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953016+0000", 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953017+0000", 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.626e-06 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953149+0000", 2024-09-05T17:30:46.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013172300000000001 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953177+0000", 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7586e-05 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953197+0000", 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.069e-05 2024-09-05T17:30:46.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953315+0000", 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011709699999999999 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.953344+0000", 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9243000000000001e-05 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.955285+0000", 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019410250000000001 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.955375+0000", 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0509999999999999e-05 2024-09-05T17:30:46.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:80 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'58, mlcod=17'53)", 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.954017+0000", 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.721256576000002, 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020260429999999999, 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954017+0000", 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954017+0000", 2024-09-05T17:30:46.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954019+0000", 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6139999999999999e-06 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954134+0000", 2024-09-05T17:30:46.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115296 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954159+0000", 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5469e-05 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954171+0000", 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1847e-05 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954379+0000", 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020785199999999999 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.954433+0000", 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3940000000000002e-05 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.955952+0000", 2024-09-05T17:30:46.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015193520000000001 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.956043+0000", 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0673000000000004e-05 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:93 1.0 e18/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 18'67, mlcod=18'64)", 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:28.304965+0000", 2024-09-05T17:30:46.769 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.370308762000001, 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023539699999999999, 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.304965+0000", 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.304965+0000", 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.304967+0000", 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.844e-06 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.305041+0000", 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4496e-05 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.305066+0000", 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4797e-05 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.305078+0000", 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2429000000000001e-05 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.305218+0000", 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013928599999999999 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.305276+0000", 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7815999999999997e-05 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.307283+0000", 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020079020000000002 2024-09-05T17:30:46.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:28.307319+0000", 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.54e-05 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:45.590757+0000", 2024-09-05T17:30:46.774 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.084516222, 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064825239999999999, 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 11 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590757+0000", 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590757+0000", 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:46.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590760+0000", 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9210000000000001e-06 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590775+0000", 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4375e-05 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590801+0000", 2024-09-05T17:30:46.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5910000000000001e-05 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590814+0000", 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2891000000000001e-05 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590908+0000", 2024-09-05T17:30:46.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4430000000000002e-05 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590915+0000", 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3730000000000004e-06 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.594558+0000", 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003643121 2024-09-05T17:30:46.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.594760+0000", 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000201819 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.595184+0000", 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042355300000000002 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.596655+0000", 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014709600000000001 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.597038+0000", 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038340800000000001 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.597158+0000", 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119499 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.597240+0000", 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2263999999999997e-05 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:46.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:46.783 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:46.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:30:46.785 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:30:46.786 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:46.783+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:46.885 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:46.887+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:46.943 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:46.944 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:46.944 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:46.944 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:46.962 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:30:46.972 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:30:46.972 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:30:46.986 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:46.989+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:46.988 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:30:46.989 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:30:47.005 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:30:47.005 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:30:47.023 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:30:47.023 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:30:47.044 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:30:47.044 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:30:47.065 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:30:47.065 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:30:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:47.073 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:47.086 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:30:47.086 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:30:47.087 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:30:47.088 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:47.087+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:47.106 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:30:47.107 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:30:47.189 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:47.187+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:47.216 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:47.216 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:47.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:30:47.291 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:47.291+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:47.361 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:47.361 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:47.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:30:47.424 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:47.429+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:47.491 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:47.491+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:47.509 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:47.509 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:47.523 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:30:47.540 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:47.540 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:47.557 INFO:teuthology.orchestra.run.smithi050.stdout:3 write 0x2df870d thru 0x2dfca5d (0x4351 bytes) 2024-09-05T17:30:47.560 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:47.560 INFO:teuthology.orchestra.run.smithi050.stdout:6 read 0x24fcc44 thru 0x24fdcdc (0x1099 bytes) 2024-09-05T17:30:47.560 INFO:teuthology.orchestra.run.smithi050.stdout:7 read 0x28c480 thru 0x290af8 (0x4679 bytes) 2024-09-05T17:30:47.581 INFO:teuthology.orchestra.run.smithi050.stdout:8 writesame 0xbebe095 thru 0xbecb0c7 data_size 0x1(0xd033 bytes) 2024-09-05T17:30:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:9 read 0x436237 thru 0x438773 (0x253d bytes) 2024-09-05T17:30:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:11 read 0xb9918d4 thru 0xb9955a2 (0x3ccf bytes) 2024-09-05T17:30:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:13 read 0x99fe82b thru 0x9a07e6c (0x9642 bytes) 2024-09-05T17:30:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:18 read 0x87c354 thru 0x882f29 (0x6bd6 bytes) 2024-09-05T17:30:47.582 INFO:teuthology.orchestra.run.smithi050.stdout:19 write 0x98682e9 thru 0x986c7f2 (0x450a bytes) 2024-09-05T17:30:47.586 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:47.586 INFO:teuthology.orchestra.run.smithi050.stdout:21 read 0x4e5f573 thru 0x4e5f67f (0x10d bytes) 2024-09-05T17:30:47.586 INFO:teuthology.orchestra.run.smithi050.stdout:truncating to largest ever: 0x5ba5090 2024-09-05T17:30:47.592 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:47.597+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:47.593 INFO:teuthology.orchestra.run.smithi050.stdout:22 trunc from 0xbecb0c8 to 0x5ba5090 2024-09-05T17:30:47.601 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:30:47.622 INFO:teuthology.orchestra.run.smithi050.stdout:23 writesame 0x61d771a thru 0x61db69d data_size 0x1e(0x3f84 bytes) 2024-09-05T17:30:47.622 INFO:teuthology.orchestra.run.smithi050.stdout:24 writesame 0x43511fa thru 0x435705b data_size 0x3(0x5e62 bytes) 2024-09-05T17:30:47.635 INFO:teuthology.orchestra.run.smithi050.stdout:25 read 0x2b6415f thru 0x2b71c92 (0xdb34 bytes) 2024-09-05T17:30:47.635 INFO:teuthology.orchestra.run.smithi050.stdout:26 read 0x529ef4b thru 0x52a3f38 (0x4fee bytes) 2024-09-05T17:30:47.635 INFO:teuthology.orchestra.run.smithi050.stdout:27 write 0x5aef055 thru 0x5afa258 (0xb204 bytes) 2024-09-05T17:30:47.641 INFO:teuthology.orchestra.run.smithi050.stdout:28 writesame 0x2b51b3e thru 0x2b5a23f data_size 0xb(0x8702 bytes) 2024-09-05T17:30:47.645 INFO:teuthology.orchestra.run.smithi050.stdout:29 read 0x2961cd4 thru 0x2961e37 (0x164 bytes) 2024-09-05T17:30:47.646 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:47.646 INFO:teuthology.orchestra.run.smithi050.stdout:34 read 0x19ebcec thru 0x19ecae9 (0xdfe bytes) 2024-09-05T17:30:47.646 INFO:teuthology.orchestra.run.smithi050.stdout:35 clone 1 order 19 su 4096 sc 9 2024-09-05T17:30:47.674 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:47.674 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:47.689 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:30:47.732 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:47.737+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:47.794 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:47.791+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:47.849 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:47.850 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:47.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:30:47.895 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:47.895+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:47.980 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:47.980 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:47.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:30:47.995 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:47.995+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:48.097 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:48.101+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:48.123 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:48.123 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:48.138 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:30:48.198 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:48.201+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:48.269 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:48.269 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:48.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:30:48.327 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:48.327+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:48.374 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:30:48.395 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:30:48.395 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-05T17:30:48.396 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-05T17:30:48.405 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:48.406 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:48.419 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:30:48.440 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:48.445+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:48.500 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:48.505+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:48.588 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:48.588 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:48.601 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:30:48.601 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:48.605+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:48.602 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:30:48.702 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:48.705+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:30:48.729 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 28, 2024-09-05T17:30:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "229efc05-fdc4-4e1f-8246-413b49f3eeda", 2024-09-05T17:30:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2024-09-05T17:30:12.762369+0000", 2024-09-05T17:30:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2024-09-05T17:30:48.600408+0000", 2024-09-05T17:30:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2024-09-05T17:30:23.981355+0000", 2024-09-05T17:30:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2024-09-05T17:30:15.006059+0000", 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5804032, 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "nodeep-scrub", 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 5, 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.94999998807907104, 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-05T17:30:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 3, 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "squid", 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:25.818485+0000", 2024-09-05T17:30:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:30:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:30:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "18", 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:30:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:30:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:30:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:30:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:30:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:30:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:30:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:30:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:30:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:30:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:30:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:30:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:30:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:30:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:30:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:30.943478+0000", 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:30:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:30:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "22", 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 2, 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 22, 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:30:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:30:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:30:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2024-09-05T17:30:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "pool_client.0", 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:42.082168+0000", 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:30:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2024-09-05T17:30:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "28", 2024-09-05T17:30:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 3, 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 28, 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:30:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:30:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:30:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "38dd1565-a37f-4055-acb3-aa82457cf9e7", 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:30:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:30:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6825/1446480840", 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6827/1446480840", 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/1446480840", 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6829/1446480840", 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f5ef5f03-d714-4329-b14b-1881ad1e7358", 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/3885625462", 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/3885625462", 2024-09-05T17:30:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/3885625462", 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/3885625462", 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "7b87b0cc-2484-4a66-be1b-232a7e36dc11", 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:30:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 19, 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/3027840955", 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/3027840955", 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/3027840955", 2024-09-05T17:30:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/3027840955", 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f6d63b1e-2673-4542-a2e2-fbb0c4577864", 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:30:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2024-09-05T17:30:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/2889879466", 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6819/2889879466", 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6823/2889879466", 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6821/2889879466", 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:30:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "273ec4c6-0c2a-41d5-90c1-68b317365484", 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:30:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6808", 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6809", 2024-09-05T17:30:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6810", 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6811", 2024-09-05T17:30:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6814", 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6815", 2024-09-05T17:30:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6812", 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6813", 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6809/1774319792", 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6811/1774319792", 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6815/1774319792", 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6813/1774319792", 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "5f6cf36b-2dd0-47de-97c4-42e98f849734", 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:30:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6816", 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6817", 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:30:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6818", 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6819", 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6822", 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6823", 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6820", 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6821", 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6817/1348894681", 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6819/1348894681", 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6823/1348894681", 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6821/1348894681", 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "2d6ed4a6-3d83-4c9d-9e96-2dbab049448a", 2024-09-05T17:30:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6824", 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6825", 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6826", 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6827", 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6830", 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6831", 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6828", 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6829", 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6825/792585226", 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6827/792585226", 2024-09-05T17:30:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6831/792585226", 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6829/792585226", 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "dbe1901b-5f78-419f-864a-89946452f4a6", 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:30:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6800", 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6801", 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6802", 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6803", 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6806", 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6807", 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6804", 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6805", 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6801/2161010500", 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6803/2161010500", 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2161010500", 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2161010500", 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:30:48.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:22.246726+0000", 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.638940+0000", 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:30:48.800 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.694544+0000", 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:30:48.801 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.653253+0000", 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.467561+0000", 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.797765+0000", 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:30:48.803 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.649372+0000", 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:30:48.804 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.242988+0000", 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2024-09-05T17:30:48.805 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [ 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "snaps": [ 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "begin": 2, 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: "length": 1 2024-09-05T17:30:48.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:48.807 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:48.809 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:48.809 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:48.810 INFO:tasks.thrashosds.thrasher:j is {'epoch': 28, 'fsid': '229efc05-fdc4-4e1f-8246-413b49f3eeda', 'created': '2024-09-05T17:30:12.762369+0000', 'modified': '2024-09-05T17:30:48.600408+0000', 'last_up_change': '2024-09-05T17:30:23.981355+0000', 'last_in_change': '2024-09-05T17:30:15.006059+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T17:30:25.818485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-05T17:30:30.943478+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-05T17:30:42.082168+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 28, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '38dd1565-a37f-4055-acb3-aa82457cf9e7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6824', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6825', 'nonce': 1446480840}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6826', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6827', 'nonce': 1446480840}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6830', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6831', 'nonce': 1446480840}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6828', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6829', 'nonce': 1446480840}]}, 'public_addr': '172.21.15.50:6825/1446480840', 'cluster_addr': '172.21.15.50:6827/1446480840', 'heartbeat_back_addr': '172.21.15.50:6831/1446480840', 'heartbeat_front_addr': '172.21.15.50:6829/1446480840', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f5ef5f03-d714-4329-b14b-1881ad1e7358', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6808', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6809', 'nonce': 3885625462}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6810', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6811', 'nonce': 3885625462}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6814', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6815', 'nonce': 3885625462}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6812', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6813', 'nonce': 3885625462}]}, 'public_addr': '172.21.15.50:6809/3885625462', 'cluster_addr': '172.21.15.50:6811/3885625462', 'heartbeat_back_addr': '172.21.15.50:6815/3885625462', 'heartbeat_front_addr': '172.21.15.50:6813/3885625462', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '7b87b0cc-2484-4a66-be1b-232a7e36dc11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6800', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6801', 'nonce': 3027840955}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6802', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6803', 'nonce': 3027840955}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6806', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6807', 'nonce': 3027840955}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6804', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6805', 'nonce': 3027840955}]}, 'public_addr': '172.21.15.50:6801/3027840955', 'cluster_addr': '172.21.15.50:6803/3027840955', 'heartbeat_back_addr': '172.21.15.50:6807/3027840955', 'heartbeat_front_addr': '172.21.15.50:6805/3027840955', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'f6d63b1e-2673-4542-a2e2-fbb0c4577864', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6816', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6817', 'nonce': 2889879466}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6818', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 2889879466}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6822', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6823', 'nonce': 2889879466}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6820', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6821', 'nonce': 2889879466}]}, 'public_addr': '172.21.15.50:6817/2889879466', 'cluster_addr': '172.21.15.50:6819/2889879466', 'heartbeat_back_addr': '172.21.15.50:6823/2889879466', 'heartbeat_front_addr': '172.21.15.50:6821/2889879466', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '273ec4c6-0c2a-41d5-90c1-68b317365484', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 1774319792}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 1774319792}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 1774319792}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 1774319792}]}, 'public_addr': '172.21.15.110:6809/1774319792', 'cluster_addr': '172.21.15.110:6811/1774319792', 'heartbeat_back_addr': '172.21.15.110:6815/1774319792', 'heartbeat_front_addr': '172.21.15.110:6813/1774319792', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5f6cf36b-2dd0-47de-97c4-42e98f849734', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 1348894681}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 1348894681}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 1348894681}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 1348894681}]}, 'public_addr': '172.21.15.110:6817/1348894681', 'cluster_addr': '172.21.15.110:6819/1348894681', 'heartbeat_back_addr': '172.21.15.110:6823/1348894681', 'heartbeat_front_addr': '172.21.15.110:6821/1348894681', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2d6ed4a6-3d83-4c9d-9e96-2dbab049448a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 792585226}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 792585226}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 792585226}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 792585226}]}, 'public_addr': '172.21.15.110:6825/792585226', 'cluster_addr': '172.21.15.110:6827/792585226', 'heartbeat_back_addr': '172.21.15.110:6831/792585226', 'heartbeat_front_addr': '172.21.15.110:6829/792585226', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dbe1901b-5f78-419f-864a-89946452f4a6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2161010500}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2161010500}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2161010500}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2161010500}]}, 'public_addr': '172.21.15.110:6801/2161010500', 'cluster_addr': '172.21.15.110:6803/2161010500', 'heartbeat_back_addr': '172.21.15.110:6807/2161010500', 'heartbeat_front_addr': '172.21.15.110:6805/2161010500', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:22.246726+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.638940+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.694544+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.653253+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.467561+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.797765+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.649372+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.242988+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-05T17:30:48.810 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-05T17:30:48.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:30:48.811 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:48.807+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:48.812 INFO:teuthology.orchestra.run.smithi050.stdout:36 read 0x5dfeb7b thru 0x5e0a9f9 (0xbe7f bytes) 2024-09-05T17:30:48.812 INFO:teuthology.orchestra.run.smithi050.stdout:truncating to largest ever: 0xbdbef29 2024-09-05T17:30:48.812 INFO:teuthology.orchestra.run.smithi050.stdout:37 trunc from 0x61db69e to 0xbdbef29 2024-09-05T17:30:48.812 INFO:teuthology.orchestra.run.smithi050.stdout:38 writesame 0xce55d2d thru 0xce5bf5d data_size 0x3f(0x6231 bytes) 2024-09-05T17:30:48.812 INFO:teuthology.orchestra.run.smithi050.stdout:39 read 0xa750fe7 thru 0xa75ab75 (0x9b8f bytes) 2024-09-05T17:30:48.813 INFO:teuthology.orchestra.run.smithi050.stdout:40 read 0x656866d thru 0x6569209 (0xb9d bytes) 2024-09-05T17:30:48.813 INFO:teuthology.orchestra.run.smithi050.stdout:41 read 0xa0b4fa thru 0xa129f5 (0x74fc bytes) 2024-09-05T17:30:48.813 INFO:teuthology.orchestra.run.smithi050.stdout:42 punch from 0xaa45fad to 0xaa5544d, (0xf4a0 bytes) 2024-09-05T17:30:48.813 INFO:teuthology.orchestra.run.smithi050.stdout:43 write 0x43395f8 thru 0x43420a2 (0x8aab bytes) 2024-09-05T17:30:48.910 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:48.907+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:48.985 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:48.985 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:49.001 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:30:49.048 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:49.047+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:49.082 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.083 INFO:teuthology.orchestra.run.smithi050.stdout:47 write 0x60ce511 thru 0x60d55c4 (0x70b4 bytes) 2024-09-05T17:30:49.105 INFO:teuthology.orchestra.run.smithi050.stdout:48 write 0x127ea5e thru 0x128c6a0 (0xdc43 bytes) 2024-09-05T17:30:49.111 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:49.111+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:49.124 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:30:49.131 INFO:teuthology.orchestra.run.smithi050.stdout:50 write 0x2647422 thru 0x264e789 (0x7368 bytes) 2024-09-05T17:30:49.167 INFO:teuthology.orchestra.run.smithi050.stdout:51 read 0x186376a thru 0x1866436 (0x2ccd bytes) 2024-09-05T17:30:49.167 INFO:teuthology.orchestra.run.smithi050.stdout:52 read 0x59732e7 thru 0x597e036 (0xad50 bytes) 2024-09-05T17:30:49.169 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.177 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:49.177 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:49.180 INFO:teuthology.orchestra.run.smithi050.stdout:54 trunc from 0xce5bf5e to 0x7812ccf 2024-09-05T17:30:49.189 INFO:teuthology.orchestra.run.smithi050.stdout:55 punch from 0x1a2b7c8 to 0x1a35733, (0x9f6b bytes) 2024-09-05T17:30:49.192 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:30:49.197 INFO:teuthology.orchestra.run.smithi050.stdout:56 write 0x78eeb0e thru 0x78fa7ce (0xbcc1 bytes) 2024-09-05T17:30:49.211 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:49.213+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:49.212 INFO:teuthology.orchestra.run.smithi050.stdout:58 read 0x5291333 thru 0x529bdef (0xaabd bytes) 2024-09-05T17:30:49.212 INFO:teuthology.orchestra.run.smithi050.stdout:59 read 0x3b987a1 thru 0x3b9ac0f (0x246f bytes) 2024-09-05T17:30:49.212 INFO:teuthology.orchestra.run.smithi050.stdout:60 writesame 0x3735467 thru 0x373cebf data_size 0x1(0x7a59 bytes) 2024-09-05T17:30:49.230 INFO:teuthology.orchestra.run.smithi050.stdout:61 punch from 0x4b9b911 to 0x4b9dfcc, (0x26bb bytes) 2024-09-05T17:30:49.230 INFO:teuthology.orchestra.run.smithi050.stdout:62 read 0x2bb1227 thru 0x2bbd00a (0xbde4 bytes) 2024-09-05T17:30:49.233 INFO:teuthology.orchestra.run.smithi050.stdout:63 punch from 0x18826b5 to 0x1883ed6, (0x1821 bytes) 2024-09-05T17:30:49.246 INFO:teuthology.orchestra.run.smithi050.stdout:65 writesame 0xa68a5fb thru 0xa68e200 data_size 0x27(0x3c06 bytes) 2024-09-05T17:30:49.246 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.258 INFO:teuthology.orchestra.run.smithi050.stdout:67 write 0xccedaa0 thru 0xccf9f18 (0xc479 bytes) 2024-09-05T17:30:49.273 INFO:teuthology.orchestra.run.smithi050.stdout:68 write 0x531c4e2 thru 0x531fa0a (0x3529 bytes) 2024-09-05T17:30:49.289 INFO:teuthology.orchestra.run.smithi050.stdout:69 writesame 0xda95e36 thru 0xda98098 data_size 0x1(0x2263 bytes) 2024-09-05T17:30:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:70 writesame 0xe92caa3 thru 0xe92cbbf data_size 0x5(0x11d bytes) 2024-09-05T17:30:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:71 punch from 0x986ed45 to 0x9878c3d, (0x9ef8 bytes) 2024-09-05T17:30:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:72 read 0xa6d7a7b thru 0xa6de512 (0x6a98 bytes) 2024-09-05T17:30:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:73 read 0xd5a0acc thru 0xd5aebc8 (0xe0fd bytes) 2024-09-05T17:30:49.297 INFO:teuthology.orchestra.run.smithi050.stdout:truncating to largest ever: 0xdee57ad 2024-09-05T17:30:49.298 INFO:teuthology.orchestra.run.smithi050.stdout:74 trunc from 0xe92cbc0 to 0xdee57ad 2024-09-05T17:30:49.304 INFO:teuthology.orchestra.run.smithi050.stdout:75 write 0x6c42bff thru 0x6c45b2a (0x2f2c bytes) 2024-09-05T17:30:49.311 INFO:teuthology.orchestra.run.smithi050.stdout:76 write 0xa564ef7 thru 0xa56ed60 (0x9e6a bytes) 2024-09-05T17:30:49.311 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:49.311+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:49.312 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:30:49.313 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:30:49.323 INFO:teuthology.orchestra.run.smithi050.stdout:77 writesame 0x6d20bb9 thru 0x6d28b84 data_size 0x2(0x7fcc bytes) 2024-09-05T17:30:49.335 INFO:teuthology.orchestra.run.smithi050.stdout:78 punch from 0x325da92 to 0x32694c3, (0xba31 bytes) 2024-09-05T17:30:49.335 INFO:teuthology.orchestra.run.smithi050.stdout:79 punch from 0x155f17c to 0x156ca49, (0xd8cd bytes) 2024-09-05T17:30:49.336 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.336 INFO:teuthology.orchestra.run.smithi050.stdout:81 punch from 0xb5780a4 to 0xb57de8c, (0x5de8 bytes) 2024-09-05T17:30:49.336 INFO:teuthology.orchestra.run.smithi050.stdout:82 read 0xa568185 thru 0xa575e4f (0xdccb bytes) 2024-09-05T17:30:49.336 INFO:teuthology.orchestra.run.smithi050.stdout:83 write 0x39e8e4f thru 0x39f2df9 (0x9fab bytes) 2024-09-05T17:30:49.337 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:30:49.337 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:30:49.342 INFO:teuthology.orchestra.run.smithi050.stdout:84 punch from 0x3f4b457 to 0x3f53e40, (0x89e9 bytes) 2024-09-05T17:30:49.342 INFO:teuthology.orchestra.run.smithi050.stdout:85 write 0xab5911a thru 0xab5dde3 (0x4cca bytes) 2024-09-05T17:30:49.349 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.349 INFO:teuthology.orchestra.run.smithi050.stdout:87 write 0xbef9054 thru 0xbf02a5e (0x9a0b bytes) 2024-09-05T17:30:49.360 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:30:49.361 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:30:49.361 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.361 INFO:teuthology.orchestra.run.smithi050.stdout:89 write 0xb27339c thru 0xb282464 (0xf0c9 bytes) 2024-09-05T17:30:49.372 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.372 INFO:teuthology.orchestra.run.smithi050.stdout:91 writesame 0x2c45a62 thru 0x2c4c941 data_size 0x10(0x6ee0 bytes) 2024-09-05T17:30:49.377 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:49.378 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:49.388 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:30:49.388 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:30:49.392 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:30:49.408 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:30:49.408 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:30:49.428 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:30:49.429 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:30:49.439 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:49.439+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:49.451 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:30:49.451 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:30:49.477 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:30:49.477 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:30:49.540 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:49.545+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:49.554 INFO:teuthology.orchestra.run.smithi050.stdout:92 read 0xde468b6 thru 0xde4af3b (0x4686 bytes) 2024-09-05T17:30:49.554 INFO:teuthology.orchestra.run.smithi050.stdout:93 read 0x9795e thru 0x9f0e4 (0x7787 bytes) 2024-09-05T17:30:49.554 INFO:teuthology.orchestra.run.smithi050.stdout:94 read 0x76a9633 thru 0x76b6235 (0xcc03 bytes) 2024-09-05T17:30:49.555 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.555 INFO:teuthology.orchestra.run.smithi050.stdout:96 write 0x9f86fd0 thru 0x9f8e3c0 (0x73f1 bytes) 2024-09-05T17:30:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:49.564 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:49.564 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:30:49.564 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:30:49.564 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:49.568 INFO:teuthology.orchestra.run.smithi050.stdout:97 read 0x6c8c289 thru 0x6c90827 (0x459f bytes) 2024-09-05T17:30:49.569 INFO:teuthology.orchestra.run.smithi050.stdout:98 read 0xb24a62c thru 0xb24d36b (0x2d40 bytes) 2024-09-05T17:30:49.569 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.570 INFO:teuthology.orchestra.run.smithi050.stdout:100 writesame 0x4071c03 thru 0x4073c66 data_size 0x6(0x2064 bytes) 2024-09-05T17:30:49.573 INFO:teuthology.orchestra.run.smithi050.stdout:truncating to largest ever: 0xecb900e 2024-09-05T17:30:49.574 INFO:teuthology.orchestra.run.smithi050.stdout:102 trunc from 0xdee57ad to 0xecb900e 2024-09-05T17:30:49.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:30:49.581 INFO:teuthology.orchestra.run.smithi050.stdout:103 read 0x3451e74 thru 0x3461695 (0xf822 bytes) 2024-09-05T17:30:49.581 INFO:teuthology.orchestra.run.smithi050.stdout:105 write 0x83524a2 thru 0x8352d36 (0x895 bytes) 2024-09-05T17:30:49.585 INFO:teuthology.orchestra.run.smithi050.stdout:106 read 0xcc92a98 thru 0xcc99e63 (0x73cc bytes) 2024-09-05T17:30:49.587 INFO:teuthology.orchestra.run.smithi050.stdout:109 write 0x5487298 thru 0x548b442 (0x41ab bytes) 2024-09-05T17:30:49.594 INFO:teuthology.orchestra.run.smithi050.stdout:111 read 0x8cad053 thru 0x8cb865b (0xb609 bytes) 2024-09-05T17:30:49.595 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.595 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.595 INFO:teuthology.orchestra.run.smithi050.stdout:114 punch from 0xb952860 to 0xb954547, (0x1ce7 bytes) 2024-09-05T17:30:49.595 INFO:teuthology.orchestra.run.smithi050.stdout:116 writesame 0xa8e8ea thru 0xa90a61 data_size 0x33(0x2178 bytes) 2024-09-05T17:30:49.600 INFO:teuthology.orchestra.run.smithi050.stdout:117 read 0x3155aa0 thru 0x315c987 (0x6ee8 bytes) 2024-09-05T17:30:49.600 INFO:teuthology.orchestra.run.smithi050.stdout:118 write 0xc0540e7 thru 0xc05df5c (0x9e76 bytes) 2024-09-05T17:30:49.614 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:49.617+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:49.620 INFO:teuthology.orchestra.run.smithi050.stdout:119 trunc from 0xecb900e to 0x458ec44 2024-09-05T17:30:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:123 writesame 0x49c0ec4 thru 0x49caeda data_size 0x13(0xa017 bytes) 2024-09-05T17:30:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:124 punch from 0x33f86df to 0x3408066, (0xf987 bytes) 2024-09-05T17:30:49.702 INFO:teuthology.orchestra.run.smithi050.stdout:126 read 0xffc7a6 thru 0x100469d (0x7ef8 bytes) 2024-09-05T17:30:49.714 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:49.711+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:49.716 INFO:teuthology.orchestra.run.smithi050.stdout:127 writesame 0x88b38f4 thru 0x88bb3a5 data_size 0x2d(0x7ab2 bytes) 2024-09-05T17:30:49.717 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:49.717 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:30:49.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:30:49.717 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:30:49.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2604 3.10 3:0f142a20:::rbd_data.114070605229.0000000000000051:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 442368~2370] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:49.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.517383+0000", 2024-09-05T17:30:49.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.20166705700000001, 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054317130000000003, 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2604 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517383+0000", 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517383+0000", 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517395+0000", 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2806000000000001e-05 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517867+0000", 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00047155500000000002 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517889+0000", 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517917+0000", 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7141999999999999e-05 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.518035+0000", 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011815399999999999 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.518248+0000", 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021318500000000001 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:49.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.518647+0000", 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039882900000000001 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.520307+0000", 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001660075 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522696+0000", 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023887370000000002 2024-09-05T17:30:49.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522765+0000", 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9027000000000002e-05 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522814+0000", 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9771999999999997e-05 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2609 3.a 3:567b9325:::rbd_data.114070605229.0000000000000057:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 438272~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.520583+0000", 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.198466476, 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046712129999999996, 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:49.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2609 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.520583+0000", 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.520583+0000", 2024-09-05T17:30:49.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.520585+0000", 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3710000000000001e-06 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521342+0000", 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075738900000000002 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521378+0000", 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6154e-05 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521389+0000", 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0951000000000001e-05 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521520+0000", 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013113099999999999 2024-09-05T17:30:49.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521846+0000", 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032526400000000002 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522538+0000", 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00069247799999999995 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525111+0000", 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002572787 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525131+0000", 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.995e-05 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525208+0000", 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7741e-05 2024-09-05T17:30:49.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525254+0000", 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5997e-05 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4416.0:2604 3.10 e28/24 ondisk, result = 0)", 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.522525+0000", 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.19652470499999999, 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000300632, 2024-09-05T17:30:49.731 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522525+0000", 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522525+0000", 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522526+0000", 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.345e-06 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522537+0000", 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0457e-05 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522552+0000", 2024-09-05T17:30:49.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5393999999999999e-05 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522563+0000", 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1002000000000001e-05 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522657+0000", 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4074999999999996e-05 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522688+0000", 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0709e-05 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522826+0000", 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013765000000000001 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4416.0:2609 3.a e28/24 ondisk, result = 0)", 2024-09-05T17:30:49.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.524577+0000", 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.194473177, 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068458099999999997, 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.524577+0000", 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.524577+0000", 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.524578+0000", 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6470000000000001e-06 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.524586+0000", 2024-09-05T17:30:49.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7400000000000004e-06 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.524602+0000", 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5687000000000001e-05 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.524613+0000", 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0975000000000001e-05 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525087+0000", 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00047420300000000003 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525100+0000", 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3689999999999999e-05 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525261+0000", 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016063899999999999 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2618 3.10 3:09ec4dab:::rbd_data.114070605229.00000000000000ee:head [read 192512~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.558059+0000", 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.160990355, 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00066118800000000005, 2024-09-05T17:30:49.740 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2618 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558059+0000", 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558059+0000", 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558062+0000", 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0970000000000002e-06 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558075+0000", 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2969999999999999e-05 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558109+0000", 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3426000000000002e-05 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558132+0000", 2024-09-05T17:30:49.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3485999999999998e-05 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558309+0000", 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017648300000000001 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558479+0000", 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017060799999999999 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558721+0000", 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024111799999999999 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2620 3.a 3:57e90322:::rbd_data.114070605229.00000000000000f0:head [read 192512~4662] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:49.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.558185+0000", 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.160865009, 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00055206500000000002, 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2620 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558185+0000", 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558185+0000", 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558186+0000", 2024-09-05T17:30:49.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4330000000000001e-06 2024-09-05T17:30:49.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558193+0000", 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3300000000000001e-06 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558239+0000", 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5676000000000001e-05 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558256+0000", 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7127000000000001e-05 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558371+0000", 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115019 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558528+0000", 2024-09-05T17:30:49.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015623899999999999 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.558737+0000", 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020924100000000001 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2697 3.10 3:0f098b1d:::rbd_data.114070605229.00000000000000a2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.627238+0000", 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.091811289000000004, 2024-09-05T17:30:49.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023680379999999998, 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2697 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627238+0000", 2024-09-05T17:30:49.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627238+0000", 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627241+0000", 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3929999999999998e-06 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627262+0000", 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0903999999999998e-05 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627286+0000", 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4649999999999999e-05 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627300+0000", 2024-09-05T17:30:49.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4090000000000001e-05 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627387+0000", 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6139999999999999e-05 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627508+0000", 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121354 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.627657+0000", 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148899 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.628471+0000", 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081437899999999995 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629310+0000", 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00083867900000000005 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629468+0000", 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015777099999999999 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629606+0000", 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013877900000000001 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4416.0:2697 3.10 e28/24 ondisk, result = 0)", 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.629102+0000", 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.089947445000000001, 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052086700000000005, 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.758 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629102+0000", 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629102+0000", 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629103+0000", 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629109+0000", 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.587e-06 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629127+0000", 2024-09-05T17:30:49.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8343e-05 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629136+0000", 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1769999999999998e-06 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629270+0000", 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013432799999999999 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629292+0000", 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2444000000000001e-05 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.629623+0000", 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033078300000000002 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:2712 3.1e e28/24 3:7b32ddba:::rbd_data.114070605229.00000000000000c5:head v 28'5, mlcod=28'3)", 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.631296+0000", 2024-09-05T17:30:49.762 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.087754061999999994, 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013762379999999999, 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.631296+0000", 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.631296+0000", 2024-09-05T17:30:49.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.631297+0000", 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1599999999999999e-06 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.631304+0000", 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4499999999999998e-06 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.631320+0000", 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5981000000000002e-05 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.631330+0000", 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7669999999999998e-06 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.631454+0000", 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012371499999999999 2024-09-05T17:30:49.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.631489+0000", 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5574000000000002e-05 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.632607+0000", 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001117697 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.632672+0000", 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4894000000000006e-05 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:2719 3.1e e28/24 3:78cfa02e:::rbd_data.114070605229.00000000000000de:head v 28'6, mlcod=28'3)", 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.633022+0000", 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.086028168000000002, 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00087874100000000005, 2024-09-05T17:30:49.767 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633022+0000", 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633022+0000", 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633023+0000", 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6800000000000009e-07 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633033+0000", 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0436e-05 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633054+0000", 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0798e-05 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633064+0000", 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7759999999999992e-06 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633129+0000", 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5728999999999994e-05 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633154+0000", 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5006000000000001e-05 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633846+0000", 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00069152899999999997 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.633900+0000", 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4499000000000001e-05 2024-09-05T17:30:49.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2726 3.10 3:09ec4dab:::rbd_data.114070605229.00000000000000ee:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.634304+0000", 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.084745539999999994, 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024025349999999999, 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:49.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2726 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634304+0000", 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634304+0000", 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634306+0000", 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2620000000000001e-06 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634313+0000", 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8700000000000003e-06 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634333+0000", 2024-09-05T17:30:49.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9471e-05 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634344+0000", 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1103e-05 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634426+0000", 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1910999999999996e-05 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634509+0000", 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3061999999999999e-05 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634643+0000", 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134244 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.635717+0000", 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010742219999999999 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636238+0000", 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000520526 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636430+0000", 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019195599999999999 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636707+0000", 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027690800000000003 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2728 3.a 3:57e90322:::rbd_data.114070605229.00000000000000f0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.634621+0000", 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.084428728999999994, 2024-09-05T17:30:49.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0025297290000000001, 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2728 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634621+0000", 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634621+0000", 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634622+0000", 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799999999999999e-06 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634628+0000", 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8719999999999999e-06 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634644+0000", 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5668999999999999e-05 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634656+0000", 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1674e-05 2024-09-05T17:30:49.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634777+0000", 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121632 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.634967+0000", 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018934900000000001 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:49.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.635160+0000", 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019359100000000001 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636153+0000", 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00099259799999999992 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.637017+0000", 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00086419899999999996 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.637088+0000", 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1316999999999995e-05 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.637151+0000", 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2447999999999996e-05 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4416.0:2726 3.10 e28/24 ondisk, result = 0)", 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.636038+0000", 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.083011666999999997, 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068199799999999996, 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636038+0000", 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636038+0000", 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636039+0000", 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636045+0000", 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5910000000000003e-06 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636059+0000", 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.448e-05 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636072+0000", 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2317000000000001e-05 2024-09-05T17:30:49.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636176+0000", 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104434 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636197+0000", 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1092999999999999e-05 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636720+0000", 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052286900000000002 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4416.0:2728 3.a e28/24 ondisk, result = 0)", 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.636889+0000", 2024-09-05T17:30:49.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.082161023999999999, 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026900699999999998, 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636889+0000", 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636889+0000", 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636890+0000", 2024-09-05T17:30:49.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1680000000000001e-06 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636896+0000", 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3280000000000002e-06 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636915+0000", 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9233e-05 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.636926+0000", 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0995000000000001e-05 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.637001+0000", 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4569999999999999e-05 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.637009+0000", 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6510000000000001e-06 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.637158+0000", 2024-09-05T17:30:49.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014906199999999999 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2751 3.a 3:536b3615:::rbd_data.114070605229.0000000000000157:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.640698+0000", 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.078352029000000004, 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002946167, 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.795 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2751 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.640698+0000", 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.640698+0000", 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.640700+0000", 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.295e-06 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.640707+0000", 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1049999999999997e-06 2024-09-05T17:30:49.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.640728+0000", 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0602e-05 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.640751+0000", 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3368999999999999e-05 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.640836+0000", 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5253000000000005e-05 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.640949+0000", 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011266 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.641085+0000", 2024-09-05T17:30:49.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136329 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.642038+0000", 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00095228299999999995 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643499+0000", 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001461015 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643580+0000", 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1858000000000001e-05 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643644+0000", 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3398000000000005e-05 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.801 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4416.0:2751 3.a e28/24 ondisk, result = 0)", 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.643339+0000", 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.075710248999999993, 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031351300000000002, 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643339+0000", 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643339+0000", 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643341+0000", 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4139999999999999e-06 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643347+0000", 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.567e-06 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643369+0000", 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1977e-05 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643380+0000", 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0253e-05 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643480+0000", 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010053899999999999 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643491+0000", 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0417e-05 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.643653+0000", 2024-09-05T17:30:49.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016234600000000001 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:2781 3.1e e28/24 3:7e7705df:::rbd_data.114070605229.000000000000019d:head v 28'7, mlcod=28'5)", 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.650375+0000", 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.068674871999999998, 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00092725299999999995, 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:49.806 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.650375+0000", 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.650375+0000", 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.650376+0000", 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6190000000000001e-06 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.650388+0000", 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1379999999999999e-05 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.650415+0000", 2024-09-05T17:30:49.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7623999999999998e-05 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.650433+0000", 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7424000000000001e-05 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.650534+0000", 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101402 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:49.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.650554+0000", 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0137e-05 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.651255+0000", 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00070065500000000001 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.651302+0000", 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7012000000000003e-05 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:49.811 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:49.811 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:49.812 INFO:teuthology.orchestra.run.smithi050.stdout:129 trunc from 0x88bb3a6 to 0xdb9d5fb 2024-09-05T17:30:49.812 INFO:teuthology.orchestra.run.smithi050.stdout:130 read 0x544dc9d thru 0x544e695 (0x9f9 bytes) 2024-09-05T17:30:49.812 INFO:teuthology.orchestra.run.smithi050.stdout:132 trunc from 0xdb9d5fb to 0x32789ec 2024-09-05T17:30:49.813 INFO:teuthology.orchestra.run.smithi050.stdout:134 writesame 0x405c443 thru 0x4061397 data_size 0x1(0x4f55 bytes) 2024-09-05T17:30:49.813 INFO:teuthology.orchestra.run.smithi050.stdout:135 trunc from 0x4061398 to 0x4480dd8 2024-09-05T17:30:49.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:30:49.815 INFO:teuthology.orchestra.run.smithi050.stdout:136 trunc from 0x4480dd8 to 0x9800d49 2024-09-05T17:30:49.816 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:49.817+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:49.823 INFO:teuthology.orchestra.run.smithi050.stdout:137 write 0x8041aa3 thru 0x804d0c6 (0xb624 bytes) 2024-09-05T17:30:49.837 INFO:teuthology.orchestra.run.smithi050.stdout:139 read 0x989ca1 thru 0x99525c (0xb5bc bytes) 2024-09-05T17:30:49.838 INFO:teuthology.orchestra.run.smithi050.stdout:140 write 0x3b54871 thru 0x3b6265e (0xddee bytes) 2024-09-05T17:30:49.856 INFO:teuthology.orchestra.run.smithi050.stdout:141 write 0x8451d7a thru 0x8455698 (0x391f bytes) 2024-09-05T17:30:49.883 INFO:teuthology.orchestra.run.smithi050.stdout:142 writesame 0xd042a62 thru 0xd046f3e data_size 0x1(0x44dd bytes) 2024-09-05T17:30:49.883 INFO:teuthology.orchestra.run.smithi050.stdout:143 write 0xb03a1b0 thru 0xb04673e (0xc58f bytes) 2024-09-05T17:30:49.901 INFO:teuthology.orchestra.run.smithi050.stdout:145 read 0xaafc46e thru 0xab0a6ee (0xe281 bytes) 2024-09-05T17:30:49.901 INFO:teuthology.orchestra.run.smithi050.stdout:146 punch from 0x53b19c5 to 0x53c014a, (0xe785 bytes) 2024-09-05T17:30:49.901 INFO:teuthology.orchestra.run.smithi050.stdout:147 writesame 0x7ae5628 thru 0x7aeb0c3 data_size 0x6(0x5a9c bytes) 2024-09-05T17:30:49.911 INFO:teuthology.orchestra.run.smithi050.stdout:148 read 0x344ada thru 0x34bafc (0x7023 bytes) 2024-09-05T17:30:49.911 INFO:teuthology.orchestra.run.smithi050.stdout:149 read 0x4739884 thru 0x4742a13 (0x9190 bytes) 2024-09-05T17:30:49.911 INFO:teuthology.orchestra.run.smithi050.stdout:150 read 0x97c3ce thru 0x984998 (0x85cb bytes) 2024-09-05T17:30:49.912 INFO:teuthology.orchestra.run.smithi050.stdout:151 punch from 0x455da66 to 0x456672e, (0x8cc8 bytes) 2024-09-05T17:30:49.912 INFO:teuthology.orchestra.run.smithi050.stdout:152 punch from 0xc4436fd to 0xc452b0b, (0xf40e bytes) 2024-09-05T17:30:49.912 INFO:teuthology.orchestra.run.smithi050.stdout:153 writesame 0x107e8be thru 0x108de7a data_size 0x2b(0xf5bd bytes) 2024-09-05T17:30:49.916 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:49.921+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:49.930 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:49.930 INFO:teuthology.orchestra.run.smithi050.stdout:155 punch from 0x3a54cba to 0x3a6028d, (0xb5d3 bytes) 2024-09-05T17:30:49.932 INFO:teuthology.orchestra.run.smithi050.stdout:156 trunc from 0xd046f3f to 0xbf7f358 2024-09-05T17:30:49.940 INFO:teuthology.orchestra.run.smithi050.stdout:157 read 0x17a5f09 thru 0x17acb2c (0x6c24 bytes) 2024-09-05T17:30:49.940 INFO:teuthology.orchestra.run.smithi050.stdout:158 write 0x1eeaa17 thru 0x1ef9c7a (0xf264 bytes) 2024-09-05T17:30:49.958 INFO:teuthology.orchestra.run.smithi050.stdout:159 read 0x29d0b9d thru 0x29d1704 (0xb68 bytes) 2024-09-05T17:30:49.979 INFO:teuthology.orchestra.run.smithi050.stdout:162 trunc from 0xbf7f358 to 0x1b222e4 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:3241 3.f 3:f3eba154:::rbd_data.114070605229.0000000000000105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:50.004005+0000", 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0024108739999999999, 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002464731, 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.004 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 3241 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004005+0000", 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004005+0000", 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004007+0000", 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004013+0000", 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8699999999999997e-06 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004028+0000", 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5637e-05 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004037+0000", 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4270000000000008e-06 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004099+0000", 2024-09-05T17:30:50.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2272000000000003e-05 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004186+0000", 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6887999999999999e-05 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.004294+0000", 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107728 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.005315+0000", 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010215490000000001 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-05T17:30:50.009 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:50.016 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:50.021+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:50.022 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:30:50.023 INFO:teuthology.orchestra.run.smithi050.stdout:164 read 0xf41358 thru 0xf4bf63 (0xac0c bytes) 2024-09-05T17:30:50.051 INFO:teuthology.orchestra.run.smithi050.stdout:165 writesame 0xaa73df4 thru 0xaa79985 data_size 0x3(0x5b92 bytes) 2024-09-05T17:30:50.054 INFO:teuthology.orchestra.run.smithi050.stdout:166 trunc from 0xaa79986 to 0xc3db6e8 2024-09-05T17:30:50.063 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.063 INFO:teuthology.orchestra.run.smithi050.stdout:169 writesame 0x758422 thru 0x766c58 data_size 0x1(0xe837 bytes) 2024-09-05T17:30:50.093 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.094 INFO:teuthology.orchestra.run.smithi050.stdout:172 write 0xaff9abc thru 0xb008f16 (0xf45b bytes) 2024-09-05T17:30:50.114 INFO:teuthology.orchestra.run.smithi050.stdout:173 punch from 0x5e38aa to 0x5e402a, (0x780 bytes) 2024-09-05T17:30:50.115 INFO:teuthology.orchestra.run.smithi050.stdout:176 writesame 0x3fcec9d thru 0x3fddf16 data_size 0x29(0xf27a bytes) 2024-09-05T17:30:50.117 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:50.121+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:50.134 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.134 INFO:teuthology.orchestra.run.smithi050.stdout:178 writesame 0x9805750 thru 0x9811d9b data_size 0x62(0xc64c bytes) 2024-09-05T17:30:50.151 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:50.151 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:30:50.152 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:30:50.152 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:50.154 INFO:teuthology.orchestra.run.smithi050.stdout:179 write 0x6d603f7 thru 0x6d611bb (0xdc5 bytes) 2024-09-05T17:30:50.159 INFO:teuthology.orchestra.run.smithi050.stdout:181 write 0x1a7e9ca thru 0x1a81c3a (0x3271 bytes) 2024-09-05T17:30:50.168 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:30:50.189 INFO:teuthology.orchestra.run.smithi050.stdout:184 trunc from 0xc3db6e8 to 0x21838ab 2024-09-05T17:30:50.218 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:50.221+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:50.231 INFO:teuthology.orchestra.run.smithi050.stdout:185 write 0x58b90bd thru 0x58c7e25 (0xed69 bytes) 2024-09-05T17:30:50.247 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.247 INFO:teuthology.orchestra.run.smithi050.stdout:191 write 0x3940747 thru 0x3945e4e (0x5708 bytes) 2024-09-05T17:30:50.275 INFO:teuthology.orchestra.run.smithi050.stdout:192 trunc from 0x58c7e26 to 0x5aa2ab 2024-09-05T17:30:50.305 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:50.305 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:30:50.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:30:50.305 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:30:50.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.289719577, 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.306 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:30:50.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:30:50.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:30:50.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.844443545000001, 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014198443, 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 45 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:50.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462128+0000", 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.277e-06 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462140+0000", 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.189e-05 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462163+0000", 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2889000000000001e-05 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462182+0000", 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9193000000000001e-05 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.470719+0000", 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085367580000000002 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.470866+0000", 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000146706 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.471072+0000", 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020635099999999999 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.475968+0000", 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048962889999999998 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476144+0000", 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000175742 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476223+0000", 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8875999999999995e-05 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476326+0000", 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102472 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.844338819000001, 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016877395999999999, 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 46 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462233+0000", 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.356e-06 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462244+0000", 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0866999999999999e-05 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462271+0000", 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7399999999999999e-05 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462290+0000", 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8649000000000001e-05 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.472814+0000", 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010523963000000001 2024-09-05T17:30:50.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.473010+0000", 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000195525 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.473215+0000", 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020561099999999999 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476120+0000", 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029048619999999998 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478974+0000", 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002853487 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479048+0000", 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3949999999999995e-05 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479109+0000", 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1725999999999998e-05 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.844243287000001, 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017239246999999999, 2024-09-05T17:30:50.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 47 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462329+0000", 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7430000000000001e-06 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462484+0000", 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015445899999999999 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462503+0000", 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.942e-05 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462515+0000", 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2257e-05 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474087+0000", 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011572241 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474359+0000", 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000271267 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474735+0000", 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037594800000000003 2024-09-05T17:30:50.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479251+0000", 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004516351 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479442+0000", 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000190762 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479505+0000", 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3202999999999998e-05 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479567+0000", 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1595999999999998e-05 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.331 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.844033875000001, 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017251313000000001, 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 48 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462538+0000", 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462558+0000", 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9695999999999999e-05 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462573+0000", 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4873e-05 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462581+0000", 2024-09-05T17:30:50.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4700000000000002e-06 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476438+0000", 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013857236 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476683+0000", 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024466499999999998 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.477061+0000", 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037820699999999998 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479423+0000", 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023615749999999999 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479582+0000", 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000159383 2024-09-05T17:30:50.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479688+0000", 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000106019 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479788+0000", 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100042 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.843952058999999, 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019256863999999999, 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 49 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.338 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462620+0000", 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462629+0000", 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7099999999999996e-06 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462676+0000", 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7836000000000001e-05 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462686+0000", 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4630000000000007e-06 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.477921+0000", 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015235393 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478057+0000", 2024-09-05T17:30:50.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013605600000000001 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478323+0000", 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026547400000000003 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481738+0000", 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034152700000000002 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481757+0000", 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9423e-05 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481821+0000", 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3449999999999997e-05 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481875+0000", 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4589000000000002e-05 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.343 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.843858832999999, 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022237915, 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.344 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 50 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462713+0000", 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462785+0000", 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2476000000000002e-05 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462799+0000", 2024-09-05T17:30:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4153e-05 2024-09-05T17:30:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462808+0000", 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5799999999999992e-06 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479896+0000", 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017088398000000001 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.480128+0000", 2024-09-05T17:30:50.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023147200000000001 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.480501+0000", 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037334400000000001 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484611+0000", 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041101380000000002 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484754+0000", 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000142399 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484829+0000", 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5155999999999997e-05 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484950+0000", 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120939 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.843747228000002, 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022299985000000001, 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 51 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462824+0000", 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.47e-07 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462830+0000", 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4469999999999997e-06 2024-09-05T17:30:50.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462848+0000", 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8280000000000001e-05 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462860+0000", 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.243e-05 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482009+0000", 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019148515000000001 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482292+0000", 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000282835 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482679+0000", 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038745300000000001 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484734+0000", 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020550410000000001 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484963+0000", 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022876799999999999 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485036+0000", 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2819999999999997e-05 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485123+0000", 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7548999999999998e-05 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.357 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.843686494, 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022782574, 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 52 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462885+0000", 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1960000000000001e-06 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462896+0000", 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0319999999999999e-05 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462917+0000", 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.173e-05 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.463002+0000", 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4462999999999994e-05 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483583+0000", 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020581537 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483737+0000", 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153323 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483976+0000", 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023961100000000001 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485145+0000", 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011682579999999999 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485394+0000", 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024987400000000003 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485544+0000", 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000149123 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485667+0000", 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000123139 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.363 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373902912999998, 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012685699, 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.75e-07 2024-09-05T17:30:50.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932744+0000", 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5193999999999999e-05 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932756+0000", 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1911e-05 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932764+0000", 2024-09-05T17:30:50.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9080000000000001e-06 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934296+0000", 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001531267 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934357+0000", 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1545999999999997e-05 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934450+0000", 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2297000000000001e-05 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936128+0000", 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016780289999999999 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945240+0000", 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00911264 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945303+0000", 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2830000000000007e-05 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945353+0000", 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0402000000000003e-05 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373788047000001, 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012856464, 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 67 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6300000000000004e-07 2024-09-05T17:30:50.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932789+0000", 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2290000000000002e-06 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932799+0000", 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0492999999999999e-05 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932807+0000", 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9209999999999992e-06 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935086+0000", 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022789910000000002 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935139+0000", 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2639000000000002e-05 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935244+0000", 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105571 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940354+0000", 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051093309999999999 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945447+0000", 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050934109999999999 2024-09-05T17:30:50.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945565+0000", 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118239 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945639+0000", 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3776000000000007e-05 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373474586, 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012727738000000001, 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 68 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933097+0000", 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:30:50.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933107+0000", 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8810000000000008e-06 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933126+0000", 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9230999999999999e-05 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933138+0000", 2024-09-05T17:30:50.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1406999999999999e-05 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935553+0000", 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002415394 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935609+0000", 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6110999999999999e-05 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935735+0000", 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012551399999999999 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940369+0000", 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046339240000000002 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945709+0000", 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053400039999999998 2024-09-05T17:30:50.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945767+0000", 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8041999999999998e-05 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945824+0000", 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7098000000000001e-05 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373407107999999, 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012931031000000001, 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 69 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933224+0000", 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9184999999999997e-05 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933236+0000", 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2894999999999999e-05 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933265+0000", 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8138000000000001e-05 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936176+0000", 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029111269999999999 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936270+0000", 2024-09-05T17:30:50.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3851999999999995e-05 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936384+0000", 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011432199999999999 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940378+0000", 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039938029999999998 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945928+0000", 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055503269999999999 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946029+0000", 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010071199999999999 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946095+0000", 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5883000000000006e-05 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373274853000002, 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012945537999999999, 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 70 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933297+0000", 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7000000000000003e-07 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933304+0000", 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7449999999999995e-06 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933317+0000", 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2309e-05 2024-09-05T17:30:50.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933327+0000", 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9850000000000001e-06 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937198+0000", 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038713459999999999 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937342+0000", 2024-09-05T17:30:50.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014390900000000001 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220435 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942102+0000", 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045396179999999996 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946168+0000", 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040662809999999997 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946210+0000", 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1650999999999998e-05 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946241+0000", 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1389000000000001e-05 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373192894999999, 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013113009, 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4600000000000005e-07 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933383+0000", 2024-09-05T17:30:50.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.549e-06 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933389+0000", 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3110000000000002e-06 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933393+0000", 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2590000000000002e-06 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938234+0000", 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048408899999999996 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938317+0000", 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3096000000000005e-05 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938456+0000", 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013882599999999999 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942114+0000", 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036578190000000001 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946334+0000", 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042197770000000001 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946436+0000", 2024-09-05T17:30:50.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101822 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946491+0000", 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5114000000000001e-05 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:50.400 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373169013999998, 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01324849, 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5199999999999998e-07 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933461+0000", 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8884000000000001e-05 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933469+0000", 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6260000000000003e-06 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933473+0000", 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5070000000000002e-06 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938866+0000", 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053928539999999999 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.939015+0000", 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014948300000000001 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.939244+0000", 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022877100000000001 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943974+0000", 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047294399999999997 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946550+0000", 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0025768850000000001 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946589+0000", 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8050999999999999e-05 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946650+0000", 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1637000000000006e-05 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:50.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373086421, 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013379528, 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 73 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:50.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933485+0000", 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.82e-07 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933488+0000", 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1240000000000001e-06 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933493+0000", 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2070000000000003e-06 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933497+0000", 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8759999999999998e-06 2024-09-05T17:30:50.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940436+0000", 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069388760000000001 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940528+0000", 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2517999999999997e-05 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940675+0000", 2024-09-05T17:30:50.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014695600000000001 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943986+0000", 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033105019999999999 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946714+0000", 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027282220000000002 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946808+0000", 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4369000000000004e-05 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946864+0000", 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5396000000000003e-05 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.412 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373067129999999, 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013485855, 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4700000000000002e-07 2024-09-05T17:30:50.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933507+0000", 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7319999999999998e-06 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933511+0000", 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3599999999999998e-06 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933514+0000", 2024-09-05T17:30:50.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.36e-06 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941114+0000", 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0075993099999999997 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941245+0000", 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131669 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941471+0000", 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022618099999999999 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944147+0000", 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026750530000000002 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946920+0000", 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00277349 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946960+0000", 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9786999999999997e-05 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946989+0000", 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9566000000000001e-05 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.418 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.373049362, 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013694682999999999, 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933522+0000", 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5400000000000002e-07 2024-09-05T17:30:50.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933563+0000", 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1634000000000002e-05 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933571+0000", 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9109999999999993e-06 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933575+0000", 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.155e-06 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942168+0000", 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085926839999999997 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942247+0000", 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9221000000000006e-05 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942374+0000", 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012631799999999999 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944157+0000", 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017829969999999999 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947060+0000", 2024-09-05T17:30:50.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029038039999999998 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947162+0000", 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101346 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947216+0000", 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4258999999999997e-05 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.37298638, 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013750551999999999, 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:50.425 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 76 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933585+0000", 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933588+0000", 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.366e-06 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933592+0000", 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3290000000000004e-06 2024-09-05T17:30:50.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933596+0000", 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.41e-06 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943003+0000", 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094069459999999994 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:50.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943155+0000", 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015211900000000001 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943373+0000", 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021815800000000001 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944315+0000", 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00094195300000000004 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947265+0000", 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029501359999999999 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947306+0000", 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0479000000000003e-05 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947335+0000", 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9263000000000001e-05 2024-09-05T17:30:50.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.431 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.431 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.431 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:50.431 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:50.431 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:50.433 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:50.431+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:50.433 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:30:50.435 INFO:teuthology.orchestra.run.smithi050.stdout:194 writesame 0xe68e5c4 thru 0xe698270 data_size 0x1(0x9cad bytes) 2024-09-05T17:30:50.435 INFO:teuthology.orchestra.run.smithi050.stdout:195 read 0x219a2f thru 0x21a3ac (0x97e bytes) 2024-09-05T17:30:50.435 INFO:teuthology.orchestra.run.smithi050.stdout:197 punch from 0x3fc8a2e to 0x3fc8bda, (0x1ac bytes) 2024-09-05T17:30:50.435 INFO:teuthology.orchestra.run.smithi050.stdout:198 writesame 0x256008e thru 0x2562c09 data_size 0x2e(0x2b7c bytes) 2024-09-05T17:30:50.435 INFO:teuthology.orchestra.run.smithi050.stdout:200 read 0x9c080c3 thru 0x9c0ba4c (0x398a bytes) 2024-09-05T17:30:50.435 INFO:teuthology.orchestra.run.smithi050.stdout:201 punch from 0x60a7685 to 0x60afafe, (0x8479 bytes) 2024-09-05T17:30:50.435 INFO:teuthology.orchestra.run.smithi050.stdout:203 punch from 0xc0efa52 to 0xc0f0d01, (0x12af bytes) 2024-09-05T17:30:50.435 INFO:teuthology.orchestra.run.smithi050.stdout:205 write 0xc7e8dd0 thru 0xc7f8632 (0xf863 bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:206 read 0xbaed5a4 thru 0xbaf2a52 (0x54af bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:207 read 0xd0df96f thru 0xd0ea70a (0xad9c bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:208 write 0x90a5b38 thru 0x90ab2d1 (0x579a bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:210 read 0x7f182b4 thru 0x7f1ed20 (0x6a6d bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:213 punch from 0x7d200ef to 0x7d26ebb, (0x6dcc bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:215 read 0xe56c5b7 thru 0xe57bc29 (0xf673 bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:216 writesame 0xa8bf674 thru 0xa8c1cd5 data_size 0x11(0x2662 bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:217 read 0x740b245 thru 0x7413c98 (0x8a54 bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:218 read 0x28e9dee thru 0x28f3d86 (0x9f99 bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:222 punch from 0x2f643e7 to 0x2f71661, (0xd27a bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:223 punch from 0x2667385 to 0x266f406, (0x8081 bytes) 2024-09-05T17:30:50.436 INFO:teuthology.orchestra.run.smithi050.stdout:224 write 0x73b5aec thru 0x73c48bd (0xedd2 bytes) 2024-09-05T17:30:50.445 INFO:teuthology.orchestra.run.smithi050.stdout:225 write 0x20fb149 thru 0x2102849 (0x7701 bytes) 2024-09-05T17:30:50.466 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.466 INFO:teuthology.orchestra.run.smithi050.stdout:228 writesame 0xc4e4dff thru 0xc4eb485 data_size 0xd(0x6687 bytes) 2024-09-05T17:30:50.485 INFO:teuthology.orchestra.run.smithi050.stdout:230 read 0x2e785c7 thru 0x2e7b7d1 (0x320b bytes) 2024-09-05T17:30:50.485 INFO:teuthology.orchestra.run.smithi050.stdout:231 writesame 0x6f459e3 thru 0x6f4c69c data_size 0x3(0x6cba bytes) 2024-09-05T17:30:50.504 INFO:teuthology.orchestra.run.smithi050.stdout:232 write 0x6759689 thru 0x6764c6e (0xb5e6 bytes) 2024-09-05T17:30:50.523 INFO:teuthology.orchestra.run.smithi050.stdout:233 write 0x6438825 thru 0x64480db (0xf8b7 bytes) 2024-09-05T17:30:50.530 INFO:teuthology.orchestra.run.smithi050.stdout:235 writesame 0x8a0815 thru 0x8ad180 data_size 0x6(0xc96c bytes) 2024-09-05T17:30:50.533 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:50.531+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:50.540 INFO:teuthology.orchestra.run.smithi050.stdout:236 write 0xb3173b thru 0xb36a85 (0x534b bytes) 2024-09-05T17:30:50.553 INFO:teuthology.orchestra.run.smithi050.stdout:237 write 0x1e09b93 thru 0x1e0facd (0x5f3b bytes) 2024-09-05T17:30:50.567 INFO:teuthology.orchestra.run.smithi050.stdout:238 read 0x14a10c5 thru 0x14adec0 (0xcdfc bytes) 2024-09-05T17:30:50.567 INFO:teuthology.orchestra.run.smithi050.stdout:239 punch from 0xf73541 to 0xf79148, (0x5c07 bytes) 2024-09-05T17:30:50.567 INFO:teuthology.orchestra.run.smithi050.stdout:241 write 0x1b4508f thru 0x1b5221e (0xd190 bytes) 2024-09-05T17:30:50.574 INFO:teuthology.orchestra.run.smithi050.stdout:243 read 0x6d5fef8 thru 0x6d6a19f (0xa2a8 bytes) 2024-09-05T17:30:50.576 INFO:teuthology.orchestra.run.smithi050.stdout:244 read 0x7f3e1fa thru 0x7f4b672 (0xd479 bytes) 2024-09-05T17:30:50.576 INFO:teuthology.orchestra.run.smithi050.stdout:245 write 0x9f14b8a thru 0x9f1c418 (0x788f bytes) 2024-09-05T17:30:50.586 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:50.586 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:50.586 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:50.586 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:50.592 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.592 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.592 INFO:teuthology.orchestra.run.smithi050.stdout:249 write 0xa340de4 thru 0xa34e3c4 (0xd5e1 bytes) 2024-09-05T17:30:50.607 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:30:50.608 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.608 INFO:teuthology.orchestra.run.smithi050.stdout:251 write 0x8e4b2ab thru 0x8e4cf20 (0x1c76 bytes) 2024-09-05T17:30:50.622 INFO:teuthology.orchestra.run.smithi050.stdout:252 write 0xe878bc1 thru 0xe88114b (0x858b bytes) 2024-09-05T17:30:50.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:30:50.636 INFO:teuthology.orchestra.run.smithi050.stdout:255 write 0x3c0ea1b thru 0x3c0f0e6 (0x6cc bytes) 2024-09-05T17:30:50.636 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:50.641+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:50.641 INFO:teuthology.orchestra.run.smithi050.stdout:256 write 0x7fd2473 thru 0x7fddc3d (0xb7cb bytes) 2024-09-05T17:30:50.654 INFO:teuthology.orchestra.run.smithi050.stdout:257 write 0x875d099 thru 0x875d962 (0x8ca bytes) 2024-09-05T17:30:50.658 INFO:teuthology.orchestra.run.smithi050.stdout:258 write 0x5b3b22f thru 0x5b43e74 (0x8c46 bytes) 2024-09-05T17:30:50.673 INFO:teuthology.orchestra.run.smithi050.stdout:259 read 0x64692ff thru 0x646f6e0 (0x63e2 bytes) 2024-09-05T17:30:50.674 INFO:teuthology.orchestra.run.smithi050.stdout:261 punch from 0xc18eafc to 0xc194f70, (0x6474 bytes) 2024-09-05T17:30:50.674 INFO:teuthology.orchestra.run.smithi050.stdout:262 writesame 0x5bcf70f thru 0x5bd5ef6 data_size 0x64(0x67e8 bytes) 2024-09-05T17:30:50.679 INFO:teuthology.orchestra.run.smithi050.stdout:263 write 0xb73e52 thru 0xb79025 (0x51d4 bytes) 2024-09-05T17:30:50.686 INFO:teuthology.orchestra.run.smithi050.stdout:264 write 0x689408a thru 0x6895e98 (0x1e0f bytes) 2024-09-05T17:30:50.691 INFO:teuthology.orchestra.run.smithi050.stdout:265 read 0xc6d292c thru 0xc6df657 (0xcd2c bytes) 2024-09-05T17:30:50.696 INFO:teuthology.orchestra.run.smithi050.stdout:267 trunc from 0xe88114c to 0xbc17b59 2024-09-05T17:30:50.716 INFO:teuthology.orchestra.run.smithi050.stdout:268 write 0x6b095ab thru 0x6b184c4 (0xef1a bytes) 2024-09-05T17:30:50.726 INFO:teuthology.orchestra.run.smithi050.stdout:269 write 0x9dd361b thru 0x9dd9807 (0x61ed bytes) 2024-09-05T17:30:50.730 INFO:teuthology.orchestra.run.smithi050.stdout:271 read 0x767edbb thru 0x7684de7 (0x602d bytes) 2024-09-05T17:30:50.730 INFO:teuthology.orchestra.run.smithi050.stdout:272 writesame 0x50544f2 thru 0x506355f data_size 0x19(0xf06e bytes) 2024-09-05T17:30:50.735 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:50.737+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:50.742 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:50.743 INFO:teuthology.orchestra.run.smithi050.stdout:278 write 0xa441624 thru 0xa44e334 (0xcd11 bytes) 2024-09-05T17:30:50.754 INFO:teuthology.orchestra.run.smithi050.stdout:279 write 0xc0a508b thru 0xc0b0eec (0xbe62 bytes) 2024-09-05T17:30:50.760 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:50.760 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:50.760 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:30:50.760 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:30:50.760 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:50.767 INFO:teuthology.orchestra.run.smithi050.stdout:281 punch from 0x4911344 to 0x49144e2, (0x319e bytes) 2024-09-05T17:30:50.773 INFO:teuthology.orchestra.run.smithi050.stdout:282 trunc from 0xc0b0eed to 0x895b8f3 2024-09-05T17:30:50.783 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:30:50.800 INFO:teuthology.orchestra.run.smithi050.stdout:283 trunc from 0x895b8f3 to 0x76f4bb2 2024-09-05T17:30:50.828 INFO:teuthology.orchestra.run.smithi050.stdout:284 write 0xb68b07a thru 0xb68e16b (0x30f2 bytes) 2024-09-05T17:30:50.836 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:50.835+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:50.844 INFO:teuthology.orchestra.run.smithi050.stdout:285 writesame 0xc18a827 thru 0xc19a73a data_size 0x32(0xff14 bytes) 2024-09-05T17:30:50.844 INFO:teuthology.orchestra.run.smithi050.stdout:286 punch from 0x67efbf9 to 0x67f4d43, (0x514a bytes) 2024-09-05T17:30:50.845 INFO:teuthology.orchestra.run.smithi050.stdout:287 trunc from 0xc19a73b to 0xc5000a2 2024-09-05T17:30:50.851 INFO:teuthology.orchestra.run.smithi050.stdout:288 write 0x79b8815 thru 0x79c7511 (0xecfd bytes) 2024-09-05T17:30:50.865 INFO:teuthology.orchestra.run.smithi050.stdout:290 read 0x41b4629 thru 0x41ba294 (0x5c6c bytes) 2024-09-05T17:30:50.881 INFO:teuthology.orchestra.run.smithi050.stdout:291 trunc from 0xc5000a2 to 0x37c7ab4 2024-09-05T17:30:50.924 INFO:teuthology.orchestra.run.smithi050.stdout:292 punch from 0x33f3f24 to 0x33f931d, (0x53f9 bytes) 2024-09-05T17:30:50.924 INFO:teuthology.orchestra.run.smithi050.stdout:293 punch from 0x22a0311 to 0x22a5192, (0x4e81 bytes) 2024-09-05T17:30:50.938 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:50.935+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:50.938 INFO:teuthology.orchestra.run.smithi050.stdout:294 write 0x9664a08 thru 0x966f023 (0xa61c bytes) 2024-09-05T17:30:50.943 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:50.943 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:30:50.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:30:50.943 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:30:50.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.943 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-05T17:30:50.943 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.936833+0000", 2024-09-05T17:30:50.943 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.009722964000002, 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.009089349, 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936833+0000", 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936833+0000", 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936835+0000", 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9300000000000002e-06 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936847+0000", 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1533e-05 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936875+0000", 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8609999999999999e-05 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936892+0000", 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6526000000000001e-05 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.936979+0000", 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7171999999999998e-05 2024-09-05T17:30:50.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937011+0000", 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2393e-05 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945826+0000", 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0088144160000000003 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.945923+0000", 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6768999999999995e-05 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.008994040000001, 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010346731, 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.948 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937564+0000", 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0770000000000002e-06 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937719+0000", 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015435199999999999 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937753+0000", 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4629999999999999e-05 2024-09-05T17:30:50.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937771+0000", 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7544e-05 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937897+0000", 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012583900000000001 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937982+0000", 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4948000000000001e-05 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.947840+0000", 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098585610000000001 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.947909+0000", 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8780000000000002e-05 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.952 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.938263+0000", 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.008293058, 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0097423679999999995, 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938263+0000", 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938263+0000", 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938266+0000", 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5330000000000001e-06 2024-09-05T17:30:50.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938275+0000", 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3570000000000004e-06 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938294+0000", 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8632999999999999e-05 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938304+0000", 2024-09-05T17:30:50.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939348+0000", 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010431259999999999 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939399+0000", 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1702000000000001e-05 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.947916+0000", 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085169140000000004 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948006+0000", 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9419000000000006e-05 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.957 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.938751+0000", 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.007805128000001, 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0093610340000000007, 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938751+0000", 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938751+0000", 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938753+0000", 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.567e-06 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938762+0000", 2024-09-05T17:30:50.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.217e-06 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938779+0000", 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6926e-05 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.938791+0000", 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1727e-05 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940101+0000", 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001310383 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940156+0000", 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4968e-05 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948012+0000", 2024-09-05T17:30:50.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0078563869999999994 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948112+0000", 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9858999999999994e-05 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'41)", 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.939534+0000", 2024-09-05T17:30:50.962 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.007022719999998, 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0086702749999999999, 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939534+0000", 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939534+0000", 2024-09-05T17:30:50.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939536+0000", 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5359999999999999e-06 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939610+0000", 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4239999999999994e-05 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939635+0000", 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4652999999999999e-05 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.939650+0000", 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940863+0000", 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012129389999999999 2024-09-05T17:30:50.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940917+0000", 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3897000000000003e-05 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948119+0000", 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0072014180000000002 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948204+0000", 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5239000000000002e-05 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'41)", 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.940673+0000", 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.005883271999998, 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0076093970000000004, 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940673+0000", 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940673+0000", 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940675+0000", 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.934e-06 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940687+0000", 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1666e-05 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940714+0000", 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6999999999999999e-05 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.940727+0000", 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.323e-05 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942127+0000", 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001400168 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942182+0000", 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4857e-05 2024-09-05T17:30:50.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948210+0000", 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060284320000000002 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948282+0000", 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2109999999999999e-05 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'41)", 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.941563+0000", 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.004992854000001, 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0067969550000000004, 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941563+0000", 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941563+0000", 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941565+0000", 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9400000000000001e-06 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941577+0000", 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1419e-05 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941603+0000", 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5846999999999998e-05 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.941616+0000", 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3376e-05 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942917+0000", 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001301204 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942969+0000", 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1502999999999998e-05 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948289+0000", 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053202329999999997 2024-09-05T17:30:50.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948360+0000", 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1433000000000005e-05 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'41)", 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.942368+0000", 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.00418822, 2024-09-05T17:30:50.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00610342, 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942368+0000", 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942368+0000", 2024-09-05T17:30:50.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942370+0000", 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0229999999999999e-06 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942443+0000", 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3308999999999999e-05 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942468+0000", 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.44e-05 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.942481+0000", 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3443e-05 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943693+0000", 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012115030000000001 2024-09-05T17:30:50.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.943743+0000", 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0093999999999998e-05 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948369+0000", 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046260720000000002 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.948471+0000", 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102576 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:45.590757+0000", 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.3557988160000001, 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064825239999999999, 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 11 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590757+0000", 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590757+0000", 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590760+0000", 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9210000000000001e-06 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590775+0000", 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4375e-05 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590801+0000", 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5910000000000001e-05 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590814+0000", 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2891000000000001e-05 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590908+0000", 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4430000000000002e-05 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.590915+0000", 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3730000000000004e-06 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.594558+0000", 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003643121 2024-09-05T17:30:50.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.594760+0000", 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000201819 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.595184+0000", 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00042355300000000002 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:50.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.596655+0000", 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014709600000000001 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.597038+0000", 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038340800000000001 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.597158+0000", 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119499 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:45.597240+0000", 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2263999999999997e-05 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:2606 3.12 3:4b89a8fb:::rbd_data.114070605229.0000000000000054:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 438272~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:49.522394+0000", 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.4241618059999999, 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005105081, 2024-09-05T17:30:50.988 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 2606 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.522394+0000", 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.522394+0000", 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.522397+0000", 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5100000000000001e-06 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.522737+0000", 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000340508 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.522760+0000", 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2365999999999999e-05 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.522775+0000", 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4790000000000001e-05 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.522864+0000", 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9115000000000003e-05 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.523049+0000", 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018496100000000001 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.523426+0000", 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037726799999999999 2024-09-05T17:30:50.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.525902+0000", 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002475779 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.527430+0000", 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001527977 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.527469+0000", 2024-09-05T17:30:50.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9731999999999998e-05 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.527500+0000", 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0074999999999999e-05 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:2748 3.17 3:ea99cc06:::rbd_data.114070605229.000000000000014b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:49.643154+0000", 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.303402435, 2024-09-05T17:30:50.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005457061, 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 2748 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643154+0000", 2024-09-05T17:30:50.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643154+0000", 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643155+0000", 2024-09-05T17:30:50.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.78e-07 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643161+0000", 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.891e-06 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643176+0000", 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5067e-05 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643185+0000", 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9460000000000004e-06 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643247+0000", 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2193999999999994e-05 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643343+0000", 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6358000000000001e-05 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643457+0000", 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113971 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.644353+0000", 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00089576800000000002 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.648494+0000", 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041406719999999998 2024-09-05T17:30:50.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.648528+0000", 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3992000000000003e-05 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.648611+0000", 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3224000000000001e-05 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:2752 3.17 3:e87f9a91:::rbd_data.114070605229.0000000000000158:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:49.643766+0000", 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.302790348, 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049740770000000004, 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 2752 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643766+0000", 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643766+0000", 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643767+0000", 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1829999999999999e-06 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643775+0000", 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7009999999999996e-06 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643792+0000", 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6801000000000001e-05 2024-09-05T17:30:51.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643798+0000", 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3520000000000003e-06 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643849+0000", 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0636000000000001e-05 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643926+0000", 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7348000000000006e-05 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.644050+0000", 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124098 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.644653+0000", 2024-09-05T17:30:51.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00060338600000000003 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.648678+0000", 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0040244139999999996 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.648710+0000", 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2156000000000002e-05 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.648740+0000", 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0001999999999998e-05 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:2754 3.1f 3:fa901b21:::rbd_data.114070605229.000000000000015e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:49.643826+0000", 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.3027306269999999, 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0061071789999999999, 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.007 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 2754 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643826+0000", 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643826+0000", 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643826+0000", 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4199999999999995e-07 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643830+0000", 2024-09-05T17:30:51.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.411e-06 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643839+0000", 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643851+0000", 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1233000000000001e-05 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643899+0000", 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8421000000000003e-05 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.643984+0000", 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5408000000000006e-05 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.644090+0000", 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000105405 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.644919+0000", 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00082925200000000005 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.649813+0000", 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0048936889999999997 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.649888+0000", 2024-09-05T17:30:51.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5451000000000007e-05 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.649933+0000", 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4548000000000001e-05 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3243 3.17 3:ee85f957:::rbd_data.114070605229.000000000000010b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.007412+0000", 2024-09-05T17:30:51.013 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.93914462600000004, 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0062000800000000002, 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3243 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.007412+0000", 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.007412+0000", 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.007413+0000", 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5319999999999999e-06 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.007421+0000", 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6240000000000002e-06 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.007444+0000", 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3493999999999999e-05 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.007457+0000", 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3212e-05 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.007625+0000", 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016729200000000001 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.007826+0000", 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020129699999999999 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.008129+0000", 2024-09-05T17:30:51.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030275499999999998 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.009166+0000", 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010374780000000001 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.013431+0000", 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042649150000000002 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.013543+0000", 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111623 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.013612+0000", 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8857999999999997e-05 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3676 3.17 3:ee88d319:::rbd_data.114070605229.00000000000000c9:head [write 143360~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.019 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.530187+0000", 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.41636943700000001, 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051907639999999996, 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3676 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530187+0000", 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530187+0000", 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530189+0000", 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3499999999999999e-06 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530215+0000", 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5361e-05 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530242+0000", 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7917999999999999e-05 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530262+0000", 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9902e-05 2024-09-05T17:30:51.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530369+0000", 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106549 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530467+0000", 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7959000000000002e-05 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 5", 2024-09-05T17:30:51.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.530622+0000", 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015503399999999999 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.531477+0000", 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00085474200000000002 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.535270+0000", 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037935880000000001 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.535330+0000", 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9935999999999997e-05 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.535378+0000", 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7425000000000001e-05 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.025 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:4129 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.891326+0000", 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.055230089000000003, 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004898548, 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 4129 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891326+0000", 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891326+0000", 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891328+0000", 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.317e-06 2024-09-05T17:30:51.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891335+0000", 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3380000000000001e-06 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891353+0000", 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7710000000000002e-05 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891363+0000", 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0434e-05 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891447+0000", 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3722999999999998e-05 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891588+0000", 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141779 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891761+0000", 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017225899999999999 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.892687+0000", 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00092603499999999997 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.896076+0000", 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033890740000000002 2024-09-05T17:30:51.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.896162+0000", 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6130000000000004e-05 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.896225+0000", 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2749000000000005e-05 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.031 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:4130 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.891390+0000", 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.055165855, 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074800780000000002, 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.032 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 4130 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891390+0000", 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891390+0000", 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891391+0000", 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2099999999999997e-07 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891393+0000", 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4940000000000002e-06 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891400+0000", 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9550000000000003e-06 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.891407+0000", 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5379999999999999e-06 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.892153+0000", 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00074607700000000005 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.892257+0000", 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010404999999999999 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.892409+0000", 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015211099999999999 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.893099+0000", 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000690202 2024-09-05T17:30:51.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.898787+0000", 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056877710000000003 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.898838+0000", 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1133e-05 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.898870+0000", 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2225999999999999e-05 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:4133 3.12 3:4c9b9856:::rbd_data.114070605229.00000000000000b4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.895128+0000", 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.051428441999999998, 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049758379999999998, 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.038 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 4133 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895128+0000", 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895128+0000", 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895129+0000", 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3230000000000001e-06 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895135+0000", 2024-09-05T17:30:51.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6590000000000004e-06 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895151+0000", 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5872999999999999e-05 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895164+0000", 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3004e-05 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895242+0000", 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8832999999999996e-05 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895353+0000", 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111007 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.895460+0000", 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010681800000000001 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.896692+0000", 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012314909999999999 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.900001+0000", 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033090569999999998 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.900055+0000", 2024-09-05T17:30:51.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4552000000000002e-05 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.900104+0000", 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8220999999999998e-05 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:4170 3.1b 3:d887e684:::rbd_data.114070605229.00000000000000e3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.909918+0000", 2024-09-05T17:30:51.044 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.036637971999999998, 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068937870000000002, 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 4170 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.909918+0000", 2024-09-05T17:30:51.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.909918+0000", 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.909919+0000", 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.909929+0000", 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2939999999999994e-06 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.909942+0000", 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2986999999999999e-05 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.909951+0000", 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9770000000000006e-06 2024-09-05T17:30:51.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910016+0000", 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5757000000000001e-05 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910132+0000", 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115942 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:51.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910242+0000", 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109301 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.911580+0000", 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013382940000000001 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.916666+0000", 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005086269 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.916753+0000", 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6372999999999994e-05 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.916812+0000", 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9540000000000003e-05 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:4173 3.1b 3:df406739:::rbd_data.114070605229.00000000000000e6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.050 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.910462+0000", 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.036094361999999998, 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0065503879999999999, 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 4173 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910462+0000", 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910462+0000", 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910463+0000", 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:30:51.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910467+0000", 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6369999999999998e-06 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910480+0000", 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2686e-05 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910491+0000", 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0431999999999999e-05 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910549+0000", 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7958999999999999e-05 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910639+0000", 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0481000000000003e-05 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.910759+0000", 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011972 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.912218+0000", 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001458804 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.916876+0000", 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046579400000000002 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.916961+0000", 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5631999999999996e-05 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.917012+0000", 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1113999999999999e-05 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.056 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:51.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:30:51.059 INFO:teuthology.orchestra.run.smithi050.stdout:295 writesame 0xa3759e8 thru 0xa37cedb data_size 0x14(0x74f4 bytes) 2024-09-05T17:30:51.059 INFO:teuthology.orchestra.run.smithi050.stdout:296 read 0x54277fb thru 0x542db96 (0x639c bytes) 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:297 write 0x3db12ea thru 0x3db578a (0x44a1 bytes) 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:299 read 0x7e49eac thru 0x7e5963a (0xf78f bytes) 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:300 write 0xe2f28ef thru 0xe300527 (0xdc39 bytes) 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:303 write 0x8ac65b5 thru 0x8ac75f6 (0x1042 bytes) 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:306 trunc from 0xe300528 to 0xd702f63 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:307 trunc from 0xd702f63 to 0xce864af 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:308 write 0xbc1db04 thru 0xbc1e2f9 (0x7f6 bytes) 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:310 writesame 0x1f659ed thru 0x1f71815 data_size 0x1b(0xbe29 bytes) 2024-09-05T17:30:51.060 INFO:teuthology.orchestra.run.smithi050.stdout:311 write 0xaaa922d thru 0xaab32b1 (0xa085 bytes) 2024-09-05T17:30:51.061 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:51.061+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:51.065 INFO:teuthology.orchestra.run.smithi050.stdout:312 read 0x65b4794 thru 0x65bd470 (0x8cdd bytes) 2024-09-05T17:30:51.065 INFO:teuthology.orchestra.run.smithi050.stdout:313 punch from 0x81cf49a to 0x81dd4cc, (0xe032 bytes) 2024-09-05T17:30:51.065 INFO:teuthology.orchestra.run.smithi050.stdout:314 writesame 0x717e6f6 thru 0x7189a74 data_size 0x35(0xb37f bytes) 2024-09-05T17:30:51.080 INFO:teuthology.orchestra.run.smithi050.stdout:315 writesame 0xcc70fa5 thru 0xcc78c6d data_size 0x1(0x7cc9 bytes) 2024-09-05T17:30:51.081 INFO:teuthology.orchestra.run.smithi050.stdout:316 punch from 0x71c33ba to 0x71c8438, (0x507e bytes) 2024-09-05T17:30:51.081 INFO:teuthology.orchestra.run.smithi050.stdout:317 read 0x4e11f95 thru 0x4e16fc9 (0x5035 bytes) 2024-09-05T17:30:51.091 INFO:teuthology.orchestra.run.smithi050.stdout:318 write 0xe6cf154 thru 0xe6d5651 (0x64fe bytes) 2024-09-05T17:30:51.105 INFO:teuthology.orchestra.run.smithi050.stdout:321 read 0x534871c thru 0x53526b3 (0x9f98 bytes) 2024-09-05T17:30:51.105 INFO:teuthology.orchestra.run.smithi050.stdout:323 read 0x8383be0 thru 0x838f497 (0xb8b8 bytes) 2024-09-05T17:30:51.106 INFO:teuthology.orchestra.run.smithi050.stdout:324 write 0x9e4a63e thru 0x9e4abaf (0x572 bytes) 2024-09-05T17:30:51.110 INFO:teuthology.orchestra.run.smithi050.stdout:325 writesame 0x8b1512d thru 0x8b1f819 data_size 0x1(0xa6ed bytes) 2024-09-05T17:30:51.131 INFO:teuthology.orchestra.run.smithi050.stdout:326 punch from 0x2695923 to 0x269a532, (0x4c0f bytes) 2024-09-05T17:30:51.132 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.132 INFO:teuthology.orchestra.run.smithi050.stdout:328 writesame 0x28f9a7d thru 0x28fcf97 data_size 0x1(0x351b bytes) 2024-09-05T17:30:51.143 INFO:teuthology.orchestra.run.smithi050.stdout:329 read 0x97a4a6f thru 0x97a50f6 (0x688 bytes) 2024-09-05T17:30:51.143 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.143 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.143 INFO:teuthology.orchestra.run.smithi050.stdout:332 write 0x21f6584 thru 0x2205a7e (0xf4fb bytes) 2024-09-05T17:30:51.151 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.151 INFO:teuthology.orchestra.run.smithi050.stdout:334 read 0xcd11b65 thru 0xcd201e4 (0xe680 bytes) 2024-09-05T17:30:51.151 INFO:teuthology.orchestra.run.smithi050.stdout:335 read 0x329f89a thru 0x32a7759 (0x7ec0 bytes) 2024-09-05T17:30:51.152 INFO:teuthology.orchestra.run.smithi050.stdout:336 writesame 0x2befa7a thru 0x2bf71dc data_size 0x1(0x7763 bytes) 2024-09-05T17:30:51.159 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:51.161+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:51.168 INFO:teuthology.orchestra.run.smithi050.stdout:337 read 0x8ea2afd thru 0x8eae216 (0xb71a bytes) 2024-09-05T17:30:51.168 INFO:teuthology.orchestra.run.smithi050.stdout:340 writesame 0x2160db6 thru 0x21655c7 data_size 0x4b(0x4812 bytes) 2024-09-05T17:30:51.172 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.172 INFO:teuthology.orchestra.run.smithi050.stdout:342 punch from 0x21204a2 to 0x21265a2, (0x6100 bytes) 2024-09-05T17:30:51.187 INFO:teuthology.orchestra.run.smithi050.stdout:343 trunc from 0xe6d5652 to 0x559aca5 2024-09-05T17:30:51.207 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:51.207 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:51.207 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:51.207 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:51.219 INFO:teuthology.orchestra.run.smithi050.stdout:344 read 0x30f3b1 thru 0x3192e2 (0x9f32 bytes) 2024-09-05T17:30:51.219 INFO:teuthology.orchestra.run.smithi050.stdout:345 read 0x3d7fa68 thru 0x3d86ec8 (0x7461 bytes) 2024-09-05T17:30:51.220 INFO:teuthology.orchestra.run.smithi050.stdout:346 read 0x14fb748 thru 0x14fe579 (0x2e32 bytes) 2024-09-05T17:30:51.220 INFO:teuthology.orchestra.run.smithi050.stdout:348 punch from 0x1971649 to 0x19792df, (0x7c96 bytes) 2024-09-05T17:30:51.220 INFO:teuthology.orchestra.run.smithi050.stdout:349 read 0x52e5eda thru 0x52e7024 (0x114b bytes) 2024-09-05T17:30:51.220 INFO:teuthology.orchestra.run.smithi050.stdout:350 read 0x4d338f1 thru 0x4d3d205 (0x9915 bytes) 2024-09-05T17:30:51.220 INFO:teuthology.orchestra.run.smithi050.stdout:351 writesame 0x2916228 thru 0x29182b8 data_size 0x7(0x2091 bytes) 2024-09-05T17:30:51.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:30:51.224 INFO:teuthology.orchestra.run.smithi050.stdout:352 trunc from 0x559aca5 to 0x5853534 2024-09-05T17:30:51.231 INFO:teuthology.orchestra.run.smithi050.stdout:353 read 0x3656e12 thru 0x36644a5 (0xd694 bytes) 2024-09-05T17:30:51.241 INFO:teuthology.orchestra.run.smithi050.stdout:355 trunc from 0x5853534 to 0xcc52f23 2024-09-05T17:30:51.251 INFO:teuthology.orchestra.run.smithi050.stdout:356 trunc from 0xcc52f23 to 0xb908b5c 2024-09-05T17:30:51.260 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:51.259+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:51.260 INFO:teuthology.orchestra.run.smithi050.stdout:357 trunc from 0xb908b5c to 0xb2ee525 2024-09-05T17:30:51.268 INFO:teuthology.orchestra.run.smithi050.stdout:358 write 0x5e73ee2 thru 0x5e7c823 (0x8942 bytes) 2024-09-05T17:30:51.288 INFO:teuthology.orchestra.run.smithi050.stdout:359 writesame 0x9a86129 thru 0x9a91543 data_size 0x6d(0xb41b bytes) 2024-09-05T17:30:51.305 INFO:teuthology.orchestra.run.smithi050.stdout:360 write 0x8b440d8 thru 0x8b51d40 (0xdc69 bytes) 2024-09-05T17:30:51.323 INFO:teuthology.orchestra.run.smithi050.stdout:361 writesame 0x79ac724 thru 0x79b7f0f data_size 0x4f(0xb7ec bytes) 2024-09-05T17:30:51.337 INFO:teuthology.orchestra.run.smithi050.stdout:362 punch from 0x4fee543 to 0x4ff6837, (0x82f4 bytes) 2024-09-05T17:30:51.337 INFO:teuthology.orchestra.run.smithi050.stdout:364 read 0xa4d35da thru 0xa4dbfc5 (0x89ec bytes) 2024-09-05T17:30:51.337 INFO:teuthology.orchestra.run.smithi050.stdout:365 read 0x8331abf thru 0x833f91b (0xde5d bytes) 2024-09-05T17:30:51.337 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.346 INFO:teuthology.orchestra.run.smithi050.stdout:368 trunc from 0xb2ee525 to 0x527b04d 2024-09-05T17:30:51.360 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:51.365+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:51.376 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:51.376 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:51.376 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:30:51.376 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:30:51.376 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:51.390 INFO:teuthology.orchestra.run.smithi050.stdout:369 write 0xc1f32f8 thru 0xc1f8378 (0x5081 bytes) 2024-09-05T17:30:51.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:30:51.403 INFO:teuthology.orchestra.run.smithi050.stdout:370 read 0x39f02a1 thru 0x39f7bb1 (0x7911 bytes) 2024-09-05T17:30:51.403 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.406 INFO:teuthology.orchestra.run.smithi050.stdout:372 trunc from 0xc1f8379 to 0xeaebeb8 2024-09-05T17:30:51.414 INFO:teuthology.orchestra.run.smithi050.stdout:374 read 0x8b94c29 thru 0x8ba4903 (0xfcdb bytes) 2024-09-05T17:30:51.414 INFO:teuthology.orchestra.run.smithi050.stdout:377 writesame 0x18b0650 thru 0x18b2240 data_size 0x1(0x1bf1 bytes) 2024-09-05T17:30:51.425 INFO:teuthology.orchestra.run.smithi050.stdout:378 write 0xa7c0647 thru 0xa7c07f0 (0x1aa bytes) 2024-09-05T17:30:51.438 INFO:teuthology.orchestra.run.smithi050.stdout:379 trunc from 0xeaebeb8 to 0x94d02ef 2024-09-05T17:30:51.457 INFO:teuthology.orchestra.run.smithi050.stdout:383 read 0x37bd456 thru 0x37bf3eb (0x1f96 bytes) 2024-09-05T17:30:51.457 INFO:teuthology.orchestra.run.smithi050.stdout:386 write 0x27e3d01 thru 0x27e98a1 (0x5ba1 bytes) 2024-09-05T17:30:51.461 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:51.465+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:51.469 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:388 read 0x14a3b8c thru 0x14b1e08 (0xe27d bytes) 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:389 punch from 0x5472a38 to 0x5478d39, (0x6301 bytes) 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:393 punch from 0x88cd37e to 0x88d6969, (0x95eb bytes) 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:395 punch from 0x8ea6ad4 to 0x8eb01f3, (0x971f bytes) 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:396 read 0x46b2fe0 thru 0x46be489 (0xb4aa bytes) 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:398 read 0x7df2b61 thru 0x7dffc78 (0xd118 bytes) 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:402 read 0x6fac190 thru 0x6fb9da7 (0xdc18 bytes) 2024-09-05T17:30:51.470 INFO:teuthology.orchestra.run.smithi050.stdout:403 writesame 0x9ce41b thru 0x9d84cd data_size 0x15(0xa0b3 bytes) 2024-09-05T17:30:51.482 INFO:teuthology.orchestra.run.smithi050.stdout:404 writesame 0x96dbacf thru 0x96dd29b data_size 0x3(0x17cd bytes) 2024-09-05T17:30:51.482 INFO:teuthology.orchestra.run.smithi050.stdout:406 punch from 0x8b42da9 to 0x8b4b6e6, (0x893d bytes) 2024-09-05T17:30:51.482 INFO:teuthology.orchestra.run.smithi050.stdout:408 punch from 0x69d331a to 0x69e32d1, (0xffb7 bytes) 2024-09-05T17:30:51.496 INFO:teuthology.orchestra.run.smithi050.stdout:409 trunc from 0x96dd29c to 0x978f1d 2024-09-05T17:30:51.500 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:30:51.537 INFO:teuthology.orchestra.run.smithi050.stdout:410 read 0x8a54d8 thru 0x8b1512 (0xc03b bytes) 2024-09-05T17:30:51.552 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:51.553 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:30:51.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:30:51.553 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:30:51.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.554 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:2611 3.0 3:0220b7dc:::rbd_data.114070605229.0000000000000058:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 438272~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.554 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:49.538018+0000", 2024-09-05T17:30:51.554 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.0180161289999998, 2024-09-05T17:30:51.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030167890000000002, 2024-09-05T17:30:51.554 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.554 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.555 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.555 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.555 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.555 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.555 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 2611 2024-09-05T17:30:51.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.556 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538018+0000", 2024-09-05T17:30:51.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538018+0000", 2024-09-05T17:30:51.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538020+0000", 2024-09-05T17:30:51.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9249999999999999e-06 2024-09-05T17:30:51.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538343+0000", 2024-09-05T17:30:51.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000322584 2024-09-05T17:30:51.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538364+0000", 2024-09-05T17:30:51.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1443000000000001e-05 2024-09-05T17:30:51.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538375+0000", 2024-09-05T17:30:51.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0747000000000001e-05 2024-09-05T17:30:51.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538450+0000", 2024-09-05T17:30:51.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4438999999999997e-05 2024-09-05T17:30:51.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538628+0000", 2024-09-05T17:30:51.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017884199999999999 2024-09-05T17:30:51.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.538978+0000", 2024-09-05T17:30:51.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034906899999999997 2024-09-05T17:30:51.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.540577+0000", 2024-09-05T17:30:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001599025 2024-09-05T17:30:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.540965+0000", 2024-09-05T17:30:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038883400000000001 2024-09-05T17:30:51.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.541004+0000", 2024-09-05T17:30:51.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8520999999999999e-05 2024-09-05T17:30:51.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.541034+0000", 2024-09-05T17:30:51.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0360000000000001e-05 2024-09-05T17:30:51.566 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.566 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.566 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.567 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3191 3.0 3:00082787:::rbd_data.114070605229.0000000000000048:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.567 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:49.989697+0000", 2024-09-05T17:30:51.567 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.566336561, 2024-09-05T17:30:51.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029464059999999999, 2024-09-05T17:30:51.568 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.569 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3191 2024-09-05T17:30:51.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.569 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.989697+0000", 2024-09-05T17:30:51.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.989697+0000", 2024-09-05T17:30:51.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.989701+0000", 2024-09-05T17:30:51.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6040000000000001e-06 2024-09-05T17:30:51.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.989712+0000", 2024-09-05T17:30:51.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1436e-05 2024-09-05T17:30:51.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.989744+0000", 2024-09-05T17:30:51.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1406999999999999e-05 2024-09-05T17:30:51.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.989757+0000", 2024-09-05T17:30:51.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3711e-05 2024-09-05T17:30:51.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.989908+0000", 2024-09-05T17:30:51.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000150521 2024-09-05T17:30:51.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.990171+0000", 2024-09-05T17:30:51.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026276499999999998 2024-09-05T17:30:51.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.990501+0000", 2024-09-05T17:30:51.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033038799999999998 2024-09-05T17:30:51.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.992153+0000", 2024-09-05T17:30:51.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001652033 2024-09-05T17:30:51.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.992412+0000", 2024-09-05T17:30:51.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025887499999999999 2024-09-05T17:30:51.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.992553+0000", 2024-09-05T17:30:51.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014082100000000001 2024-09-05T17:30:51.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.992643+0000", 2024-09-05T17:30:51.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0845000000000002e-05 2024-09-05T17:30:51.579 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.579 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.579 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.580 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3211 3.19 3:9f7aa934:::rbd_data.114070605229.0000000000000067:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.580 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:49.995209+0000", 2024-09-05T17:30:51.580 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.5608247039999998, 2024-09-05T17:30:51.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035325080000000002, 2024-09-05T17:30:51.580 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.581 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.582 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3211 2024-09-05T17:30:51.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.582 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995209+0000", 2024-09-05T17:30:51.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995209+0000", 2024-09-05T17:30:51.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995211+0000", 2024-09-05T17:30:51.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9439999999999999e-06 2024-09-05T17:30:51.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.586 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.586 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995220+0000", 2024-09-05T17:30:51.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8710000000000003e-06 2024-09-05T17:30:51.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995247+0000", 2024-09-05T17:30:51.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7603999999999999e-05 2024-09-05T17:30:51.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995263+0000", 2024-09-05T17:30:51.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5182e-05 2024-09-05T17:30:51.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995366+0000", 2024-09-05T17:30:51.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010337500000000001 2024-09-05T17:30:51.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995468+0000", 2024-09-05T17:30:51.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000102261 2024-09-05T17:30:51.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.995597+0000", 2024-09-05T17:30:51.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012914299999999999 2024-09-05T17:30:51.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.996853+0000", 2024-09-05T17:30:51.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012554370000000001 2024-09-05T17:30:51.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.998611+0000", 2024-09-05T17:30:51.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017583099999999999 2024-09-05T17:30:51.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.998686+0000", 2024-09-05T17:30:51.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5415999999999998e-05 2024-09-05T17:30:51.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.998741+0000", 2024-09-05T17:30:51.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4965e-05 2024-09-05T17:30:51.596 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.596 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.596 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.596 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3218 3.0 3:04f3a5f1:::rbd_data.114070605229.0000000000000077:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.597 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:49.997166+0000", 2024-09-05T17:30:51.597 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.558867236, 2024-09-05T17:30:51.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035757860000000001, 2024-09-05T17:30:51.597 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.597 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.597 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.598 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.598 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3218 2024-09-05T17:30:51.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.598 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.997166+0000", 2024-09-05T17:30:51.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.997166+0000", 2024-09-05T17:30:51.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.997168+0000", 2024-09-05T17:30:51.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8840000000000001e-06 2024-09-05T17:30:51.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.997177+0000", 2024-09-05T17:30:51.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2970000000000004e-06 2024-09-05T17:30:51.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.997204+0000", 2024-09-05T17:30:51.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7101999999999999e-05 2024-09-05T17:30:51.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.997218+0000", 2024-09-05T17:30:51.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4262e-05 2024-09-05T17:30:51.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.997813+0000", 2024-09-05T17:30:51.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059510800000000001 2024-09-05T17:30:51.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.997997+0000", 2024-09-05T17:30:51.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018345500000000001 2024-09-05T17:30:51.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.998208+0000", 2024-09-05T17:30:51.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021101 2024-09-05T17:30:51.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:49.999475+0000", 2024-09-05T17:30:51.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001267659 2024-09-05T17:30:51.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000568+0000", 2024-09-05T17:30:51.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010925869999999999 2024-09-05T17:30:51.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000667+0000", 2024-09-05T17:30:51.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9361e-05 2024-09-05T17:30:51.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000742+0000", 2024-09-05T17:30:51.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5061000000000005e-05 2024-09-05T17:30:51.612 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.612 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.612 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.613 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3225 3.4 3:26174b4e:::rbd_data.114070605229.00000000000000f3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.613 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.000343+0000", 2024-09-05T17:30:51.613 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.555690714, 2024-09-05T17:30:51.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003481961, 2024-09-05T17:30:51.613 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.613 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.613 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.614 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.614 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.614 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.614 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3225 2024-09-05T17:30:51.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.614 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000343+0000", 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000343+0000", 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000344+0000", 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3039999999999999e-06 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000350+0000", 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.66e-06 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000365+0000", 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.518e-05 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000376+0000", 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0891e-05 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000496+0000", 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120052 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000674+0000", 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017797000000000001 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.000884+0000", 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000209982 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.002929+0000", 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020447680000000002 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.003576+0000", 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00064752199999999998 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.003709+0000", 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013261600000000001 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.003825+0000", 2024-09-05T17:30:51.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116016 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3228 3.0 3:0102981f:::rbd_data.114070605229.00000000000000f6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.001047+0000", 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.5549867509999999, 2024-09-05T17:30:51.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036652299999999998, 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3228 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001047+0000", 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001047+0000", 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001048+0000", 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.452e-06 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001055+0000", 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5810000000000002e-06 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001109+0000", 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.448e-05 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001122+0000", 2024-09-05T17:30:51.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2904e-05 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001221+0000", 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9121000000000002e-05 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001382+0000", 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016055299999999999 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.001741+0000", 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035905900000000001 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.003090+0000", 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013493699999999999 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.004604+0000", 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001513281 2024-09-05T17:30:51.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.004672+0000", 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7891000000000004e-05 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.004712+0000", 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0537999999999997e-05 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3237 3.4 3:27431f8f:::rbd_data.114070605229.0000000000000101:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.005320+0000", 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.550713268, 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037291910000000002, 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.627 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3237 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005320+0000", 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005320+0000", 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005323+0000", 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3980000000000002e-06 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005331+0000", 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0260000000000007e-06 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005353+0000", 2024-09-05T17:30:51.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2650000000000002e-05 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005369+0000", 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6008e-05 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005461+0000", 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1940000000000004e-05 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005565+0000", 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000103853 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.005650+0000", 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5169999999999999e-05 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.006301+0000", 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00065016800000000001 2024-09-05T17:30:51.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.008783+0000", 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024822300000000002 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.008911+0000", 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000128608 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.009050+0000", 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013814 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3334 3.19 3:9cab4cb4:::rbd_data.114070605229.0000000000000162:head [set-alloc-hint object_size 524288 write_size 524288,write 57344~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.112682+0000", 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.443351608, 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029112040000000001, 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3334 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.112682+0000", 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.112682+0000", 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.112685+0000", 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6570000000000001e-06 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.112701+0000", 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6140000000000001e-05 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.112723+0000", 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2543000000000001e-05 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.112737+0000", 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3488e-05 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.112876+0000", 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013870700000000001 2024-09-05T17:30:51.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.113075+0000", 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000199798 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.113445+0000", 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036965400000000002 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.115035+0000", 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015902990000000001 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.115475+0000", 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044015299999999999 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.115553+0000", 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7380999999999997e-05 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.115593+0000", 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0383999999999998e-05 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3373 3.19 3:9c62dacc:::rbd_data.114070605229.000000000000012f:head [set-alloc-hint object_size 524288 write_size 524288,write 409600~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.157051+0000", 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.398982379, 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032124319999999999, 2024-09-05T17:30:51.639 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3373 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157051+0000", 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157051+0000", 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157054+0000", 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9550000000000001e-06 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157075+0000", 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0588999999999999e-05 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157112+0000", 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7144999999999998e-05 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157136+0000", 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4227999999999999e-05 2024-09-05T17:30:51.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157260+0000", 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000124256 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157520+0000", 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025936500000000001 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.157808+0000", 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028792800000000001 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.159148+0000", 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013400619999999999 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.160100+0000", 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00095201300000000003 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.160196+0000", 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6501000000000003e-05 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.160264+0000", 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7390000000000004e-05 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3406 3.19 3:9c62dacc:::rbd_data.114070605229.000000000000012f:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.204723+0000", 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.3513111389999999, 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003501597, 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3406 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.204723+0000", 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.204723+0000", 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.204725+0000", 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.728e-06 2024-09-05T17:30:51.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.204738+0000", 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2772000000000001e-05 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.204765+0000", 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7095999999999999e-05 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.204780+0000", 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5064e-05 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.204901+0000", 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120678 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.205059+0000", 2024-09-05T17:30:51.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015860099999999999 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.205263+0000", 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000203074 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.207220+0000", 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019570759999999999 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.207977+0000", 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00075740300000000003 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.208087+0000", 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109566 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.208224+0000", 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000137539 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.651 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3454 3.19 3:9c000400:::rbd_data.114070605229.00000000000000b3:head [set-alloc-hint object_size 524288 write_size 524288,write 372736~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.251125+0000", 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.3049090800000001, 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030037639999999999, 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.652 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3454 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251125+0000", 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251125+0000", 2024-09-05T17:30:51.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251127+0000", 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3350000000000001e-06 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251145+0000", 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7625000000000002e-05 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251171+0000", 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6874999999999999e-05 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251189+0000", 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7643999999999999e-05 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251307+0000", 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000117491 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251520+0000", 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021306499999999999 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.251746+0000", 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022650400000000001 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.253267+0000", 2024-09-05T17:30:51.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015208590000000001 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.254039+0000", 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000771655 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.254089+0000", 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0343999999999998e-05 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.254128+0000", 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9366999999999998e-05 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3487 3.0 3:035493a3:::rbd_data.114070605229.000000000000002b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.290631+0000", 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.2654022460000001, 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003452105, 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.658 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3487 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.290631+0000", 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.290631+0000", 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.290633+0000", 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.996e-06 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.290643+0000", 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2399999999999996e-06 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.290666+0000", 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3408e-05 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.290682+0000", 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5678000000000001e-05 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.290838+0000", 2024-09-05T17:30:51.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000156081 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.291048+0000", 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021000500000000001 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.291330+0000", 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028213499999999998 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.293292+0000", 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019618169999999998 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.293923+0000", 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00063121900000000003 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.294001+0000", 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7781000000000006e-05 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.294084+0000", 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2744999999999995e-05 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3580 3.0 3:05c6ea6d:::rbd_data.114070605229.0000000000000126:head [set-alloc-hint object_size 524288 write_size 524288,write 73728~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.412340+0000", 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.1436931450000001, 2024-09-05T17:30:51.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032281139999999998, 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3580 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.412340+0000", 2024-09-05T17:30:51.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.412340+0000", 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.412344+0000", 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3799999999999998e-06 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.412365+0000", 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1413999999999999e-05 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.412405+0000", 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0130999999999999e-05 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.412428+0000", 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2597000000000001e-05 2024-09-05T17:30:51.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.412569+0000", 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014050600000000001 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.412851+0000", 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000282322 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.413163+0000", 2024-09-05T17:30:51.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031219199999999998 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.414598+0000", 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014346389999999999 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.415408+0000", 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00080984099999999995 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.415481+0000", 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3316000000000001e-05 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.415569+0000", 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7775999999999994e-05 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3586 3.19 3:9ce1c5aa:::rbd_data.114070605229.000000000000014d:head [set-alloc-hint object_size 524288 write_size 524288,write 262144~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.670 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.423738+0000", 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.132295386, 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002883207, 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3586 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.423738+0000", 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.423738+0000", 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.423740+0000", 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.858e-06 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.423756+0000", 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6032000000000002e-05 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.423786+0000", 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9771999999999999e-05 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.423802+0000", 2024-09-05T17:30:51.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6246e-05 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.423980+0000", 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017819799999999999 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.424352+0000", 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037167100000000001 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.424657+0000", 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.425895+0000", 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001238306 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.426410+0000", 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051481499999999996 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.426501+0000", 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1133999999999999e-05 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.426621+0000", 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012020500000000001 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3604 3.4 3:27555207:::rbd_data.114070605229.00000000000000e7:head [set-alloc-hint object_size 524288 write_size 524288,write 372736~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.447383+0000", 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.1086505200000001, 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042431509999999997, 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3604 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.677 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447383+0000", 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447383+0000", 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447387+0000", 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.411e-06 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447409+0000", 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2776999999999999e-05 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447440+0000", 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1097999999999999e-05 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447456+0000", 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5982e-05 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447601+0000", 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014445899999999999 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447885+0000", 2024-09-05T17:30:51.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00028406900000000002 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448101+0000", 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021622000000000001 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.450740+0000", 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026390250000000001 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451449+0000", 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00070894100000000004 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451554+0000", 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010522900000000001 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451626+0000", 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1940000000000006e-05 2024-09-05T17:30:51.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3605 3.19 3:9a6fcd4c:::rbd_data.114070605229.00000000000000e8:head [set-alloc-hint object_size 524288 write_size 524288,write 372736~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.447495+0000", 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.108538977, 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0043822289999999996, 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3605 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447495+0000", 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447495+0000", 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447496+0000", 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7000000000000003e-07 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447516+0000", 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0653999999999999e-05 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447529+0000", 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3162e-05 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447539+0000", 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4069999999999999e-06 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447657+0000", 2024-09-05T17:30:51.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118521 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.447870+0000", 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021284599999999999 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448085+0000", 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00021479600000000001 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.450799+0000", 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027139629999999998 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451593+0000", 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00079460000000000002 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451753+0000", 2024-09-05T17:30:51.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015915100000000001 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451877+0000", 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012425899999999999 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:3769 3.19 3:9d2b06c6:::rbd_data.114070605229.000000000000014a:head [set-alloc-hint object_size 524288 write_size 524288,write 143360~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.610263+0000", 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.94577112799999996, 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032671610000000002, 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 3769 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610263+0000", 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610263+0000", 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610265+0000", 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9730000000000002e-06 2024-09-05T17:30:51.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610280+0000", 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4881e-05 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610307+0000", 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7047e-05 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610321+0000", 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4028e-05 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610409+0000", 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7953000000000003e-05 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610523+0000", 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113189 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.610730+0000", 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020756299999999999 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.611937+0000", 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001207241 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.613389+0000", 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001451604 2024-09-05T17:30:51.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.613471+0000", 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1590999999999999e-05 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.613530+0000", 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9091000000000001e-05 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:4423 3.0 3:0220b7dc:::rbd_data.114070605229.0000000000000058:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:51.158796+0000", 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.39723735799999998, 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003825892, 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 4423 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.696 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.158796+0000", 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.158796+0000", 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.158799+0000", 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0199999999999999e-06 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.158812+0000", 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2687000000000001e-05 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.158838+0000", 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5865999999999999e-05 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.158852+0000", 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3681e-05 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.158935+0000", 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3867000000000002e-05 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.159008+0000", 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2984999999999993e-05 2024-09-05T17:30:51.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.159494+0000", 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000485398 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.162122+0000", 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002628128 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.162432+0000", 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031054599999999998 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.162518+0000", 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5080999999999994e-05 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.162622+0000", 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104633 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:4443 3.4 3:27555207:::rbd_data.114070605229.00000000000000e7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:51.197284+0000", 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.35874977200000002, 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0035780030000000002, 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 4443 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197284+0000", 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197284+0000", 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197288+0000", 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.782e-06 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197300+0000", 2024-09-05T17:30:51.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2320000000000001e-05 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197339+0000", 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8782000000000002e-05 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197358+0000", 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8926000000000001e-05 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197550+0000", 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00019228999999999999 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197700+0000", 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149615 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197902+0000", 2024-09-05T17:30:51.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020194700000000001 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.199113+0000", 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001211763 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.200737+0000", 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001623389 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.200791+0000", 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4079999999999997e-05 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.200862+0000", 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1109e-05 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.708 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:4444 3.19 3:9a6fcd4c:::rbd_data.114070605229.00000000000000e8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:51.197405+0000", 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.35862845700000001, 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029725490000000001, 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 4444 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:51.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197405+0000", 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197405+0000", 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197406+0000", 2024-09-05T17:30:51.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6599999999999994e-07 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197414+0000", 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5259999999999996e-06 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197430+0000", 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5841999999999998e-05 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.197442+0000", 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2106000000000001e-05 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.198395+0000", 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00095321100000000003 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.198545+0000", 2024-09-05T17:30:51.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149753 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.198733+0000", 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000188853 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.199573+0000", 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00083965199999999998 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.200277+0000", 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000703547 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.200334+0000", 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.753e-05 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:51.200378+0000", 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3563000000000003e-05 2024-09-05T17:30:51.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:51.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:51.715 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:51.716 INFO:teuthology.orchestra.run.smithi050.stdout:412 writesame 0x5d371cc thru 0x5d3f457 data_size 0x1e(0x828c bytes) 2024-09-05T17:30:51.716 INFO:teuthology.orchestra.run.smithi050.stdout:413 punch from 0x51b959a to 0x51c86ad, (0xf113 bytes) 2024-09-05T17:30:51.716 INFO:teuthology.orchestra.run.smithi050.stdout:415 trunc from 0x5d3f458 to 0x464b8f8 2024-09-05T17:30:51.717 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:30:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:416 trunc from 0x464b8f8 to 0xdcba8ca 2024-09-05T17:30:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:417 read 0x3333393 thru 0x3335c0a (0x2878 bytes) 2024-09-05T17:30:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:420 write 0x4906e3a thru 0x4912e44 (0xc00b bytes) 2024-09-05T17:30:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:421 read 0x8d5872a thru 0x8d63b7f (0xb456 bytes) 2024-09-05T17:30:51.718 INFO:teuthology.orchestra.run.smithi050.stdout:422 writesame 0xd9c5d2c thru 0xd9cfcb3 data_size 0x14(0x9f88 bytes) 2024-09-05T17:30:51.719 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:30:51.719 INFO:teuthology.orchestra.run.smithi050.stdout:423 read 0x955f62 thru 0x960bac (0xac4b bytes) 2024-09-05T17:30:51.719 INFO:teuthology.orchestra.run.smithi050.stdout:424 writesame 0x6a0cf81 thru 0x6a15c2c data_size 0x6(0x8cac bytes) 2024-09-05T17:30:51.720 INFO:teuthology.orchestra.run.smithi050.stdout:427 trunc from 0xdcba8ca to 0xac78ea2 2024-09-05T17:30:51.720 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:30:51.721 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:30:51.721 INFO:teuthology.orchestra.run.smithi050.stdout:428 punch from 0x159dd7a to 0x15abb6a, (0xddf0 bytes) 2024-09-05T17:30:51.721 INFO:teuthology.orchestra.run.smithi050.stdout:431 read 0x51a81c1 thru 0x51b234e (0xa18e bytes) 2024-09-05T17:30:51.722 INFO:teuthology.orchestra.run.smithi050.stdout:433 writesame 0xb7c999e thru 0xb7d47af data_size 0x15(0xae12 bytes) 2024-09-05T17:30:51.722 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.722 INFO:teuthology.orchestra.run.smithi050.stdout:436 punch from 0x81a9416 to 0x81ad176, (0x3d60 bytes) 2024-09-05T17:30:51.722 INFO:teuthology.orchestra.run.smithi050.stdout:437 read 0x6a90253 thru 0x6a9c23e (0xbfec bytes) 2024-09-05T17:30:51.722 INFO:teuthology.orchestra.run.smithi050.stdout:438 write 0x541e2fd thru 0x542af96 (0xcc9a bytes) 2024-09-05T17:30:51.722 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:30:51.722 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:30:51.723 INFO:teuthology.orchestra.run.smithi050.stdout:439 write 0xb35b0db thru 0xb369354 (0xe27a bytes) 2024-09-05T17:30:51.723 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:30:51.723 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:30:51.723 INFO:teuthology.orchestra.run.smithi050.stdout:443 read 0xbc9d05 thru 0xbd27db (0x8ad7 bytes) 2024-09-05T17:30:51.724 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:51.721+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:51.724 INFO:teuthology.orchestra.run.smithi050.stdout:444 trunc from 0xb7d47b0 to 0x1bc76e3 2024-09-05T17:30:51.725 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:30:51.725 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:30:51.750 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:30:51.750 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:30:51.751 INFO:teuthology.orchestra.run.smithi050.stdout:446 read 0x1957992 thru 0x1963cc3 (0xc332 bytes) 2024-09-05T17:30:51.764 INFO:teuthology.orchestra.run.smithi050.stdout:447 write 0x5e615ea thru 0x5e64e01 (0x3818 bytes) 2024-09-05T17:30:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:448 read 0x4ae6375 thru 0x4af3952 (0xd5de bytes) 2024-09-05T17:30:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:449 read 0x4c01c30 thru 0x4c0b9b6 (0x9d87 bytes) 2024-09-05T17:30:51.774 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:30:51.775 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:30:51.776 INFO:teuthology.orchestra.run.smithi050.stdout:450 trunc from 0x5e64e02 to 0x44ea21a 2024-09-05T17:30:51.794 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.794 INFO:teuthology.orchestra.run.smithi050.stdout:452 punch from 0x16e60c8 to 0x16eb307, (0x523f bytes) 2024-09-05T17:30:51.794 INFO:teuthology.orchestra.run.smithi050.stdout:453 punch from 0xeabc80 to 0xeb9ce9, (0xe069 bytes) 2024-09-05T17:30:51.795 INFO:teuthology.orchestra.run.smithi050.stdout:455 trunc from 0x44ea21a to 0x4db6ecc 2024-09-05T17:30:51.796 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:30:51.796 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:30:51.803 INFO:teuthology.orchestra.run.smithi050.stdout:456 read 0x171497 thru 0x1717ca (0x334 bytes) 2024-09-05T17:30:51.803 INFO:teuthology.orchestra.run.smithi050.stdout:457 punch from 0x2b7ac01 to 0x2b87ba7, (0xcfa6 bytes) 2024-09-05T17:30:51.803 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.803 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.808 INFO:teuthology.orchestra.run.smithi050.stdout:460 trunc from 0x4db6ecc to 0x530b3d 2024-09-05T17:30:51.817 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:51.815+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:51.821 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:30:51.821 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:30:51.835 INFO:teuthology.orchestra.run.smithi050.stdout:461 trunc from 0x530b3d to 0x227e7a5 2024-09-05T17:30:51.850 INFO:teuthology.orchestra.run.smithi050.stdout:463 write 0x360267b thru 0x3611d56 (0xf6dc bytes) 2024-09-05T17:30:51.855 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:51.855 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:51.867 INFO:teuthology.orchestra.run.smithi050.stdout:464 punch from 0x1065be9 to 0x106b201, (0x5618 bytes) 2024-09-05T17:30:51.871 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:30:51.876 INFO:teuthology.orchestra.run.smithi050.stdout:465 trunc from 0x3611d57 to 0xb9f2542 2024-09-05T17:30:51.887 INFO:teuthology.orchestra.run.smithi050.stdout:466 read 0xb66e2ab thru 0xb677bb6 (0x990c bytes) 2024-09-05T17:30:51.893 INFO:teuthology.orchestra.run.smithi050.stdout:467 trunc from 0xb9f2542 to 0x2726b49 2024-09-05T17:30:51.911 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:51.911 INFO:teuthology.orchestra.run.smithi050.stdout:469 read 0x1d6390a thru 0x1d711cd (0xd8c4 bytes) 2024-09-05T17:30:51.911 INFO:teuthology.orchestra.run.smithi050.stdout:471 read 0x207df17 thru 0x208bb52 (0xdc3c bytes) 2024-09-05T17:30:51.911 INFO:teuthology.orchestra.run.smithi050.stdout:474 write 0x264790f thru 0x2652655 (0xad47 bytes) 2024-09-05T17:30:51.917 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:51.921+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:51.950 INFO:teuthology.orchestra.run.smithi050.stdout:475 write 0xdda1d0c thru 0xddacdf4 (0xb0e9 bytes) 2024-09-05T17:30:51.967 INFO:teuthology.orchestra.run.smithi050.stdout:477 write 0x75231ac thru 0x752dcc4 (0xab19 bytes) 2024-09-05T17:30:51.985 INFO:teuthology.orchestra.run.smithi050.stdout:478 punch from 0x78c8fbe to 0x78d63b2, (0xd3f4 bytes) 2024-09-05T17:30:51.985 INFO:teuthology.orchestra.run.smithi050.stdout:479 punch from 0x2bbde69 to 0x2bca81e, (0xc9b5 bytes) 2024-09-05T17:30:51.993 INFO:teuthology.orchestra.run.smithi050.stdout:481 writesame 0xe1b06aa thru 0xe1b0f0b data_size 0x1d(0x862 bytes) 2024-09-05T17:30:52.008 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:52.008 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:52.008 INFO:teuthology.orchestra.run.smithi050.stdout:483 trunc from 0xe1b0f0c to 0x68ab10 2024-09-05T17:30:52.019 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:52.019+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:52.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:30:52.049 INFO:teuthology.orchestra.run.smithi050.stdout:484 trunc from 0x68ab10 to 0x66bd96a 2024-09-05T17:30:52.056 INFO:teuthology.orchestra.run.smithi050.stdout:485 read 0x313f0de thru 0x3142949 (0x386c bytes) 2024-09-05T17:30:52.057 INFO:teuthology.orchestra.run.smithi050.stdout:486 punch from 0x4a354c9 to 0x4a445dd, (0xf114 bytes) 2024-09-05T17:30:52.071 INFO:teuthology.orchestra.run.smithi050.stdout:487 write 0xb50f654 thru 0xb51055f (0xf0c bytes) 2024-09-05T17:30:52.078 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.078 INFO:teuthology.orchestra.run.smithi050.stdout:489 writesame 0x25edacf thru 0x25f5320 data_size 0x1(0x7852 bytes) 2024-09-05T17:30:52.113 INFO:teuthology.orchestra.run.smithi050.stdout:491 writesame 0xda1d3e5 thru 0xda2c15a data_size 0x5(0xed76 bytes) 2024-09-05T17:30:52.113 INFO:teuthology.orchestra.run.smithi050.stdout:493 write 0x89e15d6 thru 0x89e351d (0x1f48 bytes) 2024-09-05T17:30:52.119 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:52.119+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:52.121 INFO:teuthology.orchestra.run.smithi050.stdout:494 write 0xc8072cc thru 0xc8076ee (0x423 bytes) 2024-09-05T17:30:52.127 INFO:teuthology.orchestra.run.smithi050.stdout:496 punch from 0x8e9dd8f to 0x8ea4808, (0x6a79 bytes) 2024-09-05T17:30:52.127 INFO:teuthology.orchestra.run.smithi050.stdout:497 read 0x685b995 thru 0x686ab8d (0xf1f9 bytes) 2024-09-05T17:30:52.127 INFO:teuthology.orchestra.run.smithi050.stdout:498 write 0x515d159 thru 0x5166c3a (0x9ae2 bytes) 2024-09-05T17:30:52.145 INFO:teuthology.orchestra.run.smithi050.stdout:499 write 0x5d0aaf1 thru 0x5d19513 (0xea23 bytes) 2024-09-05T17:30:52.166 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.166 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.166 INFO:teuthology.orchestra.run.smithi050.stdout:503 read 0x3848ef3 thru 0x3852b37 (0x9c45 bytes) 2024-09-05T17:30:52.166 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.172 INFO:teuthology.orchestra.run.smithi050.stdout:506 trunc from 0xda2c15b to 0x9bcfc6e 2024-09-05T17:30:52.184 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:52.184 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:52.191 INFO:teuthology.orchestra.run.smithi050.stdout:507 writesame 0x751616a thru 0x751850d data_size 0x2(0x23a4 bytes) 2024-09-05T17:30:52.201 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:30:52.206 INFO:teuthology.orchestra.run.smithi050.stdout:509 trunc from 0x9bcfc6e to 0xd6f4485 2024-09-05T17:30:52.233 INFO:teuthology.orchestra.run.smithi050.stdout:510 trunc from 0xd6f4485 to 0x2f1fd0f 2024-09-05T17:30:52.233 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:52.237+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:52.261 INFO:teuthology.orchestra.run.smithi050.stdout:511 read 0x29b333 thru 0x2a073f (0x540d bytes) 2024-09-05T17:30:52.261 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.261 INFO:teuthology.orchestra.run.smithi050.stdout:513 punch from 0x17d6e7f to 0x17df7d2, (0x8953 bytes) 2024-09-05T17:30:52.261 INFO:teuthology.orchestra.run.smithi050.stdout:514 read 0x28e3d8a thru 0x28ee2d4 (0xa54b bytes) 2024-09-05T17:30:52.276 INFO:teuthology.orchestra.run.smithi050.stdout:518 trunc from 0x2f1fd0f to 0xa5c79e9 2024-09-05T17:30:52.286 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.286 INFO:teuthology.orchestra.run.smithi050.stdout:521 read 0x4b0db7f thru 0x4b0f985 (0x1e07 bytes) 2024-09-05T17:30:52.286 INFO:teuthology.orchestra.run.smithi050.stdout:522 read 0x4f46ffb thru 0x4f50168 (0x916e bytes) 2024-09-05T17:30:52.286 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.286 INFO:teuthology.orchestra.run.smithi050.stdout:525 read 0x893b90c thru 0x8943cc1 (0x83b6 bytes) 2024-09-05T17:30:52.300 INFO:teuthology.orchestra.run.smithi050.stdout:527 write 0xd322354 thru 0xd322c41 (0x8ee bytes) 2024-09-05T17:30:52.306 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.307 INFO:teuthology.orchestra.run.smithi050.stdout:529 read 0x7da2b7c thru 0x7db25ca (0xfa4f bytes) 2024-09-05T17:30:52.307 INFO:teuthology.orchestra.run.smithi050.stdout:530 read 0xae4158 thru 0xaee1f2 (0xa09b bytes) 2024-09-05T17:30:52.307 INFO:teuthology.orchestra.run.smithi050.stdout:532 trunc from 0xd322c42 to 0xda19566 2024-09-05T17:30:52.317 INFO:teuthology.orchestra.run.smithi050.stdout:533 read 0x52175b7 thru 0x5225cc0 (0xe70a bytes) 2024-09-05T17:30:52.317 INFO:teuthology.orchestra.run.smithi050.stdout:535 read 0x597c712 thru 0x597dbc2 (0x14b1 bytes) 2024-09-05T17:30:52.317 INFO:teuthology.orchestra.run.smithi050.stdout:536 write 0x75ac380 thru 0x75b6bae (0xa82f bytes) 2024-09-05T17:30:52.321 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:52.325+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:52.336 INFO:teuthology.orchestra.run.smithi050.stdout:539 write 0x184fb08 thru 0x1851293 (0x178c bytes) 2024-09-05T17:30:52.345 INFO:teuthology.orchestra.run.smithi050.stdout:540 read 0xae22838 thru 0xae2f2b9 (0xca82 bytes) 2024-09-05T17:30:52.345 INFO:teuthology.orchestra.run.smithi050.stdout:541 read 0x4132baf thru 0x413e9dc (0xbe2e bytes) 2024-09-05T17:30:52.345 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.345 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.345 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.346 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:52.346 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:52.351 INFO:teuthology.orchestra.run.smithi050.stdout:545 trunc from 0xda19566 to 0xa7f60a1 2024-09-05T17:30:52.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:30:52.368 INFO:teuthology.orchestra.run.smithi050.stdout:546 punch from 0x4705a6b to 0x470fdf1, (0xa386 bytes) 2024-09-05T17:30:52.368 INFO:teuthology.orchestra.run.smithi050.stdout:547 read 0x301a4f0 thru 0x3027c0c (0xd71d bytes) 2024-09-05T17:30:52.368 INFO:teuthology.orchestra.run.smithi050.stdout:550 writesame 0x93772e2 thru 0x9382ef9 data_size 0x1a(0xbc18 bytes) 2024-09-05T17:30:52.388 INFO:teuthology.orchestra.run.smithi050.stdout:551 trunc from 0xa7f60a1 to 0x903f6f2 2024-09-05T17:30:52.402 INFO:teuthology.orchestra.run.smithi050.stdout:552 read 0x710ebfd thru 0x7119ff1 (0xb3f5 bytes) 2024-09-05T17:30:52.402 INFO:teuthology.orchestra.run.smithi050.stdout:553 read 0x115a815 thru 0x11683af (0xdb9b bytes) 2024-09-05T17:30:52.421 INFO:teuthology.orchestra.run.smithi050.stdout:555 writesame 0xeaf8368 thru 0xeaf870d data_size 0x1(0x3a6 bytes) 2024-09-05T17:30:52.421 INFO:teuthology.orchestra.run.smithi050.stdout:556 read 0x778e4f thru 0x77ece6 (0x5e98 bytes) 2024-09-05T17:30:52.421 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:52.425+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:52.422 INFO:teuthology.orchestra.run.smithi050.stdout:557 punch from 0x11d27c4 to 0x11d2bfb, (0x437 bytes) 2024-09-05T17:30:52.422 INFO:teuthology.orchestra.run.smithi050.stdout:truncating to largest ever: 0xecd86ba 2024-09-05T17:30:52.422 INFO:teuthology.orchestra.run.smithi050.stdout:558 trunc from 0xeaf870e to 0xecd86ba 2024-09-05T17:30:52.430 INFO:teuthology.orchestra.run.smithi050.stdout:559 punch from 0x43911b3 to 0x439ea1c, (0xd869 bytes) 2024-09-05T17:30:52.430 INFO:teuthology.orchestra.run.smithi050.stdout:560 write 0x1c49178 thru 0x1c4b305 (0x218e bytes) 2024-09-05T17:30:52.442 INFO:teuthology.orchestra.run.smithi050.stdout:561 trunc from 0xecd86ba to 0xb992fd3 2024-09-05T17:30:52.450 INFO:teuthology.orchestra.run.smithi050.stdout:563 read 0x197ab65 thru 0x1984eb0 (0xa34c bytes) 2024-09-05T17:30:52.451 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.454 INFO:teuthology.orchestra.run.smithi050.stdout:565 trunc from 0xb992fd3 to 0xdaa5988 2024-09-05T17:30:52.462 INFO:teuthology.orchestra.run.smithi050.stdout:567 write 0x5c49257 thru 0x5c4a1a0 (0xf4a bytes) 2024-09-05T17:30:52.491 INFO:teuthology.orchestra.run.smithi050.stdout:569 trunc from 0xdaa5988 to 0x144fbc1 2024-09-05T17:30:52.501 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:52.501 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:52.519 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:30:52.522 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:52.519+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:52.551 INFO:teuthology.orchestra.run.smithi050.stdout:570 write 0xd40bd7d thru 0xd41868f (0xc913 bytes) 2024-09-05T17:30:52.567 INFO:teuthology.orchestra.run.smithi050.stdout:571 write 0x946fe5 thru 0x94becf (0x4eeb bytes) 2024-09-05T17:30:52.580 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.580 INFO:teuthology.orchestra.run.smithi050.stdout:573 write 0x7aa44e4 thru 0x7ab18a8 (0xd3c5 bytes) 2024-09-05T17:30:52.593 INFO:teuthology.orchestra.run.smithi050.stdout:574 read 0x4499fe7 thru 0x449ea51 (0x4a6b bytes) 2024-09-05T17:30:52.593 INFO:teuthology.orchestra.run.smithi050.stdout:575 read 0x2d55673 thru 0x2d5c918 (0x72a6 bytes) 2024-09-05T17:30:52.593 INFO:teuthology.orchestra.run.smithi050.stdout:576 write 0x7b457c9 thru 0x7b488de (0x3116 bytes) 2024-09-05T17:30:52.596 INFO:teuthology.orchestra.run.smithi050.stdout:577 write 0x9b19393 thru 0x9b1aca0 (0x190e bytes) 2024-09-05T17:30:52.601 INFO:teuthology.orchestra.run.smithi050.stdout:578 writesame 0x8550ed thru 0x859ca2 data_size 0xb(0x4bb6 bytes) 2024-09-05T17:30:52.606 INFO:teuthology.orchestra.run.smithi050.stdout:579 write 0x5da1727 thru 0x5da4121 (0x29fb bytes) 2024-09-05T17:30:52.616 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.616 INFO:teuthology.orchestra.run.smithi050.stdout:582 writesame 0x4e5ba67 thru 0x4e65224 data_size 0x1(0x97be bytes) 2024-09-05T17:30:52.622 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:52.619+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:52.652 INFO:teuthology.orchestra.run.smithi050.stdout:583 trunc from 0xd418690 to 0x462ca37 2024-09-05T17:30:52.691 INFO:teuthology.orchestra.run.smithi050.stdout:585 write 0x798e52f thru 0x799d28d (0xed5f bytes) 2024-09-05T17:30:52.697 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:52.698 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:52.709 INFO:teuthology.orchestra.run.smithi050.stdout:586 write 0x17b8711 thru 0x17c70e6 (0xe9d6 bytes) 2024-09-05T17:30:52.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:30:52.728 INFO:teuthology.orchestra.run.smithi050.stdout:587 read 0x40c56ec thru 0x40c6768 (0x107d bytes) 2024-09-05T17:30:52.729 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.729 INFO:teuthology.orchestra.run.smithi050.stdout:590 read 0x76e5f9 thru 0x773729 (0x5131 bytes) 2024-09-05T17:30:52.730 INFO:teuthology.orchestra.run.smithi050.stdout:592 read 0x44aa23d thru 0x44abb1e (0x18e2 bytes) 2024-09-05T17:30:52.738 INFO:teuthology.orchestra.run.smithi050.stdout:593 trunc from 0x799d28e to 0x2babb51 2024-09-05T17:30:52.755 INFO:teuthology.orchestra.run.smithi050.stdout:595 read 0x17407e5 thru 0x174f11f (0xe93b bytes) 2024-09-05T17:30:52.763 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:52.763+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:52.775 INFO:teuthology.orchestra.run.smithi050.stdout:596 writesame 0xa29af8b thru 0xa29cff0 data_size 0x1d(0x2066 bytes) 2024-09-05T17:30:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.776 INFO:teuthology.orchestra.run.smithi050.stdout:598 write 0x259cc15 thru 0x259d9db (0xdc7 bytes) 2024-09-05T17:30:52.781 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.781 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.781 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.787 INFO:teuthology.orchestra.run.smithi050.stdout:603 trunc from 0xa29cff1 to 0x6123872 2024-09-05T17:30:52.797 INFO:teuthology.orchestra.run.smithi050.stdout:604 write 0x4f7be6 thru 0x4fa2f2 (0x270d bytes) 2024-09-05T17:30:52.817 INFO:teuthology.orchestra.run.smithi050.stdout:605 write 0x9c03ddd thru 0x9c0da28 (0x9c4c bytes) 2024-09-05T17:30:52.823 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:52.825+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:52.832 INFO:teuthology.orchestra.run.smithi050.stdout:606 write 0x84507d3 thru 0x8458ef0 (0x871e bytes) 2024-09-05T17:30:52.850 INFO:teuthology.orchestra.run.smithi050.stdout:607 writesame 0x7e9f542 thru 0x7eadcad data_size 0x6(0xe76c bytes) 2024-09-05T17:30:52.860 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:52.861 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:52.867 INFO:teuthology.orchestra.run.smithi050.stdout:608 write 0x408527f thru 0x4094b88 (0xf90a bytes) 2024-09-05T17:30:52.877 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:30:52.884 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.885 INFO:teuthology.orchestra.run.smithi050.stdout:610 trunc from 0x9c0da29 to 0x9ed1f78 2024-09-05T17:30:52.892 INFO:teuthology.orchestra.run.smithi050.stdout:611 read 0x4a2bb37 thru 0x4a3a72b (0xebf5 bytes) 2024-09-05T17:30:52.892 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:52.892 INFO:teuthology.orchestra.run.smithi050.stdout:613 read 0x80a7f81 thru 0x80b5f43 (0xdfc3 bytes) 2024-09-05T17:30:52.897 INFO:teuthology.orchestra.run.smithi050.stdout:614 trunc from 0x9ed1f78 to 0xbf59f29 2024-09-05T17:30:52.905 INFO:teuthology.orchestra.run.smithi050.stdout:615 punch from 0x284cad to 0x28ea7e, (0x9dd1 bytes) 2024-09-05T17:30:52.905 INFO:teuthology.orchestra.run.smithi050.stdout:617 writesame 0x5572090 thru 0x557d692 data_size 0x1(0xb603 bytes) 2024-09-05T17:30:52.926 INFO:teuthology.orchestra.run.smithi050.stdout:618 writesame 0x2a51c31 thru 0x2a5cc56 data_size 0x7(0xb026 bytes) 2024-09-05T17:30:52.963 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:52.963+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:52.968 INFO:teuthology.orchestra.run.smithi050.stdout:619 trunc from 0xbf59f29 to 0x16091b2 2024-09-05T17:30:53.025 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:53.023+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:53.027 INFO:teuthology.orchestra.run.smithi050.stdout:620 write 0x7c7c674 thru 0x7c8313d (0x6aca bytes) 2024-09-05T17:30:53.052 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:53.053 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:53.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:30:53.069 INFO:teuthology.orchestra.run.smithi050.stdout:621 write 0xba70295 thru 0xba765f7 (0x6363 bytes) 2024-09-05T17:30:53.107 INFO:teuthology.orchestra.run.smithi050.stdout:622 write 0xdb53c10 thru 0xdb5a575 (0x6966 bytes) 2024-09-05T17:30:53.132 INFO:teuthology.orchestra.run.smithi050.stdout:624 write 0xb22ad5a thru 0xb22c100 (0x13a7 bytes) 2024-09-05T17:30:53.142 INFO:teuthology.orchestra.run.smithi050.stdout:625 read 0x4b3c057 thru 0x4b3d3b1 (0x135b bytes) 2024-09-05T17:30:53.142 INFO:teuthology.orchestra.run.smithi050.stdout:626 writesame 0x482823a thru 0x482f229 data_size 0x12(0x6ff0 bytes) 2024-09-05T17:30:53.159 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:53.159+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:53.167 INFO:teuthology.orchestra.run.smithi050.stdout:629 write 0x419f07f thru 0x41ac560 (0xd4e2 bytes) 2024-09-05T17:30:53.192 INFO:teuthology.orchestra.run.smithi050.stdout:630 read 0xc77da3b thru 0xc78abdc (0xd1a2 bytes) 2024-09-05T17:30:53.192 INFO:teuthology.orchestra.run.smithi050.stdout:631 write 0x47f3d14 thru 0x47f790b (0x3bf8 bytes) 2024-09-05T17:30:53.207 INFO:teuthology.orchestra.run.smithi050.stdout:632 trunc from 0xdb5a576 to 0xe542768 2024-09-05T17:30:53.218 INFO:teuthology.orchestra.run.smithi050.stdout:633 read 0x3340526 thru 0x334bcb6 (0xb791 bytes) 2024-09-05T17:30:53.218 INFO:teuthology.orchestra.run.smithi050.stdout:634 write 0x836f8a thru 0x8469ee (0xfa65 bytes) 2024-09-05T17:30:53.225 INFO:teuthology.orchestra.run.smithi050.stdout:635 read 0x6f1da92 thru 0x6f2738c (0x98fb bytes) 2024-09-05T17:30:53.225 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.225 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.226 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.226 INFO:teuthology.orchestra.run.smithi050.stdout:640 punch from 0x35847c7 to 0x358b465, (0x6c9e bytes) 2024-09-05T17:30:53.226 INFO:teuthology.orchestra.run.smithi050.stdout:643 read 0xc21f960 thru 0xc22cc60 (0xd301 bytes) 2024-09-05T17:30:53.226 INFO:teuthology.orchestra.run.smithi050.stdout:645 read 0xf1e596 thru 0xf218ff (0x336a bytes) 2024-09-05T17:30:53.226 INFO:teuthology.orchestra.run.smithi050.stdout:647 read 0x2e5383e thru 0x2e61ee1 (0xe6a4 bytes) 2024-09-05T17:30:53.226 INFO:teuthology.orchestra.run.smithi050.stdout:648 read 0x799583f thru 0x799bb61 (0x6323 bytes) 2024-09-05T17:30:53.227 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:53.229+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:53.239 INFO:teuthology.orchestra.run.smithi050.stdout:650 writesame 0xe7e3724 thru 0xe7e9314 data_size 0x1(0x5bf1 bytes) 2024-09-05T17:30:53.240 INFO:teuthology.orchestra.run.smithi050.stdout:652 writesame 0x8b99a55 thru 0x8ba6b74 data_size 0x70(0xd120 bytes) 2024-09-05T17:30:53.245 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:53.245 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:53.261 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:30:53.272 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.273 INFO:teuthology.orchestra.run.smithi050.stdout:654 read 0xc4b3d9a thru 0xc4be6b9 (0xa920 bytes) 2024-09-05T17:30:53.273 INFO:teuthology.orchestra.run.smithi050.stdout:656 write 0x76c4180 thru 0x76c9e31 (0x5cb2 bytes) 2024-09-05T17:30:53.293 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.312 INFO:teuthology.orchestra.run.smithi050.stdout:658 trunc from 0xe7e9315 to 0x7dfffea 2024-09-05T17:30:53.328 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:53.333+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:53.360 INFO:teuthology.orchestra.run.smithi050.stdout:659 trunc from 0x7dfffea to 0xe843c90 2024-09-05T17:30:53.372 INFO:teuthology.orchestra.run.smithi050.stdout:661 punch from 0x771cc2b to 0x77239f4, (0x6dc9 bytes) 2024-09-05T17:30:53.372 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.372 INFO:teuthology.orchestra.run.smithi050.stdout:663 writesame 0x11f560 thru 0x123cea data_size 0x37(0x478b bytes) 2024-09-05T17:30:53.408 INFO:teuthology.orchestra.run.smithi050.stdout:665 trunc from 0xe843c90 to 0x8106471 2024-09-05T17:30:53.425 INFO:teuthology.orchestra.run.smithi050.stdout:666 writesame 0x488041f thru 0x48814f5 data_size 0x1(0x10d7 bytes) 2024-09-05T17:30:53.429 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:53.433+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:53.434 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:53.434 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:53.449 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:30:53.451 INFO:teuthology.orchestra.run.smithi050.stdout:667 writesame 0x93a20bb thru 0x93a351e data_size 0x2d(0x1464 bytes) 2024-09-05T17:30:53.451 INFO:teuthology.orchestra.run.smithi050.stdout:669 read 0x760848f thru 0x7608816 (0x388 bytes) 2024-09-05T17:30:53.452 INFO:teuthology.orchestra.run.smithi050.stdout:670 read 0x381a12 thru 0x3821c3 (0x7b2 bytes) 2024-09-05T17:30:53.479 INFO:teuthology.orchestra.run.smithi050.stdout:671 write 0xe1ccc7f thru 0xe1d4407 (0x7789 bytes) 2024-09-05T17:30:53.507 INFO:teuthology.orchestra.run.smithi050.stdout:672 read 0x157dd4f thru 0x1586090 (0x8342 bytes) 2024-09-05T17:30:53.507 INFO:teuthology.orchestra.run.smithi050.stdout:673 punch from 0x9988aec to 0x99933c5, (0xa8d9 bytes) 2024-09-05T17:30:53.507 INFO:teuthology.orchestra.run.smithi050.stdout:674 write 0x5193434 thru 0x51a2cb8 (0xf885 bytes) 2024-09-05T17:30:53.530 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:53.527+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:53.534 INFO:teuthology.orchestra.run.smithi050.stdout:675 read 0x832ce11 thru 0x83360aa (0x929a bytes) 2024-09-05T17:30:53.535 INFO:teuthology.orchestra.run.smithi050.stdout:676 writesame 0x514eadc thru 0x5153310 data_size 0x1(0x4835 bytes) 2024-09-05T17:30:53.542 INFO:teuthology.orchestra.run.smithi050.stdout:677 read 0x876ce10 thru 0x8770d3b (0x3f2c bytes) 2024-09-05T17:30:53.543 INFO:teuthology.orchestra.run.smithi050.stdout:678 write 0x91a1f03 thru 0x91acc93 (0xad91 bytes) 2024-09-05T17:30:53.570 INFO:teuthology.orchestra.run.smithi050.stdout:679 trunc from 0xe1d4408 to 0xe674909 2024-09-05T17:30:53.585 INFO:teuthology.orchestra.run.smithi050.stdout:680 read 0x79b342f thru 0x79b960d (0x61df bytes) 2024-09-05T17:30:53.586 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:53.586 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:53.586 INFO:teuthology.orchestra.run.smithi050.stdout:681 write 0x1af6979 thru 0x1b04352 (0xd9da bytes) 2024-09-05T17:30:53.601 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:30:53.628 INFO:teuthology.orchestra.run.smithi050.stdout:682 punch from 0x679800d to 0x67a2c01, (0xabf4 bytes) 2024-09-05T17:30:53.629 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.629 INFO:teuthology.orchestra.run.smithi050.stdout:684 punch from 0x833cc98 to 0x834a502, (0xd86a bytes) 2024-09-05T17:30:53.641 INFO:teuthology.orchestra.run.smithi050.stdout:686 write 0xea0001a thru 0xea0e7c7 (0xe7ae bytes) 2024-09-05T17:30:53.643 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:53.643+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:53.664 INFO:teuthology.orchestra.run.smithi050.stdout:687 writesame 0x5a33d70 thru 0x5a3d4f9 data_size 0x77(0x978a bytes) 2024-09-05T17:30:53.689 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.689 INFO:teuthology.orchestra.run.smithi050.stdout:690 read 0xbe8aca6 thru 0xbe93118 (0x8473 bytes) 2024-09-05T17:30:53.689 INFO:teuthology.orchestra.run.smithi050.stdout:691 writesame 0x49d60ab thru 0x49d9890 data_size 0x36(0x37e6 bytes) 2024-09-05T17:30:53.692 INFO:teuthology.orchestra.run.smithi050.stdout:695 read 0x3990986 thru 0x3994e0b (0x4486 bytes) 2024-09-05T17:30:53.706 INFO:teuthology.orchestra.run.smithi050.stdout:697 trunc from 0xea0e7c8 to 0x8fb528d 2024-09-05T17:30:53.720 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:30:53.732 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:53.731+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:53.733 INFO:teuthology.orchestra.run.smithi050.stdout:698 read 0x52d973 thru 0x537e9e (0xa52c bytes) 2024-09-05T17:30:53.734 INFO:teuthology.orchestra.run.smithi050.stdout:699 read 0x2d15024 thru 0x2d1e89e (0x987b bytes) 2024-09-05T17:30:53.734 INFO:teuthology.orchestra.run.smithi050.stdout:700 punch from 0x24aa1eb to 0x24b2f6b, (0x8d80 bytes) 2024-09-05T17:30:53.734 INFO:teuthology.orchestra.run.smithi050.stdout:701 read 0x7c3904b thru 0x7c3d531 (0x44e7 bytes) 2024-09-05T17:30:53.735 INFO:teuthology.orchestra.run.smithi050.stdout:702 write 0x699634e thru 0x699a0e0 (0x3d93 bytes) 2024-09-05T17:30:53.745 INFO:teuthology.orchestra.run.smithi050.stdout:703 write 0x286a0be thru 0x2877e1b (0xdd5e bytes) 2024-09-05T17:30:53.764 INFO:teuthology.orchestra.run.smithi050.stdout:704 write 0x75178a9 thru 0x751c75c (0x4eb4 bytes) 2024-09-05T17:30:53.771 INFO:teuthology.orchestra.run.smithi050.stdout:705 read 0x2f6bfc1 thru 0x2f6c295 (0x2d5 bytes) 2024-09-05T17:30:53.771 INFO:teuthology.orchestra.run.smithi050.stdout:706 write 0x5462484 thru 0x54668a4 (0x4421 bytes) 2024-09-05T17:30:53.774 INFO:teuthology.orchestra.run.smithi050.stdout:708 write 0x669a7ad thru 0x66a2a6b (0x82bf bytes) 2024-09-05T17:30:53.781 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:53.781 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:53.793 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.793 INFO:teuthology.orchestra.run.smithi050.stdout:711 punch from 0x65b9cf9 to 0x65c8b96, (0xee9d bytes) 2024-09-05T17:30:53.793 INFO:teuthology.orchestra.run.smithi050.stdout:712 read 0x8b5ed53 thru 0x8b60d59 (0x2007 bytes) 2024-09-05T17:30:53.793 INFO:teuthology.orchestra.run.smithi050.stdout:714 read 0x4317990 thru 0x4322a7d (0xb0ee bytes) 2024-09-05T17:30:53.793 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:30:53.806 INFO:teuthology.orchestra.run.smithi050.stdout:716 writesame 0xd5375b0 thru 0xd53fa75 data_size 0x6e(0x84c6 bytes) 2024-09-05T17:30:53.806 INFO:teuthology.orchestra.run.smithi050.stdout:717 read 0xc06b572 thru 0xc070f48 (0x59d7 bytes) 2024-09-05T17:30:53.806 INFO:teuthology.orchestra.run.smithi050.stdout:718 read 0xd468848 thru 0xd476ad6 (0xe28f bytes) 2024-09-05T17:30:53.806 INFO:teuthology.orchestra.run.smithi050.stdout:719 punch from 0x3455ae3 to 0x345ff1f, (0xa43c bytes) 2024-09-05T17:30:53.807 INFO:teuthology.orchestra.run.smithi050.stdout:720 punch from 0x9251f5 to 0x928d51, (0x3b5c bytes) 2024-09-05T17:30:53.807 INFO:teuthology.orchestra.run.smithi050.stdout:721 writesame 0x3b6a6f7 thru 0x3b6e62f data_size 0x41(0x3f39 bytes) 2024-09-05T17:30:53.811 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:30:53.811 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:30:53.811 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-05T17:30:53.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-05T17:30:53.815 INFO:teuthology.orchestra.run.smithi050.stdout:722 read 0x15f6e7d thru 0x15f7fe6 (0x116a bytes) 2024-09-05T17:30:53.815 INFO:teuthology.orchestra.run.smithi050.stdout:723 read 0xb65814d thru 0xb65aee2 (0x2d96 bytes) 2024-09-05T17:30:53.815 INFO:teuthology.orchestra.run.smithi050.stdout:724 read 0x1565f8a thru 0x15709d4 (0xaa4b bytes) 2024-09-05T17:30:53.815 INFO:teuthology.orchestra.run.smithi050.stdout:726 read 0x4ff3d95 thru 0x50032fa (0xf566 bytes) 2024-09-05T17:30:53.816 INFO:teuthology.orchestra.run.smithi050.stdout:727 write 0x3da58ed thru 0x3dacad7 (0x71eb bytes) 2024-09-05T17:30:53.824 INFO:teuthology.orchestra.run.smithi050.stdout:728 writesame 0xaafd189 thru 0xab05b75 data_size 0x1f(0x89ed bytes) 2024-09-05T17:30:53.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:30:53.847 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:53.847+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:53.853 INFO:teuthology.orchestra.run.smithi050.stdout:729 trunc from 0xd53fa76 to 0x457e2a3 2024-09-05T17:30:53.887 INFO:teuthology.orchestra.run.smithi050.stdout:732 read 0x25f7cbf thru 0x2600473 (0x87b5 bytes) 2024-09-05T17:30:53.888 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:53.894 INFO:teuthology.orchestra.run.smithi050.stdout:734 trunc from 0x457e2a3 to 0x89a3516 2024-09-05T17:30:53.902 INFO:teuthology.orchestra.run.smithi050.stdout:736 write 0x43b234f thru 0x43bb84f (0x9501 bytes) 2024-09-05T17:30:53.911 INFO:teuthology.orchestra.run.smithi050.stdout:738 writesame 0x502393a thru 0x5032aaa data_size 0xb(0xf171 bytes) 2024-09-05T17:30:53.927 INFO:teuthology.orchestra.run.smithi050.stdout:740 read 0x634b6c7 thru 0x635131f (0x5c59 bytes) 2024-09-05T17:30:53.927 INFO:teuthology.orchestra.run.smithi050.stdout:741 punch from 0x58d3082 to 0x58dc613, (0x9591 bytes) 2024-09-05T17:30:53.927 INFO:teuthology.orchestra.run.smithi050.stdout:742 writesame 0x408a140 thru 0x40923d2 data_size 0x1(0x8293 bytes) 2024-09-05T17:30:53.933 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:53.931+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:53.935 INFO:teuthology.orchestra.run.smithi050.stdout:744 punch from 0x5535b90 to 0x5542e5b, (0xd2cb bytes) 2024-09-05T17:30:53.943 INFO:teuthology.orchestra.run.smithi050.stdout:745 write 0x92bbbb6 thru 0x92c1556 (0x59a1 bytes) 2024-09-05T17:30:53.955 INFO:teuthology.orchestra.run.smithi050.stdout:746 read 0x6224f15 thru 0x622d949 (0x8a35 bytes) 2024-09-05T17:30:53.955 INFO:teuthology.orchestra.run.smithi050.stdout:747 read 0x1dcca6 thru 0x1e4c88 (0x7fe3 bytes) 2024-09-05T17:30:53.956 INFO:teuthology.orchestra.run.smithi050.stdout:748 read 0x3ae275e thru 0x3ae6f65 (0x4808 bytes) 2024-09-05T17:30:53.957 INFO:teuthology.orchestra.run.smithi050.stdout:749 clone 2 order 21 su 262144 sc 15 2024-09-05T17:30:53.985 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:53.986 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:54.000 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:30:54.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-05T17:30:54.020 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:30:54.021 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:30:54.039 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:30:54.040 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:30:54.040 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:54.041+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:54.056 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:30:54.057 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:30:54.073 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:30:54.074 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:30:54.091 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:30:54.092 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:30:54.111 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:30:54.149 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:30:54.149 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:30:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:30:54.150 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:30:54.150 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:30:54.151 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:54.153+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:54.165 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:54.166 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:54.166 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:30:54.166 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:30:54.166 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:54.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-05T17:30:54.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:30:54.268 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:54.273+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:54.297 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:54.298 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:30:54.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:30:54.298 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:30:54.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.298 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2604 3.10 3:0f142a20:::rbd_data.114070605229.0000000000000051:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 442368~2370] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.298 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.517383+0000", 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.7802541400000003, 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054317130000000003, 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2604 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517383+0000", 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517383+0000", 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517395+0000", 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2806000000000001e-05 2024-09-05T17:30:54.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517867+0000", 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00047155500000000002 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517889+0000", 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.517917+0000", 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7141999999999999e-05 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.518035+0000", 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011815399999999999 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.518248+0000", 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021318500000000001 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.518647+0000", 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039882900000000001 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.520307+0000", 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001660075 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522696+0000", 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023887370000000002 2024-09-05T17:30:54.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522765+0000", 2024-09-05T17:30:54.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9027000000000002e-05 2024-09-05T17:30:54.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522814+0000", 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9771999999999997e-05 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:2609 3.a 3:567b9325:::rbd_data.114070605229.0000000000000057:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write 438272~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:49.520583+0000", 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.7770535589999996, 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046712129999999996, 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.305 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2609 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.520583+0000", 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.520583+0000", 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.520585+0000", 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3710000000000001e-06 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521342+0000", 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00075738900000000002 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521378+0000", 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6154e-05 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521389+0000", 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0951000000000001e-05 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521520+0000", 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013113099999999999 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.521846+0000", 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032526400000000002 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.522538+0000", 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00069247799999999995 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525111+0000", 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002572787 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525131+0000", 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.995e-05 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525208+0000", 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7741e-05 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:49.525254+0000", 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5997e-05 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:3236 3.a 3:57f5bd37:::rbd_data.114070605229.0000000000000100:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:50.002184+0000", 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.2954530990000004, 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.005195687, 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 3236 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.312 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002184+0000", 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002184+0000", 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002187+0000", 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0170000000000001e-06 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002198+0000", 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0954e-05 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002234+0000", 2024-09-05T17:30:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5973999999999998e-05 2024-09-05T17:30:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002258+0000", 2024-09-05T17:30:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4515000000000002e-05 2024-09-05T17:30:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002353+0000", 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4597000000000002e-05 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002448+0000", 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5140000000000001e-05 2024-09-05T17:30:54.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.002562+0000", 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114363 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.003531+0000", 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00096857499999999995 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.007115+0000", 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003584467 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.007262+0000", 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014657599999999999 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.007379+0000", 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117509 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.318 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:3316 3.10 3:0bb3dd74:::rbd_data.114070605229.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:50.081667+0000", 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.2159696679999996, 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006307226, 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 3316 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.081667+0000", 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.081667+0000", 2024-09-05T17:30:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.081669+0000", 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2180000000000002e-06 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.081677+0000", 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8730000000000007e-06 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.081692+0000", 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4446e-05 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.081700+0000", 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3680000000000002e-06 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.081770+0000", 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9968999999999994e-05 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.081934+0000", 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016439199999999999 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.083195+0000", 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001260892 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.087826+0000", 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046303170000000001 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.087874+0000", 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8504000000000002e-05 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.087934+0000", 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9697999999999997e-05 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.087974+0000", 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0549000000000001e-05 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:3673 3.a 3:579df87c:::rbd_data.114070605229.00000000000000c6:head [write 143360~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:50.527089+0000", 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.77054746, 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049197499999999996, 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 3673 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527089+0000", 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527089+0000", 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527092+0000", 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.033e-06 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527115+0000", 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2676000000000001e-05 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527147+0000", 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.201e-05 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527163+0000", 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6053e-05 2024-09-05T17:30:54.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527311+0000", 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014818599999999999 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527507+0000", 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019586199999999999 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.527749+0000", 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024155499999999999 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.530917+0000", 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031684579999999999 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.531785+0000", 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00086800699999999996 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.531912+0000", 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127138 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.532009+0000", 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6772000000000001e-05 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.332 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4136 3.a 3:55d9040e:::rbd_data.114070605229.00000000000000b7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:50.892141+0000", 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.4054953609999998, 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046233610000000003, 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4136 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892141+0000", 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892141+0000", 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892145+0000", 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.817e-06 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892159+0000", 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3665999999999999e-05 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892204+0000", 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4963000000000003e-05 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892226+0000", 2024-09-05T17:30:54.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2560000000000001e-05 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892414+0000", 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018776200000000001 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892631+0000", 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000217059 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.892911+0000", 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000280191 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.895596+0000", 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002684049 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.896494+0000", 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00089877999999999996 2024-09-05T17:30:54.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.896639+0000", 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014485499999999999 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.896765+0000", 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125659 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.338 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4142 3.a 3:579df87c:::rbd_data.114070605229.00000000000000c6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:50.894205+0000", 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.4034313169999999, 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045187550000000002, 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.339 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4142 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894205+0000", 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894205+0000", 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894209+0000", 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.067e-06 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894221+0000", 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2386e-05 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894259+0000", 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8486999999999999e-05 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894282+0000", 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2566e-05 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894436+0000", 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015413300000000001 2024-09-05T17:30:54.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894705+0000", 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026899399999999999 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.894987+0000", 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028181099999999998 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.896827+0000", 2024-09-05T17:30:54.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018399790000000001 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.898441+0000", 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016144239999999999 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.898616+0000", 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017507499999999999 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.898724+0000", 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107833 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4268 3.a 3:5460dfee:::rbd_data.114070605229.00000000000001c6:head [set-alloc-hint object_size 524288 write_size 524288,write 225280~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:50.998705+0000", 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.2989316450000001, 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039925439999999998, 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4268 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.998705+0000", 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.998705+0000", 2024-09-05T17:30:54.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.998707+0000", 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1739999999999999e-06 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.998737+0000", 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9258999999999999e-05 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.998772+0000", 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5785999999999999e-05 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.998789+0000", 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6218e-05 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.998931+0000", 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014287800000000001 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.999338+0000", 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040605799999999999 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:50.999747+0000", 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040956400000000001 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.001324+0000", 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015767979999999999 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.002394+0000", 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010700849999999999 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.002561+0000", 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016708900000000001 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.002698+0000", 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000136635 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4286 3.10 3:0b1f8b71:::rbd_data.114070605229.00000000000001ca:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.017715+0000", 2024-09-05T17:30:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.2799218620000001, 2024-09-05T17:30:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00372705, 2024-09-05T17:30:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.352 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4286 2024-09-05T17:30:54.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.017715+0000", 2024-09-05T17:30:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.017715+0000", 2024-09-05T17:30:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.017716+0000", 2024-09-05T17:30:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9800000000000002e-07 2024-09-05T17:30:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.017720+0000", 2024-09-05T17:30:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7139999999999999e-06 2024-09-05T17:30:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.017729+0000", 2024-09-05T17:30:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7440000000000002e-06 2024-09-05T17:30:54.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.017738+0000", 2024-09-05T17:30:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5099999999999998e-06 2024-09-05T17:30:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.019001+0000", 2024-09-05T17:30:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012628520000000001 2024-09-05T17:30:54.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.019211+0000", 2024-09-05T17:30:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000210239 2024-09-05T17:30:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.019599+0000", 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038826099999999999 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.020806+0000", 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001206443 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.021303+0000", 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00049775000000000004 2024-09-05T17:30:54.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.021382+0000", 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8996000000000001e-05 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.021442+0000", 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9642999999999998e-05 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4402 3.a 3:567b9325:::rbd_data.114070605229.0000000000000057:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.140416+0000", 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1572206899999999, 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059604549999999999, 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.363 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4402 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.140416+0000", 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.140416+0000", 2024-09-05T17:30:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.140419+0000", 2024-09-05T17:30:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1999999999999999e-06 2024-09-05T17:30:54.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.140438+0000", 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8289000000000001e-05 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.140478+0000", 2024-09-05T17:30:54.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0114000000000003e-05 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.140499+0000", 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1503000000000001e-05 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.140618+0000", 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118455 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.140769+0000", 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000151111 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.141955+0000", 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001185869 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.146148+0000", 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041937850000000002 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.146222+0000", 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3961000000000006e-05 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.146310+0000", 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7410999999999994e-05 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.146377+0000", 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6756999999999998e-05 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4422 3.a 3:567b9325:::rbd_data.114070605229.0000000000000057:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.155717+0000", 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1419200979999999, 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041901200000000003, 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4422 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.155717+0000", 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.155717+0000", 2024-09-05T17:30:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.155720+0000", 2024-09-05T17:30:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.977e-06 2024-09-05T17:30:54.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.155730+0000", 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0747999999999999e-05 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.155756+0000", 2024-09-05T17:30:54.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5772e-05 2024-09-05T17:30:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.155772+0000", 2024-09-05T17:30:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5841999999999998e-05 2024-09-05T17:30:54.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.155873+0000", 2024-09-05T17:30:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010056399999999999 2024-09-05T17:30:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.155967+0000", 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4424000000000003e-05 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.156310+0000", 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034290900000000002 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.158108+0000", 2024-09-05T17:30:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001797601 2024-09-05T17:30:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.159654+0000", 2024-09-05T17:30:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00154637 2024-09-05T17:30:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.159799+0000", 2024-09-05T17:30:54.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014461899999999999 2024-09-05T17:30:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.159907+0000", 2024-09-05T17:30:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108294 2024-09-05T17:30:54.379 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4425 3.10 3:0f142a20:::rbd_data.114070605229.0000000000000051:head [set-alloc-hint object_size 524288 write_size 524288,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.380 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.161110+0000", 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1365263479999999, 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006268671, 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4425 2024-09-05T17:30:54.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.161110+0000", 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.161110+0000", 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.161114+0000", 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8199999999999998e-06 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.161128+0000", 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3512e-05 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.161160+0000", 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1844999999999997e-05 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.161180+0000", 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0146e-05 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.161316+0000", 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135981 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.161433+0000", 2024-09-05T17:30:54.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117722 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.162503+0000", 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010698859999999999 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.167183+0000", 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046791719999999997 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.167215+0000", 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1982e-05 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.167301+0000", 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6763999999999998e-05 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.167379+0000", 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7841000000000002e-05 2024-09-05T17:30:54.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4612 3.a 3:55d9040e:::rbd_data.114070605229.00000000000000b7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.352947+0000", 2024-09-05T17:30:54.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.9446902910000001, 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046841390000000004, 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4612 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.352947+0000", 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.352947+0000", 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.352948+0000", 2024-09-05T17:30:54.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9479999999999998e-06 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.352957+0000", 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.352980+0000", 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3269999999999999e-05 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.352992+0000", 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466999999999999e-05 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.353181+0000", 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000188741 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.353432+0000", 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025087200000000002 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.353745+0000", 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000312751 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.355193+0000", 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014479479999999999 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.357398+0000", 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022051319999999998 2024-09-05T17:30:54.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.357525+0000", 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012708500000000001 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.357631+0000", 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105713 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4712 3.a 3:564fb1b5:::rbd_data.114070605229.0000000000000049:head [write 454656~4096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.460571+0000", 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.8370653580000003, 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039697589999999998, 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.394 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4712 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.460571+0000", 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.460571+0000", 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.460575+0000", 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3459999999999998e-06 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.460597+0000", 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2257000000000001e-05 2024-09-05T17:30:54.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.460632+0000", 2024-09-05T17:30:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4730000000000001e-05 2024-09-05T17:30:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.460650+0000", 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8009999999999999e-05 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.460775+0000", 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012516900000000001 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.461035+0000", 2024-09-05T17:30:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025992099999999998 2024-09-05T17:30:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.461423+0000", 2024-09-05T17:30:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038840400000000002 2024-09-05T17:30:54.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.463557+0000", 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021340999999999999 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.464280+0000", 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00072214700000000002 2024-09-05T17:30:54.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.464427+0000", 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000147412 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.464541+0000", 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114263 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4764 3.a 3:564fb1b5:::rbd_data.114070605229.0000000000000049:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.511950+0000", 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.7856865740000001, 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054113140000000004, 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4764 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.511950+0000", 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.511950+0000", 2024-09-05T17:30:54.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.511954+0000", 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.653e-06 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.511968+0000", 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4037e-05 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.512013+0000", 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4818999999999999e-05 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.512038+0000", 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5199999999999999e-05 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.512214+0000", 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176312 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.512445+0000", 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023029800000000001 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.512801+0000", 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035620699999999999 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.516267+0000", 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034658229999999998 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.517109+0000", 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00084252700000000003 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.517241+0000", 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131829 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.517362+0000", 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120609 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4777 3.a 3:567b9325:::rbd_data.114070605229.0000000000000057:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.518319+0000", 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.7793176769999999, 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043513930000000003, 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.410 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4777 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.518319+0000", 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.518319+0000", 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.518322+0000", 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7429999999999998e-06 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.518338+0000", 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6082999999999998e-05 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.518376+0000", 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7966999999999997e-05 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.518400+0000", 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4263000000000001e-05 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.518557+0000", 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000156792 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.518781+0000", 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000223938 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.519081+0000", 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030046800000000002 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.520892+0000", 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001810187 2024-09-05T17:30:54.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.522271+0000", 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0013791249999999999 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.522450+0000", 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017900500000000001 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.522671+0000", 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022082199999999999 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4852 3.a 3:555c8570:::rbd_data.114070605229.0000000000000093:head [set-alloc-hint object_size 524288 write_size 524288,write 118784~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.599110+0000", 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.698526347, 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042071000000000001, 2024-09-05T17:30:54.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4852 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599110+0000", 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599110+0000", 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599115+0000", 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9599999999999999e-06 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599145+0000", 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9856e-05 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599190+0000", 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4469999999999999e-05 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599213+0000", 2024-09-05T17:30:54.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3053000000000001e-05 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599357+0000", 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014388500000000001 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599661+0000", 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000304598 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.599959+0000", 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029766100000000001 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.601808+0000", 2024-09-05T17:30:54.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001849329 2024-09-05T17:30:54.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.603156+0000", 2024-09-05T17:30:54.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00134811 2024-09-05T17:30:54.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.603245+0000", 2024-09-05T17:30:54.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8828999999999999e-05 2024-09-05T17:30:54.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.603318+0000", 2024-09-05T17:30:54.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2348999999999995e-05 2024-09-05T17:30:54.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.425 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4950 3.10 3:0f098b1d:::rbd_data.114070605229.00000000000000a2:head [set-alloc-hint object_size 524288 write_size 524288,write 364544~8087] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-05T17:30:54.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.687113+0000", 2024-09-05T17:30:54.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.6105241449999999, 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072667679999999998, 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4950 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.687113+0000", 2024-09-05T17:30:54.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.687113+0000", 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.687117+0000", 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.126e-06 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.687143+0000", 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6339999999999999e-05 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.687175+0000", 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2060000000000001e-05 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.687190+0000", 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4708e-05 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.687361+0000", 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000170726 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.687379+0000", 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8223000000000002e-05 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.691086+0000", 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0037074629999999998 2024-09-05T17:30:54.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.691301+0000", 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021443499999999999 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.691722+0000", 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00042145399999999998 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.694195+0000", 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024723140000000002 2024-09-05T17:30:54.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.694225+0000", 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0139999999999999e-05 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.694310+0000", 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5829999999999996e-05 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.694379+0000", 2024-09-05T17:30:54.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8948999999999993e-05 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4990 3.a 3:555c8570:::rbd_data.114070605229.0000000000000093:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.731006+0000", 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.5666305010000001, 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0044317460000000003, 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4990 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731006+0000", 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731006+0000", 2024-09-05T17:30:54.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731014+0000", 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2559999999999996e-06 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731036+0000", 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.279e-05 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731063+0000", 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6701000000000001e-05 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731075+0000", 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2216e-05 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731186+0000", 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111187 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731318+0000", 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013153899999999999 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731493+0000", 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017537100000000001 2024-09-05T17:30:54.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.733277+0000", 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017835430000000001 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.735264+0000", 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001987422 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.735365+0000", 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010040200000000001 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.735438+0000", 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3318999999999994e-05 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:4996 3.10 3:0f098b1d:::rbd_data.114070605229.00000000000000a2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-05T17:30:54.438 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:51.731175+0000", 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.566462198, 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041087479999999997, 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 4996 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731175+0000", 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731175+0000", 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731175+0000", 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3600000000000002e-07 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731180+0000", 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4839999999999998e-06 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731192+0000", 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2081e-05 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.731204+0000", 2024-09-05T17:30:54.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2224e-05 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.732730+0000", 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001526082 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.732952+0000", 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022180999999999999 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.733241+0000", 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028888900000000002 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.734713+0000", 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001472058 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.735061+0000", 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034788799999999997 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.735186+0000", 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124654 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:51.735283+0000", 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7742e-05 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.444 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.445 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.445 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:54.447 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-05T17:30:54.447 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:54.449+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:54.447 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:30:54.547 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:54.549+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:54.573 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:54.573 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:54.573 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:30:54.573 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:54.587 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:30:54.648 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:54.647+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:54.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-05T17:30:54.705 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:54.705 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:54.705 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:30:54.705 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:30:54.706 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:54.719 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:30:54.752 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:54.757+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:54.849 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:54.847+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:54.874 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-05T17:30:54.883 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.874414064, 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.892 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:30:54.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:30:54.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:30:54.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.899 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.429138032000001, 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014198443, 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 45 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462127+0000", 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462128+0000", 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.277e-06 2024-09-05T17:30:54.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462140+0000", 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.189e-05 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462163+0000", 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2889000000000001e-05 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462182+0000", 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9193000000000001e-05 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.470719+0000", 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085367580000000002 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.470866+0000", 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000146706 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.471072+0000", 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020635099999999999 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.475968+0000", 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048962889999999998 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476144+0000", 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000175742 2024-09-05T17:30:54.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476223+0000", 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8875999999999995e-05 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476326+0000", 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102472 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.429033306000001, 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016877395999999999, 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.906 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 46 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462232+0000", 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462233+0000", 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.356e-06 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462244+0000", 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0866999999999999e-05 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462271+0000", 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7399999999999999e-05 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462290+0000", 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8649000000000001e-05 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.472814+0000", 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010523963000000001 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.473010+0000", 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000195525 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.473215+0000", 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020561099999999999 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476120+0000", 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029048619999999998 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478974+0000", 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002853487 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479048+0000", 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3949999999999995e-05 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479109+0000", 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1725999999999998e-05 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.428937774000001, 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017239246999999999, 2024-09-05T17:30:54.912 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 47 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462327+0000", 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462329+0000", 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7430000000000001e-06 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462484+0000", 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015445899999999999 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462503+0000", 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.942e-05 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462515+0000", 2024-09-05T17:30:54.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2257e-05 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474087+0000", 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011572241 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474359+0000", 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000271267 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.474735+0000", 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037594800000000003 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479251+0000", 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.004516351 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479442+0000", 2024-09-05T17:30:54.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000190762 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479505+0000", 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3202999999999998e-05 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479567+0000", 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1595999999999998e-05 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.428728362000001, 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017251313000000001, 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 48 2024-09-05T17:30:54.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462537+0000", 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462538+0000", 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462558+0000", 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9695999999999999e-05 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462573+0000", 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4873e-05 2024-09-05T17:30:54.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462581+0000", 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4700000000000002e-06 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476438+0000", 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013857236 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.476683+0000", 2024-09-05T17:30:54.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024466499999999998 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.477061+0000", 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037820699999999998 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479423+0000", 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023615749999999999 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479582+0000", 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000159383 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479688+0000", 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000106019 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479788+0000", 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100042 2024-09-05T17:30:54.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.428646546, 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019256863999999999, 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 49 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462619+0000", 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462620+0000", 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462629+0000", 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7099999999999996e-06 2024-09-05T17:30:54.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462676+0000", 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7836000000000001e-05 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462686+0000", 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4630000000000007e-06 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.477921+0000", 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015235393 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478057+0000", 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013605600000000001 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.478323+0000", 2024-09-05T17:30:54.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026547400000000003 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481738+0000", 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034152700000000002 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481757+0000", 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9423e-05 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481821+0000", 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3449999999999997e-05 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.481875+0000", 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4589000000000002e-05 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.428553319999999, 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022237915, 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 50 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462712+0000", 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462713+0000", 2024-09-05T17:30:54.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462785+0000", 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2476000000000002e-05 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462799+0000", 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4153e-05 2024-09-05T17:30:54.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462808+0000", 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5799999999999992e-06 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.479896+0000", 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017088398000000001 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.480128+0000", 2024-09-05T17:30:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023147200000000001 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.480501+0000", 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037334400000000001 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484611+0000", 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041101380000000002 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484754+0000", 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000142399 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484829+0000", 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5155999999999997e-05 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484950+0000", 2024-09-05T17:30:54.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120939 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.428441715000002, 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022299985000000001, 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.938 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 51 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462823+0000", 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462824+0000", 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.47e-07 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462830+0000", 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4469999999999997e-06 2024-09-05T17:30:54.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462848+0000", 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8280000000000001e-05 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462860+0000", 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.243e-05 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482009+0000", 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019148515000000001 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482292+0000", 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000282835 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.482679+0000", 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038745300000000001 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484734+0000", 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020550410000000001 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.484963+0000", 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022876799999999999 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485036+0000", 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2819999999999997e-05 2024-09-05T17:30:54.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485123+0000", 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7548999999999998e-05 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.428380981, 2024-09-05T17:30:54.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.022782574, 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 52 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:54.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462884+0000", 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462885+0000", 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1960000000000001e-06 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462896+0000", 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0319999999999999e-05 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.462917+0000", 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.173e-05 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.463002+0000", 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4462999999999994e-05 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483583+0000", 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.020581537 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483737+0000", 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153323 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.483976+0000", 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023961100000000001 2024-09-05T17:30:54.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485145+0000", 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011682579999999999 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485394+0000", 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024987400000000003 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485544+0000", 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000149123 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.485667+0000", 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000123139 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.958597399999999, 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012685699, 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 66 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.951 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932668+0000", 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.75e-07 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932744+0000", 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5193999999999999e-05 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932756+0000", 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1911e-05 2024-09-05T17:30:54.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932764+0000", 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9080000000000001e-06 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934296+0000", 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001531267 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934357+0000", 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1545999999999997e-05 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.934450+0000", 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2297000000000001e-05 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936128+0000", 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016780289999999999 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945240+0000", 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00911264 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945303+0000", 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2830000000000007e-05 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945353+0000", 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0402000000000003e-05 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.958482534000002, 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012856464, 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.957 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 67 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932783+0000", 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6300000000000004e-07 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932789+0000", 2024-09-05T17:30:54.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2290000000000002e-06 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932799+0000", 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0492999999999999e-05 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.932807+0000", 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9209999999999992e-06 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935086+0000", 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022789910000000002 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935139+0000", 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2639000000000002e-05 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935244+0000", 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105571 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940354+0000", 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051093309999999999 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945447+0000", 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050934109999999999 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945565+0000", 2024-09-05T17:30:54.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118239 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945639+0000", 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3776000000000007e-05 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.958169073000001, 2024-09-05T17:30:54.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012727738000000001, 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 68 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:54.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933096+0000", 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933097+0000", 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933107+0000", 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8810000000000008e-06 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933126+0000", 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9230999999999999e-05 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933138+0000", 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1406999999999999e-05 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935553+0000", 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002415394 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935609+0000", 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6110999999999999e-05 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.935735+0000", 2024-09-05T17:30:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012551399999999999 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940369+0000", 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0046339240000000002 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945709+0000", 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053400039999999998 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945767+0000", 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8041999999999998e-05 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945824+0000", 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7098000000000001e-05 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.958101594999999, 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012931031000000001, 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 69 2024-09-05T17:30:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933164+0000", 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8700000000000005e-07 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933224+0000", 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9184999999999997e-05 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933236+0000", 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2894999999999999e-05 2024-09-05T17:30:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933265+0000", 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8138000000000001e-05 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936176+0000", 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029111269999999999 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936270+0000", 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3851999999999995e-05 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.936384+0000", 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011432199999999999 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940378+0000", 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0039938029999999998 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.945928+0000", 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055503269999999999 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946029+0000", 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010071199999999999 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946095+0000", 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5883000000000006e-05 2024-09-05T17:30:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.957969339999998, 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012945537999999999, 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 70 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933296+0000", 2024-09-05T17:30:54.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933297+0000", 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7000000000000003e-07 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933304+0000", 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7449999999999995e-06 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933317+0000", 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2309e-05 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933327+0000", 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9850000000000001e-06 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937198+0000", 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038713459999999999 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937342+0000", 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014390900000000001 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220435 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942102+0000", 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045396179999999996 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946168+0000", 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0040662809999999997 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946210+0000", 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1650999999999998e-05 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946241+0000", 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1389000000000001e-05 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.957887381999999, 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013113009, 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933378+0000", 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4600000000000005e-07 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933383+0000", 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.549e-06 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933389+0000", 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3110000000000002e-06 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933393+0000", 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2590000000000002e-06 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938234+0000", 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048408899999999996 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938317+0000", 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3096000000000005e-05 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938456+0000", 2024-09-05T17:30:54.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013882599999999999 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942114+0000", 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036578190000000001 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946334+0000", 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042197770000000001 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946436+0000", 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101822 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946491+0000", 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5114000000000001e-05 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.988 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.957863500999999, 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01324849, 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933402+0000", 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5199999999999998e-07 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933461+0000", 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8884000000000001e-05 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933469+0000", 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6260000000000003e-06 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933473+0000", 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5070000000000002e-06 2024-09-05T17:30:54.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.938866+0000", 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053928539999999999 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.939015+0000", 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014948300000000001 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.939244+0000", 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022877100000000001 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943974+0000", 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0047294399999999997 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946550+0000", 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0025768850000000001 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946589+0000", 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8050999999999999e-05 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946650+0000", 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1637000000000006e-05 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.994 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.957780908, 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013379528, 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 73 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:54.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933484+0000", 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933485+0000", 2024-09-05T17:30:54.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.82e-07 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933488+0000", 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1240000000000001e-06 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933493+0000", 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2070000000000003e-06 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933497+0000", 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8759999999999998e-06 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940436+0000", 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069388760000000001 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940528+0000", 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2517999999999997e-05 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.940675+0000", 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014695600000000001 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943986+0000", 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033105019999999999 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946714+0000", 2024-09-05T17:30:54.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027282220000000002 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946808+0000", 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4369000000000004e-05 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946864+0000", 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5396000000000003e-05 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.000 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.957761616999999, 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013485855, 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:55.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933504+0000", 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4700000000000002e-07 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933507+0000", 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7319999999999998e-06 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933511+0000", 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3599999999999998e-06 2024-09-05T17:30:55.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933514+0000", 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.36e-06 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941114+0000", 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0075993099999999997 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:55.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941245+0000", 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131669 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.941471+0000", 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022618099999999999 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944147+0000", 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026750530000000002 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946920+0000", 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00277349 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946960+0000", 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9786999999999997e-05 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.946989+0000", 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9566000000000001e-05 2024-09-05T17:30:55.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.957743849, 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013694682999999999, 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:55.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 75 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933521+0000", 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:55.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933522+0000", 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5400000000000002e-07 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933563+0000", 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1634000000000002e-05 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:55.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933571+0000", 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9109999999999993e-06 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933575+0000", 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.155e-06 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942168+0000", 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085926839999999997 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942247+0000", 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9221000000000006e-05 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.942374+0000", 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012631799999999999 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944157+0000", 2024-09-05T17:30:55.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017829969999999999 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947060+0000", 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029038039999999998 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947162+0000", 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101346 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947216+0000", 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4258999999999997e-05 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.957680867000001, 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013750551999999999, 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:55.013 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 76 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933584+0000", 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933585+0000", 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933588+0000", 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.366e-06 2024-09-05T17:30:55.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933592+0000", 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3290000000000004e-06 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.933596+0000", 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.41e-06 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:55.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943003+0000", 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0094069459999999994 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943155+0000", 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015211900000000001 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.943373+0000", 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021815800000000001 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.944315+0000", 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00094195300000000004 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947265+0000", 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029501359999999999 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947306+0000", 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0479000000000003e-05 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:55.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.947335+0000", 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9263000000000001e-05 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:55.019 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:55.021 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone1 from 0x92c1557 (overlap 0x530b3d) to 0x2137b2 2024-09-05T17:30:55.022 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:55.025+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:55.022 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:30:55.069 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-05T17:30:55.073 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-05T17:30:55.121 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:55.119+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:55.186 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:55.186 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:55.186 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:55.186 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:55.203 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:30:55.240 INFO:teuthology.orchestra.run.smithi050.stdout:751 write 0x4ac4fc9 thru 0x4ad3f4d (0xef85 bytes) 2024-09-05T17:30:55.241 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:55.245+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:55.258 INFO:teuthology.orchestra.run.smithi050.stdout:752 write 0x812f689 thru 0x8135be6 (0x655e bytes) 2024-09-05T17:30:55.266 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.273 INFO:teuthology.orchestra.run.smithi050.stdout:754 trunc from 0x92c1557 to 0x45e8627 2024-09-05T17:30:55.292 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-05T17:30:55.323 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:55.323+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:55.343 INFO:teuthology.orchestra.run.smithi050.stdout:755 punch from 0x2d3d11b to 0x2d3f08c, (0x1f71 bytes) 2024-09-05T17:30:55.382 INFO:teuthology.orchestra.run.smithi050.stdout:756 write 0x160a2a7 thru 0x160a399 (0xf3 bytes) 2024-09-05T17:30:55.383 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:55.383 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:55.383 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:30:55.383 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:30:55.383 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:55.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:30:55.384 INFO:teuthology.orchestra.run.smithi050.stdout:758 write 0xe6dce6a thru 0xe6ebcb2 (0xee49 bytes) 2024-09-05T17:30:55.384 INFO:teuthology.orchestra.run.smithi050.stdout:760 read 0x1820e37 thru 0x182a296 (0x9460 bytes) 2024-09-05T17:30:55.401 INFO:teuthology.orchestra.run.smithi050.stdout:763 trunc from 0xe6ebcb3 to 0xa76ad8 2024-09-05T17:30:55.428 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:55.423+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:55.474 INFO:teuthology.orchestra.run.smithi050.stdout:765 punch from 0x45af2 to 0x4ecb9, (0x91c7 bytes) 2024-09-05T17:30:55.474 INFO:teuthology.orchestra.run.smithi050.stdout:767 read 0x947357 thru 0x9502b3 (0x8f5d bytes) 2024-09-05T17:30:55.492 INFO:teuthology.orchestra.run.smithi050.stdout:769 write 0x8f61b58 thru 0x8f6b36f (0x9818 bytes) 2024-09-05T17:30:55.496 INFO:teuthology.orchestra.run.smithi050.stdout:770 write 0x5186391 thru 0x51954ca (0xf13a bytes) 2024-09-05T17:30:55.513 INFO:teuthology.orchestra.run.smithi050.stdout:771 write 0xda580c2 thru 0xda5a65b (0x259a bytes) 2024-09-05T17:30:55.517 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.517 INFO:teuthology.orchestra.run.smithi050.stdout:773 read 0x776d28a thru 0x77768e7 (0x965e bytes) 2024-09-05T17:30:55.517 INFO:teuthology.orchestra.run.smithi050.stdout:774 read 0x285413f thru 0x285a89b (0x675d bytes) 2024-09-05T17:30:55.518 INFO:teuthology.orchestra.run.smithi050.stdout:775 read 0xa5f0d8c thru 0xa5fd2ff (0xc574 bytes) 2024-09-05T17:30:55.518 INFO:teuthology.orchestra.run.smithi050.stdout:776 writesame 0x5cc74c9 thru 0x5cd3250 data_size 0x14(0xbd88 bytes) 2024-09-05T17:30:55.523 INFO:teuthology.orchestra.run.smithi050.stdout:777 write 0x1c7c3e1 thru 0x1c84984 (0x85a4 bytes) 2024-09-05T17:30:55.525 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:55.529+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:55.527 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.527 INFO:teuthology.orchestra.run.smithi050.stdout:780 write 0x8be17c4 thru 0x8be7c68 (0x64a5 bytes) 2024-09-05T17:30:55.531 INFO:teuthology.orchestra.run.smithi050.stdout:782 writesame 0x1f1bc89 thru 0x1f2b66e data_size 0x1d(0xf9e6 bytes) 2024-09-05T17:30:55.537 INFO:teuthology.orchestra.run.smithi050.stdout:783 read 0x937afd5 thru 0x937b2bd (0x2e9 bytes) 2024-09-05T17:30:55.537 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.537 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.537 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.537 INFO:teuthology.orchestra.run.smithi050.stdout:790 read 0x865c6fb thru 0x86646d0 (0x7fd6 bytes) 2024-09-05T17:30:55.537 INFO:teuthology.orchestra.run.smithi050.stdout:792 punch from 0x9d76ced to 0x9d76db9, (0xcc bytes) 2024-09-05T17:30:55.538 INFO:teuthology.orchestra.run.smithi050.stdout:793 writesame 0x70bf328 thru 0x70c8035 data_size 0x2e(0x8d0e bytes) 2024-09-05T17:30:55.544 INFO:teuthology.orchestra.run.smithi050.stdout:794 write 0xa296a9f thru 0xa29cf1d (0x647f bytes) 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4213.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.613301441000001, 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010346731, 2024-09-05T17:30:55.546 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937562+0000", 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937564+0000", 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0770000000000002e-06 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937719+0000", 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015435199999999999 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937753+0000", 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4629999999999999e-05 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937771+0000", 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7544e-05 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937897+0000", 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012583900000000001 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.937982+0000", 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4948000000000001e-05 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.947840+0000", 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098585610000000001 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:27.947909+0000", 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8780000000000002e-05 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7519 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 290816~20480] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301026+0000", 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24983735100000001, 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010346835, 2024-09-05T17:30:55.551 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7519 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301026+0000", 2024-09-05T17:30:55.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301026+0000", 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301027+0000", 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9700000000000002e-07 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301029+0000", 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3020000000000002e-06 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301036+0000", 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8730000000000001e-06 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301041+0000", 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4210000000000003e-06 2024-09-05T17:30:55.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311013+0000", 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0099715289999999998 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311098+0000", 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4920999999999996e-05 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311373+0000", 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027539200000000001 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7546 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 28672~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301131+0000", 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.249732498, 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010499534, 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.556 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7546 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301131+0000", 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301131+0000", 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301132+0000", 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1800000000000001e-07 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301134+0000", 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1919999999999999e-06 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301141+0000", 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1350000000000003e-06 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301147+0000", 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.127e-06 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311452+0000", 2024-09-05T17:30:55.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010305293 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311539+0000", 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7020000000000004e-05 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311631+0000", 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1348999999999996e-05 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.560 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7547 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301155+0000", 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24970877899999999, 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010665202, 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7547 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301155+0000", 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301155+0000", 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301155+0000", 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3799999999999998e-07 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301158+0000", 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2299999999999998e-06 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301164+0000", 2024-09-05T17:30:55.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4629999999999998e-06 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301169+0000", 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1739999999999999e-06 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311661+0000", 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010492041000000001 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311741+0000", 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0061000000000005e-05 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311820+0000", 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8794999999999994e-05 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7548 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 28672~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301176+0000", 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24968723400000001, 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010908446, 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.566 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7548 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301176+0000", 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301176+0000", 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301177+0000", 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.34e-07 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301180+0000", 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6389999999999998e-06 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301188+0000", 2024-09-05T17:30:55.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6569999999999997e-06 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301194+0000", 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4e-06 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311849+0000", 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010655181 2024-09-05T17:30:55.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311994+0000", 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014485499999999999 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312085+0000", 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1279999999999993e-05 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7549 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301201+0000", 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24966255400000001, 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011064842, 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.571 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7549 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301201+0000", 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301201+0000", 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301202+0000", 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3300000000000002e-07 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301204+0000", 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5830000000000001e-06 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301212+0000", 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9629999999999998e-06 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301218+0000", 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4550000000000003e-06 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312117+0000", 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010898901000000001 2024-09-05T17:30:55.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312196+0000", 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9093999999999999e-05 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312266+0000", 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0213e-05 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.575 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7564 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 323584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.302090+0000", 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24877397600000001, 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010359024, 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7564 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302090+0000", 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302090+0000", 2024-09-05T17:30:55.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302090+0000", 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302093+0000", 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.129e-06 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302102+0000", 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0299999999999999e-06 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302258+0000", 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015550699999999999 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312297+0000", 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010039467 2024-09-05T17:30:55.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312377+0000", 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9429000000000001e-05 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312449+0000", 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1891999999999995e-05 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.580 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7593 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 57344~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.302656+0000", 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24820731400000001, 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010379449000000001, 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7593 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302656+0000", 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302656+0000", 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302657+0000", 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8100000000000003e-07 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302660+0000", 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.807e-06 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304343+0000", 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016837060000000001 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304357+0000", 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3926e-05 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312862+0000", 2024-09-05T17:30:55.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085051039999999994 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312946+0000", 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3416000000000002e-05 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.313036+0000", 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0008999999999998e-05 2024-09-05T17:30:55.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7668 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 114688~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.304872+0000", 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.245991402, 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010367609, 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7668 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304872+0000", 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304872+0000", 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304873+0000", 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7100000000000002e-07 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304875+0000", 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4229999999999999e-06 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304882+0000", 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6959999999999999e-06 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304887+0000", 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9729999999999997e-06 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315037+0000", 2024-09-05T17:30:55.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010149816000000001 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315128+0000", 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1172000000000001e-05 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315240+0000", 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111958 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.590 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7681 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.304967+0000", 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24589687499999999, 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010485382, 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.591 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7681 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304967+0000", 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304967+0000", 2024-09-05T17:30:55.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304967+0000", 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6199999999999998e-07 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304978+0000", 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0621999999999999e-05 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304986+0000", 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0960000000000001e-06 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304992+0000", 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315275+0000", 2024-09-05T17:30:55.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010282754 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315361+0000", 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6689999999999998e-05 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315452+0000", 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0747000000000004e-05 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.595 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7703 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 143360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305078+0000", 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24578583700000001, 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010587665, 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.596 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7703 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305078+0000", 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305078+0000", 2024-09-05T17:30:55.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305078+0000", 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1399999999999997e-07 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305081+0000", 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4590000000000001e-06 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305088+0000", 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2509999999999997e-06 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305095+0000", 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3960000000000003e-06 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315488+0000", 2024-09-05T17:30:55.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010393489000000001 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315565+0000", 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6934999999999994e-05 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315665+0000", 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100521 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.600 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7704 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 143360~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305103+0000", 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.245760282, 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010771612, 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.601 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7704 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305103+0000", 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305103+0000", 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305104+0000", 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2899999999999999e-07 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305107+0000", 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7870000000000002e-06 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305114+0000", 2024-09-05T17:30:55.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9439999999999999e-06 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305119+0000", 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2650000000000004e-06 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315697+0000", 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010577764 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315777+0000", 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9975999999999995e-05 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315875+0000", 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8447000000000001e-05 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7709 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 0~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.605 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305154+0000", 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24570924299999999, 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010951705000000001, 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7709 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305154+0000", 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305154+0000", 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305155+0000", 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6800000000000001e-07 2024-09-05T17:30:55.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305158+0000", 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.005e-06 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305165+0000", 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8940000000000004e-06 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305171+0000", 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5760000000000002e-06 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315910+0000", 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010739115 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316002+0000", 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1280999999999996e-05 2024-09-05T17:30:55.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316106+0000", 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104366 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7710 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 438272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305180+0000", 2024-09-05T17:30:55.610 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24568395600000001, 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01116113, 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7710 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305180+0000", 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305180+0000", 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305180+0000", 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4199999999999996e-07 2024-09-05T17:30:55.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305182+0000", 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2630000000000002e-06 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305191+0000", 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3769999999999996e-06 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305196+0000", 2024-09-05T17:30:55.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8579999999999999e-06 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316139+0000", 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010943424 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316254+0000", 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011531600000000001 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316341+0000", 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6349999999999998e-05 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7739 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 176128~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305322+0000", 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24554178900000001, 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011254304, 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7739 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305322+0000", 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305322+0000", 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305322+0000", 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2e-07 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305325+0000", 2024-09-05T17:30:55.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305331+0000", 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6900000000000003e-06 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305337+0000", 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.198e-06 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316378+0000", 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011041057 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316473+0000", 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5660000000000002e-05 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316576+0000", 2024-09-05T17:30:55.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010275700000000001 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7740 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 172032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305344+0000", 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24551922500000001, 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0114254, 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.620 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7740 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305344+0000", 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305344+0000", 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305345+0000", 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8699999999999995e-07 2024-09-05T17:30:55.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305347+0000", 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305354+0000", 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:30:55.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305360+0000", 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4949999999999999e-06 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316605+0000", 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011245376 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316679+0000", 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4087999999999999e-05 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316770+0000", 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0673000000000004e-05 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.625 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7745 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 28672~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305392+0000", 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24547147999999999, 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011530832, 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.626 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7745 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305392+0000", 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305392+0000", 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305393+0000", 2024-09-05T17:30:55.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-07 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305395+0000", 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3520000000000001e-06 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305402+0000", 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8070000000000002e-06 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305409+0000", 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3440000000000003e-06 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316791+0000", 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011381657999999999 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316859+0000", 2024-09-05T17:30:55.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7794999999999997e-05 2024-09-05T17:30:55.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316923+0000", 2024-09-05T17:30:55.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4204999999999999e-05 2024-09-05T17:30:55.631 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.631 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.632 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.632 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7746 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.632 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305419+0000", 2024-09-05T17:30:55.632 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.245444995, 2024-09-05T17:30:55.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01164595, 2024-09-05T17:30:55.632 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7746 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305419+0000", 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305419+0000", 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305419+0000", 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1900000000000002e-07 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305422+0000", 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2649999999999999e-06 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305429+0000", 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2080000000000003e-06 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305434+0000", 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2639999999999999e-06 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316947+0000", 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011512952999999999 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317016+0000", 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9074999999999998e-05 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317065+0000", 2024-09-05T17:30:55.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8566000000000002e-05 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7775 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 204800~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305575+0000", 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.245289125, 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011635795000000001, 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.637 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7775 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305575+0000", 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305575+0000", 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305575+0000", 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0200000000000001e-07 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305578+0000", 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.689e-06 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305635+0000", 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7438000000000001e-05 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305643+0000", 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1829999999999997e-06 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317083+0000", 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011440943 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317140+0000", 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6604000000000002e-05 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317210+0000", 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0235999999999996e-05 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.641 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7776 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 204800~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305656+0000", 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.24520795300000001, 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011729293999999999, 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:55.642 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7776 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305656+0000", 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305656+0000", 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305656+0000", 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3399999999999999e-07 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305686+0000", 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9845999999999999e-05 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305696+0000", 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0091999999999999e-05 2024-09-05T17:30:55.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305703+0000", 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4559999999999997e-06 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317235+0000", 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011532396 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:55.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317294+0000", 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8967e-05 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317385+0000", 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0902999999999993e-05 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:55.646 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:55.647 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.648 INFO:teuthology.orchestra.run.smithi050.stdout:798 write 0x43b6f73 thru 0x43bc340 (0x53ce bytes) 2024-09-05T17:30:55.648 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.648 INFO:teuthology.orchestra.run.smithi050.stdout:801 punch from 0x53ad15b to 0x53b8d1b, (0xbbc0 bytes) 2024-09-05T17:30:55.648 INFO:teuthology.orchestra.run.smithi050.stdout:802 write 0x7b3074e thru 0x7b3962e (0x8ee1 bytes) 2024-09-05T17:30:55.648 INFO:teuthology.orchestra.run.smithi050.stdout:805 writesame 0xb3a291 thru 0xb442d3 data_size 0x1(0xa043 bytes) 2024-09-05T17:30:55.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:30:55.650 INFO:teuthology.orchestra.run.smithi050.stdout:807 write 0x1f64f35 thru 0x1f7437f (0xf44b bytes) 2024-09-05T17:30:55.650 INFO:teuthology.orchestra.run.smithi050.stdout:810 punch from 0x1eda1d to 0x1f6817, (0x8dfa bytes) 2024-09-05T17:30:55.650 INFO:teuthology.orchestra.run.smithi050.stdout:812 write 0xccb5c28 thru 0xccc0e50 (0xb229 bytes) 2024-09-05T17:30:55.650 INFO:teuthology.orchestra.run.smithi050.stdout:813 write 0x5cda8ff thru 0x5ce0f04 (0x6606 bytes) 2024-09-05T17:30:55.650 INFO:teuthology.orchestra.run.smithi050.stdout:truncating to largest ever: 0xed7adac 2024-09-05T17:30:55.650 INFO:teuthology.orchestra.run.smithi050.stdout:814 trunc from 0xda5a65c to 0xed7adac 2024-09-05T17:30:55.650 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:55.650 INFO:teuthology.orchestra.run.smithi050.stdout:817 clone 3 order 25 su 4194304 sc 8 2024-09-05T17:30:55.651 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:55.653+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:55.749 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:55.753+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:55.819 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:55.820 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:55.820 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:55.820 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:55.837 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:30:55.880 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:55.885+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:55.951 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:55.947+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:56.006 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:56.006 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:56.007 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:30:56.007 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:30:56.007 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:56.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:30:56.024 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone2 from 0xed7adac (overlap 0xa76ad8) to 0x3239a7 2024-09-05T17:30:56.051 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:56.051+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:56.152 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:56.157+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7511 3.0 3:04f3a5f1:::rbd_data.114070605229.0000000000000077:4 [read 380928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295214+0000", 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86603215600000005, 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015571801999999999, 2024-09-05T17:30:56.158 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7511 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295214+0000", 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295214+0000", 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295214+0000", 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9100000000000004e-07 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295217+0000", 2024-09-05T17:30:56.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5179999999999999e-06 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295224+0000", 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3010000000000001e-06 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295229+0000", 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.310542+0000", 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015312374 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.310673+0000", 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131414 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.310785+0000", 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000112194 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7530 3.0 3:02edcbe9:::rbd_data.114070605229.000000000000008a:4 [read 204800~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295276+0000", 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.865969659, 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015704605999999999, 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7530 2024-09-05T17:30:56.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295276+0000", 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295276+0000", 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295277+0000", 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6700000000000003e-07 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295288+0000", 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0852999999999999e-05 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295300+0000", 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021000000000001e-05 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295312+0000", 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2238999999999999e-05 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.310822+0000", 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015510352 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.310908+0000", 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5468000000000002e-05 2024-09-05T17:30:56.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.310981+0000", 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3106000000000001e-05 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7533 3.0 3:0121f9c2:::rbd_data.114070605229.000000000000008d:4 [read 204800~25251] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.167 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295371+0000", 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86587481300000002, 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015815005, 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7533 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295371+0000", 2024-09-05T17:30:56.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295371+0000", 2024-09-05T17:30:56.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295372+0000", 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295374+0000", 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6869999999999999e-06 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295391+0000", 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6623e-05 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295398+0000", 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3499999999999999e-06 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311010+0000", 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015611866 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311083+0000", 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3178999999999998e-05 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311186+0000", 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010268900000000001 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.172 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7556 3.0 3:04f3a5f1:::rbd_data.114070605229.0000000000000077:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295411+0000", 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86583495099999996, 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015973220999999999, 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7556 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295411+0000", 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295411+0000", 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295411+0000", 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7100000000000002e-07 2024-09-05T17:30:56.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295414+0000", 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6759999999999999e-06 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295421+0000", 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5360000000000004e-06 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295427+0000", 2024-09-05T17:30:56.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3170000000000001e-06 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311215+0000", 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015788683000000001 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311302+0000", 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6663999999999996e-05 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311384+0000", 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1873999999999996e-05 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7574 3.4 3:2498994f:::rbd_data.114070605229.0000000000000089:4 [read 233472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295435+0000", 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86581059000000005, 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015775058000000002, 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.177 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7574 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295435+0000", 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295435+0000", 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295436+0000", 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8699999999999995e-07 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295438+0000", 2024-09-05T17:30:56.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4169999999999999e-06 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295451+0000", 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3419e-05 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295468+0000", 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6195e-05 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.310561+0000", 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015093361 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.310673+0000", 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000112032 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311210+0000", 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00053714699999999997 2024-09-05T17:30:56.181 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7575 3.0 3:02edcbe9:::rbd_data.114070605229.000000000000008a:4 [read 233472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295478+0000", 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86576741499999998, 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016079877999999999, 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.182 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7575 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295478+0000", 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295478+0000", 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295479+0000", 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4099999999999999e-07 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295482+0000", 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0489999999999999e-06 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295490+0000", 2024-09-05T17:30:56.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0819999999999999e-06 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295496+0000", 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6030000000000004e-06 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311413+0000", 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015917563999999999 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311488+0000", 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4668999999999999e-05 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311558+0000", 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0370000000000006e-05 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7577 3.4 3:23b5ffb2:::rbd_data.114070605229.000000000000008c:4 [read 233472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295504+0000", 2024-09-05T17:30:56.186 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86574130000000005, 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016128822000000001, 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7577 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295504+0000", 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295504+0000", 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295505+0000", 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0600000000000001e-07 2024-09-05T17:30:56.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295508+0000", 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.666e-06 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295519+0000", 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1734e-05 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295525+0000", 2024-09-05T17:30:56.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5809999999999996e-06 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311400+0000", 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015875251 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311556+0000", 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000156071 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311633+0000", 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7113000000000005e-05 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7578 3.0 3:0121f9c2:::rbd_data.114070605229.000000000000008d:4 [read 233472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295536+0000", 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86570994800000001, 2024-09-05T17:30:56.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016202568000000001, 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7578 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295536+0000", 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295536+0000", 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295536+0000", 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7100000000000002e-07 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295539+0000", 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7939999999999998e-06 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295546+0000", 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7120000000000003e-06 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295551+0000", 2024-09-05T17:30:56.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2689999999999999e-06 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311590+0000", 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016038983999999999 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311671+0000", 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0945999999999994e-05 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311738+0000", 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7391999999999994e-05 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7601 3.0 3:04f3a5f1:::rbd_data.114070605229.0000000000000077:4 [read 438272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295560+0000", 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.865685963, 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016361935000000001, 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7601 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295560+0000", 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295560+0000", 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295560+0000", 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1600000000000002e-07 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295563+0000", 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.464e-06 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295570+0000", 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295575+0000", 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2129999999999999e-06 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311768+0000", 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016192683999999999 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311845+0000", 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6908000000000003e-05 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311922+0000", 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7050000000000003e-05 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7619 3.4 3:2498994f:::rbd_data.114070605229.0000000000000089:4 [read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295603+0000", 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.865642456, 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016202129999999999, 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7619 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295603+0000", 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295603+0000", 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295604+0000", 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7300000000000005e-07 2024-09-05T17:30:56.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295608+0000", 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.664e-06 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295617+0000", 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8519999999999993e-06 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295630+0000", 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3372e-05 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311663+0000", 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016033398000000001 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311741+0000", 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7643000000000002e-05 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311805+0000", 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4428e-05 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7620 3.0 3:02edcbe9:::rbd_data.114070605229.000000000000008a:4 [read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295640+0000", 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86560541899999999, 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016462286999999999, 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7620 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295640+0000", 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295640+0000", 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295641+0000", 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9900000000000001e-07 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295649+0000", 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8499999999999994e-06 2024-09-05T17:30:56.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295657+0000", 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0420000000000003e-06 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295662+0000", 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2429999999999996e-06 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311951+0000", 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016288745 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312033+0000", 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1833000000000001e-05 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312103+0000", 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0074999999999996e-05 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7622 3.4 3:23b5ffb2:::rbd_data.114070605229.000000000000008c:4 [read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295671+0000", 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86557429600000002, 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016303567000000001, 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7622 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.210 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295671+0000", 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295671+0000", 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295672+0000", 2024-09-05T17:30:56.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6600000000000002e-07 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295675+0000", 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8100000000000002e-06 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295681+0000", 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6409999999999996e-06 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295686+0000", 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7609999999999998e-06 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311834+0000", 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016147697999999999 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311911+0000", 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6960999999999997e-05 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311975+0000", 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.423e-05 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7623 3.0 3:0121f9c2:::rbd_data.114070605229.000000000000008d:4 [read 262144~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.295694+0000", 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86555179599999998, 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016588961999999999, 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.214 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7623 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295694+0000", 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295694+0000", 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295694+0000", 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295697+0000", 2024-09-05T17:30:56.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295703+0000", 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8390000000000001e-06 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.295711+0000", 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.187e-06 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312130+0000", 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016419869 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312211+0000", 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0464999999999996e-05 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312283+0000", 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1976000000000003e-05 2024-09-05T17:30:56.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7692 3.0 3:02edcbe9:::rbd_data.114070605229.000000000000008a:4 [read 319488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.299374+0000", 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86187151799999995, 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015769043, 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.219 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7692 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299374+0000", 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299374+0000", 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299375+0000", 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0400000000000002e-07 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299377+0000", 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5000000000000002e-06 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299384+0000", 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8430000000000004e-06 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299389+0000", 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9690000000000002e-06 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.313017+0000", 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013628482000000001 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.313101+0000", 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4047000000000004e-05 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315143+0000", 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020417980000000001 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7695 3.0 3:0121f9c2:::rbd_data.114070605229.000000000000008d:4 [read 319488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.223 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.299427+0000", 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86181895399999997, 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015938662999999999, 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7695 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299427+0000", 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299427+0000", 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299427+0000", 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4000000000000002e-07 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299430+0000", 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3470000000000001e-06 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299438+0000", 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0299999999999994e-06 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299452+0000", 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4122e-05 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315183+0000", 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015731396000000002 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315283+0000", 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9742999999999997e-05 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315365+0000", 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2584999999999996e-05 2024-09-05T17:30:56.227 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7728 3.0 3:02edcbe9:::rbd_data.114070605229.000000000000008a:4 [read 348160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.299481+0000", 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86176455299999999, 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016049840999999999, 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.228 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7728 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299481+0000", 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299481+0000", 2024-09-05T17:30:56.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299482+0000", 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1300000000000001e-07 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299492+0000", 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0380999999999999e-05 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299500+0000", 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7179999999999996e-06 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299505+0000", 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2379999999999997e-06 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315399+0000", 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015894031999999999 2024-09-05T17:30:56.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315460+0000", 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1388000000000002e-05 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315531+0000", 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0671000000000002e-05 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7731 3.0 3:0121f9c2:::rbd_data.114070605229.000000000000008d:4 [read 348160~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.299535+0000", 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86171079500000003, 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016111169000000002, 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7731 2024-09-05T17:30:56.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299535+0000", 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299535+0000", 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299535+0000", 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.34e-07 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299538+0000", 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2539999999999999e-06 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299544+0000", 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299550+0000", 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1050000000000003e-06 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315549+0000", 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.015999299000000002 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315597+0000", 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8112000000000003e-05 2024-09-05T17:30:56.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315646+0000", 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9160999999999999e-05 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7764 3.0 3:02edcbe9:::rbd_data.114070605229.000000000000008a:4 [read 380928~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.299590+0000", 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86165547600000003, 2024-09-05T17:30:56.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016224993, 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7764 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299590+0000", 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299590+0000", 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299591+0000", 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299593+0000", 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5469999999999999e-06 2024-09-05T17:30:56.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299600+0000", 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0339999999999999e-06 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299605+0000", 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.006e-06 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315674+0000", 2024-09-05T17:30:56.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016068195 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315746+0000", 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2564000000000005e-05 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315815+0000", 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9151000000000003e-05 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7766 3.4 3:23b5ffb2:::rbd_data.114070605229.000000000000008c:4 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.299614+0000", 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86163221899999998, 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.014121698, 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7766 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299614+0000", 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299614+0000", 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299614+0000", 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4900000000000001e-07 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299617+0000", 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5179999999999999e-06 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299624+0000", 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0180000000000004e-06 2024-09-05T17:30:56.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299629+0000", 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7370000000000003e-06 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.313443+0000", 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.013813706 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.313604+0000", 2024-09-05T17:30:56.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000161299 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.313735+0000", 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013097099999999999 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7767 3.0 3:0121f9c2:::rbd_data.114070605229.000000000000008d:4 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.299638+0000", 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.86160825399999996, 2024-09-05T17:30:56.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016359377000000001, 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7767 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299638+0000", 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:56.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299638+0000", 2024-09-05T17:30:56.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:56.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299638+0000", 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3099999999999998e-07 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299641+0000", 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5909999999999998e-06 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299648+0000", 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0829999999999998e-06 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.299653+0000", 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2449999999999998e-06 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315847+0000", 2024-09-05T17:30:56.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.016194130000000001 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315924+0000", 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7404000000000006e-05 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315997+0000", 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2492999999999999e-05 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.251 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.252 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.252 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:56.252 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:56.252 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:56.252 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:30:56.254 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:30:56.255 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-05T17:30:56.255 INFO:teuthology.orchestra.run.smithi050.stdout:819 read 0xe4e7616 thru 0xe4ead63 (0x374e bytes) 2024-09-05T17:30:56.255 INFO:teuthology.orchestra.run.smithi050.stdout:820 write 0xccf21f2 thru 0xccfc8a1 (0xa6b0 bytes) 2024-09-05T17:30:56.256 INFO:teuthology.orchestra.run.smithi050.stdout:821 writesame 0xbaf0d41 thru 0xbafeb72 data_size 0x22(0xde32 bytes) 2024-09-05T17:30:56.256 INFO:teuthology.orchestra.run.smithi050.stdout:822 read 0xd1785bd thru 0xd184bde (0xc622 bytes) 2024-09-05T17:30:56.256 INFO:teuthology.orchestra.run.smithi050.stdout:823 punch from 0x9c0d5fa to 0x9c12835, (0x523b bytes) 2024-09-05T17:30:56.256 INFO:teuthology.orchestra.run.smithi050.stdout:824 read 0xe879ec thru 0xe929b5 (0xafca bytes) 2024-09-05T17:30:56.256 INFO:teuthology.orchestra.run.smithi050.stdout:825 trunc from 0xed7adac to 0x33c3e3 2024-09-05T17:30:56.256 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:56.257+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:56.331 INFO:teuthology.orchestra.run.smithi050.stdout:826 write 0xc30ccb8 thru 0xc30e01e (0x1367 bytes) 2024-09-05T17:30:56.337 INFO:teuthology.orchestra.run.smithi050.stdout:827 trunc from 0xc30e01f to 0xa79e107 2024-09-05T17:30:56.353 INFO:teuthology.orchestra.run.smithi050.stdout:828 writesame 0x2d0d926 thru 0x2d123ac data_size 0x1(0x4a87 bytes) 2024-09-05T17:30:56.355 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:56.355+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:56.369 INFO:teuthology.orchestra.run.smithi050.stdout:829 trunc from 0xa79e107 to 0x880e545 2024-09-05T17:30:56.385 INFO:teuthology.orchestra.run.smithi050.stdout:831 write 0x2db1e76 thru 0x2dbc382 (0xa50d bytes) 2024-09-05T17:30:56.387 INFO:teuthology.orchestra.run.smithi050.stdout:833 write 0x789c156 thru 0x789e74e (0x25f9 bytes) 2024-09-05T17:30:56.395 INFO:teuthology.orchestra.run.smithi050.stdout:836 read 0x46f2fa5 thru 0x46f5b9c (0x2bf8 bytes) 2024-09-05T17:30:56.445 INFO:teuthology.orchestra.run.smithi050.stdout:837 punch from 0x3a323e7 to 0x3a3ad8f, (0x89a8 bytes) 2024-09-05T17:30:56.445 INFO:teuthology.orchestra.run.smithi050.stdout:838 punch from 0x31c0e0 to 0x32b813, (0xf733 bytes) 2024-09-05T17:30:56.445 INFO:teuthology.orchestra.run.smithi050.stdout:839 write 0x8621230 thru 0x862ba2a (0xa7fb bytes) 2024-09-05T17:30:56.446 INFO:teuthology.orchestra.run.smithi050.stdout:840 trunc from 0x880e545 to 0x2a78d75 2024-09-05T17:30:56.446 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:56.446 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:56.446 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:56.447 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:56.448 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:30:56.448 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:30:56.452 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:30:56.453 INFO:teuthology.orchestra.run.smithi050.stdout:841 writesame 0xe625063 thru 0xe62ad19 data_size 0x2f(0x5cb7 bytes) 2024-09-05T17:30:56.454 INFO:teuthology.orchestra.run.smithi050.stdout:842 writesame 0x4cdd824 thru 0x4ce3d20 data_size 0x1(0x64fd bytes) 2024-09-05T17:30:56.456 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:56.457+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:56.467 INFO:teuthology.orchestra.run.smithi050.stdout:843 write 0x376c653 thru 0x377669f (0xa04d bytes) 2024-09-05T17:30:56.469 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:30:56.470 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:30:56.474 INFO:teuthology.orchestra.run.smithi050.stdout:844 writesame 0xd02ffd1 thru 0xd0365ff data_size 0x25(0x662f bytes) 2024-09-05T17:30:56.482 INFO:teuthology.orchestra.run.smithi050.stdout:845 write 0x82b9d7 thru 0x837312 (0xb93c bytes) 2024-09-05T17:30:56.487 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:30:56.488 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:30:56.488 INFO:teuthology.orchestra.run.smithi050.stdout:847 write 0xc7066d9 thru 0xc70ad72 (0x469a bytes) 2024-09-05T17:30:56.491 INFO:teuthology.orchestra.run.smithi050.stdout:848 punch from 0xad84cc7 to 0xad90965, (0xbc9e bytes) 2024-09-05T17:30:56.491 INFO:teuthology.orchestra.run.smithi050.stdout:849 writesame 0x361120c thru 0x3620d7d data_size 0x52(0xfb72 bytes) 2024-09-05T17:30:56.494 INFO:teuthology.orchestra.run.smithi050.stdout:850 writesame 0xc62c155 thru 0xc63486a data_size 0x1(0x8716 bytes) 2024-09-05T17:30:56.505 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:30:56.505 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:30:56.526 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:30:56.526 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:30:56.538 INFO:teuthology.orchestra.run.smithi050.stdout:851 punch from 0x3ae2ad9 to 0x3aeefaf, (0xc4d6 bytes) 2024-09-05T17:30:56.539 INFO:teuthology.orchestra.run.smithi050.stdout:854 write 0xca406dc thru 0xca493ac (0x8cd1 bytes) 2024-09-05T17:30:56.541 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:56.541 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:56.541 INFO:teuthology.orchestra.run.smithi050.stdout:857 write 0xd4c69e6 thru 0xd4d689e (0xfeb9 bytes) 2024-09-05T17:30:56.544 INFO:teuthology.orchestra.run.smithi050.stdout:858 read 0xbf1f956 thru 0xbf2cf9c (0xd647 bytes) 2024-09-05T17:30:56.544 INFO:teuthology.orchestra.run.smithi050.stdout:861 writesame 0x202c32 thru 0x20f79d data_size 0x2f(0xcb6c bytes) 2024-09-05T17:30:56.548 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:30:56.548 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:30:56.557 INFO:teuthology.orchestra.run.smithi050.stdout:862 trunc from 0xe62ad1a to 0x8062c07 2024-09-05T17:30:56.557 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:56.561+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:56.571 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:30:56.572 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:30:56.572 INFO:teuthology.orchestra.run.smithi050.stdout:866 write 0x2b4946e thru 0x2b57520 (0xe0b3 bytes) 2024-09-05T17:30:56.574 INFO:teuthology.orchestra.run.smithi050.stdout:868 writesame 0x33c6267 thru 0x33c9293 data_size 0x1(0x302d bytes) 2024-09-05T17:30:56.580 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:56.580 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:56.580 INFO:teuthology.orchestra.run.smithi050.stdout:869 read 0x17d320b thru 0x17d6410 (0x3206 bytes) 2024-09-05T17:30:56.593 INFO:teuthology.orchestra.run.smithi050.stdout:870 write 0x8b7c3fb thru 0x8b884cc (0xc0d2 bytes) 2024-09-05T17:30:56.594 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:30:56.594 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:30:56.595 INFO:teuthology.orchestra.run.smithi050.stdout:871 clone 4 order 20 su 524288 sc 13 2024-09-05T17:30:56.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:30:56.661 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:56.665+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:56.759 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:56.755+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:56.775 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:56.775 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:56.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:30:56.860 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:56.859+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:56.914 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:56.914 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:56.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:30:56.961 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:56.959+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:57.023 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:30:57.055 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:57.055 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:57.058 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone3 from 0x8b884cd (overlap 0x33c3e3) to 0x0 2024-09-05T17:30:57.065 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:57.069+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:57.071 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:30:57.166 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:57.169+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:57.203 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-05T17:30:57.213 INFO:teuthology.orchestra.run.smithi050.stdout:872 writesame 0x841378b thru 0x841cc51 data_size 0x1(0x94c7 bytes) 2024-09-05T17:30:57.238 INFO:teuthology.orchestra.run.smithi050.stdout:873 write 0x77e7f12 thru 0x77eeaa1 (0x6b90 bytes) 2024-09-05T17:30:57.243 INFO:teuthology.orchestra.run.smithi050.stdout:874 clone 5 order 18 su 2048 sc 8 2024-09-05T17:30:57.250 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:57.251 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:57.268 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:30:57.308 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:57.313+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:57.371 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:57.373+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:57.399 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:57.399 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:57.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:30:57.473 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:57.477+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:57.485 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:30:57.548 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:57.548 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:57.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:30:57.607 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:57.607+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:57.638 INFO:teuthology.orchestra.run.smithi050.stdout:leaving image image_client.0-clone4 intact 2024-09-05T17:30:57.676 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:57.677+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:57.692 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:57.692 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:57.706 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:30:57.775 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:57.777+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:57.875 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:57.875 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:57.876 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:57.875+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:57.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:30:57.902 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-05T17:30:57.905 INFO:teuthology.orchestra.run.smithi050.stdout:875 read 0x595600a thru 0x5957462 (0x1459 bytes) 2024-09-05T17:30:57.907 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:57.907 INFO:teuthology.orchestra.run.smithi050.stdout:877 read 0x6ac45a8 thru 0x6acac5a (0x66b3 bytes) 2024-09-05T17:30:57.916 INFO:teuthology.orchestra.run.smithi050.stdout:878 punch from 0x49dda24 to 0x49de0ee, (0x6ca bytes) 2024-09-05T17:30:57.934 INFO:teuthology.orchestra.run.smithi050.stdout:880 trunc from 0x8b884cd to 0xd738bc7 2024-09-05T17:30:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:881 read 0x982dda5 thru 0x98350da (0x7336 bytes) 2024-09-05T17:30:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:883 punch from 0x10e5e32 to 0x10ede85, (0x8053 bytes) 2024-09-05T17:30:57.945 INFO:teuthology.orchestra.run.smithi050.stdout:884 read 0x31ee05a thru 0x31f55f9 (0x75a0 bytes) 2024-09-05T17:30:57.954 INFO:teuthology.orchestra.run.smithi050.stdout:886 writesame 0xbf10658 thru 0xbf1be76 data_size 0xb(0xb81f bytes) 2024-09-05T17:30:57.978 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:57.981+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:57.996 INFO:teuthology.orchestra.run.smithi050.stdout:887 trunc from 0xd738bc7 to 0x9fa5162 2024-09-05T17:30:58.001 INFO:teuthology.orchestra.run.smithi050.stdout:888 writesame 0xe7a0f2 thru 0xe7dd89 data_size 0x4(0x3c98 bytes) 2024-09-05T17:30:58.060 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:58.060 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:58.074 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:30:58.078 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:58.081+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:58.179 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:30:58.181+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:30:58.197 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:58.197 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:58.211 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:30:58.280 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:58.279+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:58.335 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:58.335 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:58.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:30:58.381 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:58.385+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:58.482 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:58.479+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:58.510 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:58.573 INFO:teuthology.orchestra.run.smithi050.stdout:890 writesame 0xc21d529 thru 0xc226f75 data_size 0x3(0x9a4d bytes) 2024-09-05T17:30:58.574 INFO:teuthology.orchestra.run.smithi050.stdout:892 write 0xaad1c03 thru 0xaad844f (0x684d bytes) 2024-09-05T17:30:58.574 INFO:teuthology.orchestra.run.smithi050.stdout:894 write 0x73f4e08 thru 0x73fd624 (0x881d bytes) 2024-09-05T17:30:58.574 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:58.574 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:58.575 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:30:58.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:30:58.616 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:58.615+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:58.684 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:58.685+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:58.753 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:58.753 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:58.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:30:58.795 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:30:58.795 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:30:58.796 INFO:teuthology.orchestra.run.smithi050.stdout:895 read 0x280a86e thru 0x28110e9 (0x687c bytes) 2024-09-05T17:30:58.804 INFO:teuthology.orchestra.run.smithi050.stdout:896 trunc from 0xc226f76 to 0x784ff28 2024-09-05T17:30:58.811 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:58.811+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:58.813 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:30:58.813 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:30:58.833 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:30:58.833 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:30:58.851 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:30:58.851 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:30:58.869 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:30:58.870 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:30:58.886 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:30:58.889+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:30:58.889 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:30:58.889 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:30:58.907 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:30:58.907 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:30:58.914 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:30:58.914 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:30:58.926 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:30:58.926 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:30:58.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:30:58.988 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:30:58.993+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:30:59.013 INFO:teuthology.orchestra.run.smithi050.stdout:899 write 0xbc5581e thru 0xbc573fb (0x1bde bytes) 2024-09-05T17:30:59.114 INFO:teuthology.orchestra.run.smithi050.stdout:900 writesame 0xea6a973 thru 0xea78f51 data_size 0x1(0xe5df bytes) 2024-09-05T17:30:59.114 INFO:teuthology.orchestra.run.smithi050.stdout:901 writesame 0x29fcd4d thru 0x2a09e9d data_size 0x7(0xd151 bytes) 2024-09-05T17:30:59.115 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:59.115 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:30:59.116 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:30:59.116 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:30:59.116 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:59.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:30:59.117 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:30:59.111+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:30:59.215 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:59.211+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:59.286 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.269721226000001, 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.287 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:30:59.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:30:59.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:30:59.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12645 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 13072384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.927136+0000", 2024-09-05T17:30:59.295 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.35943657400000001, 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043781948000000001, 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12645 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.296 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.927136+0000", 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.927136+0000", 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.934749+0000", 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0076135259999999998 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.934757+0000", 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7139999999999993e-06 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.934768+0000", 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1255e-05 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.934776+0000", 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1960000000000008e-06 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.970816+0000", 2024-09-05T17:30:59.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.036039984999999997 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.970867+0000", 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0302000000000001e-05 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.970918+0000", 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0970000000000002e-05 2024-09-05T17:30:59.300 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12686 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 13760512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.935383+0000", 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.35118892200000001, 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042820947999999998, 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.301 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12686 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.935383+0000", 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.935383+0000", 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.942665+0000", 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072816770000000003 2024-09-05T17:30:59.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.942668+0000", 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.937e-06 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.942675+0000", 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7410000000000003e-06 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.942679+0000", 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6310000000000002e-06 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.978038+0000", 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.035358392000000002 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.978123+0000", 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5439000000000006e-05 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.978204+0000", 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1131000000000006e-05 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12724 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14383104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.307 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943235+0000", 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34333714900000001, 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042956606000000001, 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12724 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.309 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943235+0000", 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943235+0000", 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943235+0000", 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943237+0000", 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943240+0000", 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.552e-06 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943243+0000", 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0599999999999999e-06 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986035+0000", 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042791795000000001 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986114+0000", 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9195000000000003e-05 2024-09-05T17:30:59.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986192+0000", 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7581000000000001e-05 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12725 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14399488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943247+0000", 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34332528800000001, 2024-09-05T17:30:59.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043146497999999998, 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12725 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943247+0000", 2024-09-05T17:30:59.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943247+0000", 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943247+0000", 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8299999999999998e-07 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943248+0000", 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.17e-06 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943254+0000", 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6280000000000002e-06 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943257+0000", 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1860000000000001e-06 2024-09-05T17:30:59.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986232+0000", 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042974525999999999 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986317+0000", 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4747999999999996e-05 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986394+0000", 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6957000000000002e-05 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12726 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14415872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943273+0000", 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34329902499999998, 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043317249000000002, 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.318 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12726 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943273+0000", 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943273+0000", 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943274+0000", 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0800000000000005e-07 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943279+0000", 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.648e-06 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943284+0000", 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3579999999999996e-06 2024-09-05T17:30:59.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943287+0000", 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2279999999999998e-06 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986432+0000", 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043145402999999999 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986511+0000", 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8577000000000003e-05 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986591+0000", 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9526999999999999e-05 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12727 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14432256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943292+0000", 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34328057200000001, 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043515229000000002, 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.324 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12727 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943292+0000", 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943292+0000", 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943292+0000", 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9400000000000001e-07 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943293+0000", 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.263e-06 2024-09-05T17:30:59.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943297+0000", 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5389999999999999e-06 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943300+0000", 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.066e-06 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986641+0000", 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043341478000000003 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986731+0000", 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9098000000000007e-05 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986807+0000", 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6390999999999994e-05 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12728 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14448640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943304+0000", 2024-09-05T17:30:59.329 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34326856900000002, 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043706710000000003, 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12728 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943304+0000", 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943304+0000", 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943304+0000", 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6600000000000003e-07 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943305+0000", 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.136e-06 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943309+0000", 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943312+0000", 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0089999999999999e-06 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986851+0000", 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043539841000000003 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986931+0000", 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9245000000000004e-05 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987010+0000", 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9739000000000003e-05 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12729 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14465024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943316+0000", 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34325676599999999, 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043882867999999998, 2024-09-05T17:30:59.335 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12729 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943316+0000", 2024-09-05T17:30:59.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943316+0000", 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943316+0000", 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7500000000000001e-07 2024-09-05T17:30:59.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943317+0000", 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.291e-06 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943321+0000", 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5240000000000001e-06 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943324+0000", 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1e-06 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987037+0000", 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043713230999999998 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987121+0000", 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4518999999999995e-05 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987198+0000", 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6928000000000006e-05 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12730 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14481408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943328+0000", 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34324475799999998, 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044080319999999999, 2024-09-05T17:30:59.340 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12730 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943328+0000", 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943328+0000", 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943328+0000", 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943329+0000", 2024-09-05T17:30:59.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943332+0000", 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.478e-06 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943335+0000", 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0580000000000002e-06 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987245+0000", 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043909721999999998 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987327+0000", 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2224000000000004e-05 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987408+0000", 2024-09-05T17:30:59.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0432999999999994e-05 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12731 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14497792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943339+0000", 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34323295500000001, 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044291170999999997, 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12731 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943339+0000", 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943339+0000", 2024-09-05T17:30:59.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943340+0000", 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6399999999999998e-07 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943341+0000", 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943344+0000", 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4920000000000002e-06 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943347+0000", 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2329999999999998e-06 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987460+0000", 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044112871999999997 2024-09-05T17:30:59.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987551+0000", 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0447999999999999e-05 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987631+0000", 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9784999999999996e-05 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.349 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12732 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14514176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943351+0000", 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34322103100000001, 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044489571999999998, 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12732 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943351+0000", 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943351+0000", 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943352+0000", 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6e-07 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943353+0000", 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.314e-06 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943356+0000", 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.478e-06 2024-09-05T17:30:59.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943359+0000", 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0910000000000001e-06 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987675+0000", 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044315977999999999 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987761+0000", 2024-09-05T17:30:59.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5308000000000004e-05 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987841+0000", 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0142999999999995e-05 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.354 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12733 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14530560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943363+0000", 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34320911599999998, 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044690949000000001, 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12733 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.355 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943363+0000", 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943363+0000", 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943363+0000", 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943365+0000", 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1209999999999999e-06 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943368+0000", 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4800000000000001e-06 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943371+0000", 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.016e-06 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987890+0000", 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044518580000000002 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987975+0000", 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5035000000000002e-05 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988054+0000", 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9456000000000006e-05 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12734 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14563328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943375+0000", 2024-09-05T17:30:59.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34319739500000002, 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044887950000000003, 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12734 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943375+0000", 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943375+0000", 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943375+0000", 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7099999999999998e-07 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943376+0000", 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943380+0000", 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.433e-06 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943383+0000", 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1439999999999999e-06 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988098+0000", 2024-09-05T17:30:59.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044714853999999998 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988181+0000", 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2750999999999994e-05 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988263+0000", 2024-09-05T17:30:59.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2262999999999995e-05 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12735 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14546944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943387+0000", 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34318535300000003, 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045087815000000003, 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12735 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943387+0000", 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943387+0000", 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943387+0000", 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6e-07 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943388+0000", 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.22e-06 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943392+0000", 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.439e-06 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943395+0000", 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9950000000000001e-06 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988313+0000", 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044918538000000001 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988400+0000", 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6216000000000003e-05 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988475+0000", 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5147000000000004e-05 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12736 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14579712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943399+0000", 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34317370200000002, 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045283557000000002, 2024-09-05T17:30:59.371 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12736 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943399+0000", 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943399+0000", 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943399+0000", 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6300000000000001e-07 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943400+0000", 2024-09-05T17:30:59.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2470000000000001e-06 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943404+0000", 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4800000000000001e-06 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943407+0000", 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.039e-06 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988518+0000", 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045111142 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988600+0000", 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1987e-05 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988682+0000", 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2398999999999995e-05 2024-09-05T17:30:59.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12737 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14612480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943411+0000", 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34316169400000002, 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045484793000000003, 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12737 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943411+0000", 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943411+0000", 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943411+0000", 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943412+0000", 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2330000000000001e-06 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943416+0000", 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4819999999999999e-06 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943419+0000", 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8519999999999997e-06 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988729+0000", 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045309508999999998 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988816+0000", 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988895+0000", 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9698999999999997e-05 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12738 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14596096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943423+0000", 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34314889399999998, 2024-09-05T17:30:59.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045686732000000001, 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12738 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943423+0000", 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943423+0000", 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943424+0000", 2024-09-05T17:30:59.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8799999999999998e-07 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943428+0000", 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2590000000000002e-06 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943432+0000", 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0489999999999997e-06 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943435+0000", 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.095e-06 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988938+0000", 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045502948000000001 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989022+0000", 2024-09-05T17:30:59.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4017999999999994e-05 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989110+0000", 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8075e-05 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12739 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14628864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.386 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943453+0000", 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.343119273, 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045863226, 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12739 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.387 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943453+0000", 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943453+0000", 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943453+0000", 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.72e-07 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943455+0000", 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4470000000000001e-06 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943459+0000", 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0110000000000002e-06 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943462+0000", 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0900000000000001e-06 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989159+0000", 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045696579000000001 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989243+0000", 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4039e-05 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989316+0000", 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3688000000000003e-05 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12740 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14645248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943466+0000", 2024-09-05T17:30:59.392 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.34310586799999998, 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.046056694000000002, 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12740 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943466+0000", 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943466+0000", 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:30:59.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.950624+0000", 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071575809999999997 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.950629+0000", 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7979999999999996e-06 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.950645+0000", 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.950652+0000", 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3749999999999999e-06 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989359+0000", 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038707631999999999 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989441+0000", 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1532999999999993e-05 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:30:59.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989523+0000", 2024-09-05T17:30:59.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2253e-05 2024-09-05T17:30:59.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.398 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:30:59.398 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:30:59.398 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:30:59.400 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:30:59.400 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:59.401+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:59.501 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:30:59.505+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:30:59.512 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:30:59.561 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:59.561 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:59.561 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:30:59.561 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:59.583 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:30:59.602 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:30:59.599+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:30:59.697 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:30:59.697 INFO:teuthology.orchestra.run.smithi050.stdout:907 writesame 0xd8be238 thru 0xd8c9dc1 data_size 0x5(0xbb8a bytes) 2024-09-05T17:30:59.703 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:30:59.699+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:30:59.721 INFO:teuthology.orchestra.run.smithi050.stdout:908 writesame 0x8962b64 thru 0x896d212 data_size 0x1(0xa6af bytes) 2024-09-05T17:30:59.726 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:59.726 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:30:59.726 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:30:59.726 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:30:59.727 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:30:59.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:30:59.750 INFO:teuthology.orchestra.run.smithi050.stdout:910 write 0x4dba154 thru 0x4dbbb5b (0x1a08 bytes) 2024-09-05T17:30:59.805 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:30:59.803+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:30:59.865 INFO:teuthology.orchestra.run.smithi050.stdout:911 writesame 0x40e6807 thru 0x40ef322 data_size 0x3a(0x8b1c bytes) 2024-09-05T17:30:59.893 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7519 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 290816~20480] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301026+0000", 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5965360139999998, 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010346835, 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7519 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301026+0000", 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301026+0000", 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301027+0000", 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9700000000000002e-07 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301029+0000", 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3020000000000002e-06 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301036+0000", 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8730000000000001e-06 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301041+0000", 2024-09-05T17:30:59.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4210000000000003e-06 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311013+0000", 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0099715289999999998 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311098+0000", 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4920999999999996e-05 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311373+0000", 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027539200000000001 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7546 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 28672~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301131+0000", 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5964311609999999, 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010499534, 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.899 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7546 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301131+0000", 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301131+0000", 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301132+0000", 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1800000000000001e-07 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301134+0000", 2024-09-05T17:30:59.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1919999999999999e-06 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301141+0000", 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1350000000000003e-06 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301147+0000", 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.127e-06 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311452+0000", 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010305293 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311539+0000", 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7020000000000004e-05 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311631+0000", 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1348999999999996e-05 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.903 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7547 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301155+0000", 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5964074420000003, 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010665202, 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.904 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7547 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301155+0000", 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301155+0000", 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301155+0000", 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3799999999999998e-07 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301158+0000", 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2299999999999998e-06 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301164+0000", 2024-09-05T17:30:59.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4629999999999998e-06 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301169+0000", 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1739999999999999e-06 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311661+0000", 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010492041000000001 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311741+0000", 2024-09-05T17:30:59.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0061000000000005e-05 2024-09-05T17:30:59.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311820+0000", 2024-09-05T17:30:59.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8794999999999994e-05 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7548 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 28672~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301176+0000", 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5963858970000002, 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010908446, 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.909 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7548 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301176+0000", 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301176+0000", 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301177+0000", 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.34e-07 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301180+0000", 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6389999999999998e-06 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301188+0000", 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6569999999999997e-06 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301194+0000", 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4e-06 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311849+0000", 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010655181 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.311994+0000", 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014485499999999999 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312085+0000", 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1279999999999993e-05 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.913 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.914 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7549 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.914 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.301201+0000", 2024-09-05T17:30:59.915 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5963612170000001, 2024-09-05T17:30:59.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011064842, 2024-09-05T17:30:59.915 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.915 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.915 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.915 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.916 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.916 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.916 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7549 2024-09-05T17:30:59.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.916 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301201+0000", 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301201+0000", 2024-09-05T17:30:59.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301202+0000", 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3300000000000002e-07 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301204+0000", 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5830000000000001e-06 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301212+0000", 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9629999999999998e-06 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.301218+0000", 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4550000000000003e-06 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312117+0000", 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010898901000000001 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312196+0000", 2024-09-05T17:30:59.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9093999999999999e-05 2024-09-05T17:30:59.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312266+0000", 2024-09-05T17:30:59.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0213e-05 2024-09-05T17:30:59.921 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.921 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.921 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.921 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7564 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 323584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.921 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.302090+0000", 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5954726390000005, 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010359024, 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.922 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7564 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302090+0000", 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302090+0000", 2024-09-05T17:30:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302090+0000", 2024-09-05T17:30:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:30:59.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302093+0000", 2024-09-05T17:30:59.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.129e-06 2024-09-05T17:30:59.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302102+0000", 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0299999999999999e-06 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302258+0000", 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015550699999999999 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312297+0000", 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010039467 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312377+0000", 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9429000000000001e-05 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312449+0000", 2024-09-05T17:30:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1891999999999995e-05 2024-09-05T17:30:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.929 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7593 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 57344~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.929 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.302656+0000", 2024-09-05T17:30:59.929 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5949059769999998, 2024-09-05T17:30:59.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010379449000000001, 2024-09-05T17:30:59.929 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.929 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.929 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.930 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.930 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.930 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7593 2024-09-05T17:30:59.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.930 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302656+0000", 2024-09-05T17:30:59.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302656+0000", 2024-09-05T17:30:59.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302657+0000", 2024-09-05T17:30:59.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8100000000000003e-07 2024-09-05T17:30:59.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.302660+0000", 2024-09-05T17:30:59.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.807e-06 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304343+0000", 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016837060000000001 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304357+0000", 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3926e-05 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312862+0000", 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0085051039999999994 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.312946+0000", 2024-09-05T17:30:59.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3416000000000002e-05 2024-09-05T17:30:59.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.313036+0000", 2024-09-05T17:30:59.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0008999999999998e-05 2024-09-05T17:30:59.935 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.935 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7668 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 114688~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.304872+0000", 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5926900650000002, 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010367609, 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.936 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7668 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304872+0000", 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304872+0000", 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304873+0000", 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7100000000000002e-07 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304875+0000", 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4229999999999999e-06 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304882+0000", 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6959999999999999e-06 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304887+0000", 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9729999999999997e-06 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315037+0000", 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010149816000000001 2024-09-05T17:30:59.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315128+0000", 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1172000000000001e-05 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315240+0000", 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000111958 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7681 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.304967+0000", 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5925955380000003, 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010485382, 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7681 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.941 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304967+0000", 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304967+0000", 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304967+0000", 2024-09-05T17:30:59.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6199999999999998e-07 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304978+0000", 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0621999999999999e-05 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304986+0000", 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0960000000000001e-06 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.304992+0000", 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315275+0000", 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010282754 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315361+0000", 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6689999999999998e-05 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315452+0000", 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0747000000000004e-05 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7703 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 143360~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305078+0000", 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5924845000000003, 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010587665, 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.945 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7703 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305078+0000", 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305078+0000", 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305078+0000", 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1399999999999997e-07 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305081+0000", 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4590000000000001e-06 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305088+0000", 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2509999999999997e-06 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305095+0000", 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3960000000000003e-06 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315488+0000", 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010393489000000001 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315565+0000", 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6934999999999994e-05 2024-09-05T17:30:59.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315665+0000", 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000100521 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7704 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 143360~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305103+0000", 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5924589449999997, 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010771612, 2024-09-05T17:30:59.950 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7704 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305103+0000", 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305103+0000", 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305104+0000", 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2899999999999999e-07 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305107+0000", 2024-09-05T17:30:59.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7870000000000002e-06 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305114+0000", 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9439999999999999e-06 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305119+0000", 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2650000000000004e-06 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315697+0000", 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010577764 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315777+0000", 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9975999999999995e-05 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315875+0000", 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8447000000000001e-05 2024-09-05T17:30:59.954 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7709 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 0~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305154+0000", 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.592407906, 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010951705000000001, 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.955 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7709 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305154+0000", 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305154+0000", 2024-09-05T17:30:59.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305155+0000", 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6800000000000001e-07 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305158+0000", 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.005e-06 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305165+0000", 2024-09-05T17:30:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8940000000000004e-06 2024-09-05T17:30:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305171+0000", 2024-09-05T17:30:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5760000000000002e-06 2024-09-05T17:30:59.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.315910+0000", 2024-09-05T17:30:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010739115 2024-09-05T17:30:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316002+0000", 2024-09-05T17:30:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1280999999999996e-05 2024-09-05T17:30:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316106+0000", 2024-09-05T17:30:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000104366 2024-09-05T17:30:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7710 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 438272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305180+0000", 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5923826190000003, 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01116113, 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7710 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305180+0000", 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305180+0000", 2024-09-05T17:30:59.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305180+0000", 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4199999999999996e-07 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305182+0000", 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2630000000000002e-06 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305191+0000", 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3769999999999996e-06 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305196+0000", 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8579999999999999e-06 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316139+0000", 2024-09-05T17:30:59.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010943424 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316254+0000", 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011531600000000001 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316341+0000", 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6349999999999998e-05 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7739 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 176128~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305322+0000", 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5922404520000004, 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011254304, 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7739 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305322+0000", 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305322+0000", 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305322+0000", 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2e-07 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305325+0000", 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305331+0000", 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6900000000000003e-06 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305337+0000", 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.198e-06 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316378+0000", 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011041057 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316473+0000", 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5660000000000002e-05 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316576+0000", 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010275700000000001 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7740 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 172032~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305344+0000", 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5922178880000004, 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0114254, 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7740 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305344+0000", 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305344+0000", 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305345+0000", 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8699999999999995e-07 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305347+0000", 2024-09-05T17:30:59.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305354+0000", 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305360+0000", 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4949999999999999e-06 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316605+0000", 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011245376 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316679+0000", 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4087999999999999e-05 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316770+0000", 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0673000000000004e-05 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7745 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 28672~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305392+0000", 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5921701429999997, 2024-09-05T17:30:59.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011530832, 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7745 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305392+0000", 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305392+0000", 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305393+0000", 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-07 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305395+0000", 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3520000000000001e-06 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305402+0000", 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8070000000000002e-06 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305409+0000", 2024-09-05T17:30:59.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3440000000000003e-06 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316791+0000", 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011381657999999999 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316859+0000", 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7794999999999997e-05 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316923+0000", 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4204999999999999e-05 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7746 3.12 3:48aff0e6:::rbd_data.114070605229.000000000000007f:4 [read 466944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305419+0000", 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5921436580000004, 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.01164595, 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7746 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305419+0000", 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305419+0000", 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305419+0000", 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1900000000000002e-07 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305422+0000", 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2649999999999999e-06 2024-09-05T17:30:59.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305429+0000", 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2080000000000003e-06 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305434+0000", 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2639999999999999e-06 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.316947+0000", 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011512952999999999 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317016+0000", 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9074999999999998e-05 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317065+0000", 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8566000000000002e-05 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.986 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7775 3.12 3:4e9aed2d:::rbd_data.114070605229.000000000000009e:4 [read 204800~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305575+0000", 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.591987788, 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011635795000000001, 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7775 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305575+0000", 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305575+0000", 2024-09-05T17:30:59.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305575+0000", 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0200000000000001e-07 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305578+0000", 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.689e-06 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305635+0000", 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7438000000000001e-05 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305643+0000", 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1829999999999997e-06 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317083+0000", 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011440943 2024-09-05T17:30:59.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317140+0000", 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6604000000000002e-05 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317210+0000", 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0235999999999996e-05 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:7776 3.12 3:4ab03268:::rbd_data.114070605229.000000000000009f:4 [read 204800~28672] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.305656+0000", 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5919066160000002, 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011729293999999999, 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 7776 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.992 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305656+0000", 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305656+0000", 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305656+0000", 2024-09-05T17:30:59.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3399999999999999e-07 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305686+0000", 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9845999999999999e-05 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305696+0000", 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0091999999999999e-05 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.305703+0000", 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4559999999999997e-06 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317235+0000", 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011532396 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317294+0000", 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8967e-05 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.317385+0000", 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0902999999999993e-05 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:8542 3.1 3:841dbd93:::rbd_header.1140d4ae3aec:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.892006+0000", 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.0055563120000004, 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010374283999999999, 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:30:59.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 8542 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.892006+0000", 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:30:59.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.892006+0000", 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.892009+0000", 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.067e-06 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.892020+0000", 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1009000000000001e-05 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.892046+0000", 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5452e-05 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.892058+0000", 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2864000000000001e-05 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.892141+0000", 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2678999999999999e-05 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:30:59.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.892147+0000", 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9120000000000003e-06 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.899636+0000", 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074893859999999998 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.899715+0000", 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8460000000000004e-05 2024-09-05T17:31:00.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4", 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.900159+0000", 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044442800000000002 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.900830+0000", 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00067097299999999995 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.902318+0000", 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014878739999999999 2024-09-05T17:31:00.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.902353+0000", 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5089999999999998e-05 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.902380+0000", 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.709e-05 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.002 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.003 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:00.004 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:00.004 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:00.005+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:00.070 INFO:teuthology.orchestra.run.smithi050.stdout:912 read 0xcbe2f65 thru 0xcbebb73 (0x8c0f bytes) 2024-09-05T17:31:00.070 INFO:teuthology.orchestra.run.smithi050.stdout:913 read 0x9e36e71 thru 0x9e39dd3 (0x2f63 bytes) 2024-09-05T17:31:00.070 INFO:teuthology.orchestra.run.smithi050.stdout:914 write 0x237b0be thru 0x2382c4a (0x7b8d bytes) 2024-09-05T17:31:00.105 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:00.103+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:00.205 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:00.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:00.205 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:00.205 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:00.206 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:00.203+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:00.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:00.292 INFO:teuthology.orchestra.run.smithi050.stdout:915 punch from 0x3fe3512 to 0x3fe477a, (0x1268 bytes) 2024-09-05T17:31:00.292 INFO:teuthology.orchestra.run.smithi050.stdout:916 read 0x6a53ee0 thru 0x6a62c4e (0xed6f bytes) 2024-09-05T17:31:00.297 INFO:teuthology.orchestra.run.smithi050.stdout:917 read 0x2e99149 thru 0x2e9f281 (0x6139 bytes) 2024-09-05T17:31:00.300 INFO:teuthology.orchestra.run.smithi050.stdout:918 read 0x67f52fc thru 0x67fa26d (0x4f72 bytes) 2024-09-05T17:31:00.307 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:00.307+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:00.315 INFO:teuthology.orchestra.run.smithi050.stdout:919 trunc from 0xea78f52 to 0x84d2399 2024-09-05T17:31:00.343 INFO:teuthology.orchestra.run.smithi050.stdout:920 trunc from 0x84d2399 to 0x82af3de 2024-09-05T17:31:00.355 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:00.355 INFO:teuthology.orchestra.run.smithi050.stdout:922 read 0x1478cd1 thru 0x148202c (0x935c bytes) 2024-09-05T17:31:00.360 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:00.360 INFO:teuthology.orchestra.run.smithi050.stdout:926 punch from 0x2b2ef0c to 0x2b34712, (0x5806 bytes) 2024-09-05T17:31:00.361 INFO:teuthology.orchestra.run.smithi050.stdout:927 writesame 0x81efe26 thru 0x81fc934 data_size 0x1(0xcb0f bytes) 2024-09-05T17:31:00.392 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:00.392 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:00.393 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:00.393 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:00.393 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:00.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:00.408 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:00.407+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:00.423 INFO:teuthology.orchestra.run.smithi050.stdout:928 write 0xc59ec82 thru 0xc5ab228 (0xc5a7 bytes) 2024-09-05T17:31:00.446 INFO:teuthology.orchestra.run.smithi050.stdout:929 punch from 0xb0720ea to 0xb07ea33, (0xc949 bytes) 2024-09-05T17:31:00.447 INFO:teuthology.orchestra.run.smithi050.stdout:931 writesame 0x4f0e6d0 thru 0x4f10bbe data_size 0x1f(0x24ef bytes) 2024-09-05T17:31:00.493 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:31:00.509 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:00.513+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:00.531 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:00.531 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:00.531 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-05T17:31:00.531 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-05T17:31:00.565 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15042 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8564736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80653123900000001, 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054711072999999999, 2024-09-05T17:31:00.566 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15042 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763434+0000", 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3910000000000001e-06 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763441+0000", 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1130000000000003e-06 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763449+0000", 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4059999999999999e-06 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.817943+0000", 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054494611999999998 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818037+0000", 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3430999999999994e-05 2024-09-05T17:31:00.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818143+0000", 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010574 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15043 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8581120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80650648400000002, 2024-09-05T17:31:00.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054839756000000003, 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15043 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763457+0000", 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9700000000000002e-07 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763459+0000", 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2079999999999999e-06 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763466+0000", 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4869999999999996e-06 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763472+0000", 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4099999999999999e-06 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818179+0000", 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054706751999999997 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818235+0000", 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6433e-05 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818296+0000", 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1068999999999994e-05 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15044 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8597504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80648313199999999, 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055068822000000003, 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.576 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15044 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763482+0000", 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3120000000000001e-06 2024-09-05T17:31:00.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763489+0000", 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8020000000000003e-06 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763494+0000", 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.276e-06 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818342+0000", 2024-09-05T17:31:00.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054847104000000001 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818431+0000", 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9835999999999998e-05 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818548+0000", 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011708499999999999 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15045 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8613888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80646087899999996, 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055286647000000001, 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.581 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15045 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763505+0000", 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763511+0000", 2024-09-05T17:31:00.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.533e-06 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763517+0000", 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3979999999999998e-06 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818594+0000", 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055077706999999997 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818679+0000", 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4797999999999997e-05 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818789+0000", 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109369 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.585 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15046 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8630272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80642401799999996, 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055492107999999998, 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.586 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15046 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5699999999999998e-07 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763542+0000", 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6860000000000002e-06 2024-09-05T17:31:00.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763550+0000", 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9859999999999994e-06 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763556+0000", 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0610000000000001e-06 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818833+0000", 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055276618 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818932+0000", 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9474000000000003e-05 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819031+0000", 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8826000000000006e-05 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.590 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15047 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8646656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80639774099999995, 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055685474999999998, 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.591 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15047 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763566+0000", 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763568+0000", 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7049999999999999e-06 2024-09-05T17:31:00.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763576+0000", 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6340000000000001e-06 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763581+0000", 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.519e-06 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819078+0000", 2024-09-05T17:31:00.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055496668999999998 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819175+0000", 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6883000000000001e-05 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819250+0000", 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5462000000000004e-05 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15048 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8663040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80637282399999999, 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055952927999999999, 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.596 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15048 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3599999999999999e-07 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763593+0000", 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6589999999999999e-06 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763600+0000", 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0879999999999997e-06 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763607+0000", 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6649999999999997e-06 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819308+0000", 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055701181000000002 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819418+0000", 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109755 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819543+0000", 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012514399999999999 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15049 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8679424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80634780800000005, 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056101897999999997, 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15049 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:00.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.63e-07 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763618+0000", 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5959999999999998e-06 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763625+0000", 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9879999999999998e-06 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763631+0000", 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6069999999999998e-06 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819610+0000", 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055979244999999997 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819655+0000", 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5488999999999998e-05 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819717+0000", 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1509999999999999e-05 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15050 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8695808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80631949700000005, 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056583593000000001, 2024-09-05T17:31:00.605 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15050 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763644+0000", 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2600000000000002e-07 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763647+0000", 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:31:00.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763654+0000", 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0119999999999999e-06 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763659+0000", 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639999999999997e-06 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819747+0000", 2024-09-05T17:31:00.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056088302 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820111+0000", 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036350299999999999 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820227+0000", 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011605 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.609 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15051 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8712192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80629561199999999, 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056866834999999998, 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15051 2024-09-05T17:31:00.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763668+0000", 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7899999999999999e-07 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763670+0000", 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3580000000000001e-06 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763677+0000", 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9809999999999997e-06 2024-09-05T17:31:00.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763682+0000", 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3499999999999996e-06 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820263+0000", 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056581285000000002 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820427+0000", 2024-09-05T17:31:00.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016371100000000001 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820534+0000", 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106771 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15052 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8728576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:00.614 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80627307100000001, 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057071953000000002, 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15052 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:00.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9099999999999999e-07 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763692+0000", 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.092e-06 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763699+0000", 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5470000000000002e-06 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763704+0000", 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1039999999999998e-06 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820568+0000", 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056863805000000003 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820665+0000", 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7090999999999996e-05 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820762+0000", 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6922999999999993e-05 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.619 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15053 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8744960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80625107799999995, 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057269911999999999, 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15053 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763714+0000", 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3489999999999999e-06 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763721+0000", 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3119999999999999e-06 2024-09-05T17:31:00.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763725+0000", 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.741e-06 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820794+0000", 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057069021999999997 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820883+0000", 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8739999999999994e-05 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820982+0000", 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8368000000000004e-05 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.624 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15054 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8761344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80622821899999997, 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057438612999999999, 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.625 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15054 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2e-07 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763737+0000", 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4140000000000001e-06 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763744+0000", 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8279999999999997e-06 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763755+0000", 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1126e-05 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821013+0000", 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057257844000000002 2024-09-05T17:31:00.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821087+0000", 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3651000000000003e-05 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821173+0000", 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6329999999999995e-05 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15055 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8777728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80620062000000003, 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.05769469, 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15055 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.630 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763763+0000", 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0600000000000001e-07 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763765+0000", 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.12e-06 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763770+0000", 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8209999999999998e-06 2024-09-05T17:31:00.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763777+0000", 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999999e-06 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821205+0000", 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057428078 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821292+0000", 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6842000000000006e-05 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821457+0000", 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016531299999999999 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15056 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8794112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.634 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80617877000000004, 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057974700999999997, 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15056 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:31:00.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763786+0000", 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1229999999999998e-06 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763794+0000", 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1590000000000004e-06 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763799+0000", 2024-09-05T17:31:00.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9309999999999999e-06 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821490+0000", 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057691872999999998 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821616+0000", 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125327 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821759+0000", 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014289500000000001 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15057 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8810496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80615716699999995, 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058215998999999997, 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.639 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15057 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4300000000000003e-07 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763808+0000", 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0379999999999998e-06 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763816+0000", 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763821+0000", 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0429999999999998e-06 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821799+0000", 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057977385999999999 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821909+0000", 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110801 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822022+0000", 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000112185 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.643 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15058 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8826880~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.80611889000000003, 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058413768999999997, 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15058 2024-09-05T17:31:00.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770678+0000", 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068342020000000002 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770685+0000", 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.063e-06 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770696+0000", 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1225e-05 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770704+0000", 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3880000000000002e-06 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822073+0000", 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.051369608999999997 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822153+0000", 2024-09-05T17:31:00.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9225000000000001e-05 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822258+0000", 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010505699999999999 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15079 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9170944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:00.648 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.79898190899999999, 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054753171000000003, 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15079 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:00.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7500000000000001e-07 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770982+0000", 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770986+0000", 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.225e-06 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770989+0000", 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825631+0000", 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054642257999999999 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825680+0000", 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9026000000000001e-05 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825734+0000", 2024-09-05T17:31:00.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4218000000000002e-05 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15080 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9187328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.79895305999999999, 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054872632999999997, 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.653 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15080 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8599999999999999e-07 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771012+0000", 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.57e-06 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771016+0000", 2024-09-05T17:31:00.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1919999999999998e-06 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771019+0000", 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0790000000000001e-06 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825770+0000", 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054750974000000001 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825820+0000", 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9873999999999997e-05 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825882+0000", 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2558000000000007e-05 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.657 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15081 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9203712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.79892987000000004, 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054991252999999997, 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15081 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:00.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778817+0000", 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077838489999999998 2024-09-05T17:31:00.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778822+0000", 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9910000000000002e-06 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778831+0000", 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2089999999999994e-06 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:00.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778837+0000", 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8289999999999996e-06 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825928+0000", 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047091230999999997 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825972+0000", 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3964000000000001e-05 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.826024+0000", 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2179999999999998e-05 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.662 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:00.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:00.664 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:00.665+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:00.764 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:00.763+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:00.807 INFO:teuthology.orchestra.run.smithi050.stdout:933 read 0x21b0958 thru 0x21b9145 (0x87ee bytes) 2024-09-05T17:31:00.811 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:00.812 INFO:teuthology.orchestra.run.smithi050.stdout:937 trunc from 0xc5ab229 to 0xd3bee75 2024-09-05T17:31:00.825 INFO:teuthology.orchestra.run.smithi050.stdout:938 punch from 0x8049a79 to 0x804e54e, (0x4ad5 bytes) 2024-09-05T17:31:00.825 INFO:teuthology.orchestra.run.smithi050.stdout:939 write 0x6233a48 thru 0x62401b5 (0xc76e bytes) 2024-09-05T17:31:00.849 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:00.849 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:00.849 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:00.849 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:00.865 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:00.869+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:00.866 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:00.944 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:00.953 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 34, 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "229efc05-fdc4-4e1f-8246-413b49f3eeda", 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2024-09-05T17:30:12.762369+0000", 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2024-09-05T17:31:00.487317+0000", 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2024-09-05T17:30:23.981355+0000", 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2024-09-05T17:30:15.006059+0000", 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5804032, 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "nodeep-scrub", 2024-09-05T17:31:00.954 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 5, 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.94999998807907104, 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 3, 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "jewel", 2024-09-05T17:31:00.955 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "squid", 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:25.818485+0000", 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:00.956 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:00.957 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "18", 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:00.958 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:00.959 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:00.960 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:00.961 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2024-09-05T17:31:00.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.962 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:00.962 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:00.962 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2024-09-05T17:31:00.962 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2024-09-05T17:31:00.962 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2024-09-05T17:31:00.962 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2024-09-05T17:31:00.963 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2024-09-05T17:31:00.963 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:31:00.963 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:31:00.963 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:31:00.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:30.943478+0000", 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:00.964 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2024-09-05T17:31:00.965 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2024-09-05T17:31:00.966 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:00.966 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:00.966 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:00.966 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:00.966 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:00.966 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:00.966 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:00.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.967 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "22", 2024-09-05T17:31:00.967 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:00.967 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:00.967 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:00.967 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:00.967 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:00.967 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 2, 2024-09-05T17:31:00.967 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 22, 2024-09-05T17:31:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:00.968 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:00.969 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:31:00.970 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:31:00.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "pool_client.0", 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:42.082168+0000", 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:00.972 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:00.973 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "33", 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 7, 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 33, 2024-09-05T17:31:00.974 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:00.975 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:00.976 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2024-09-05T17:31:00.977 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "38dd1565-a37f-4055-acb3-aa82457cf9e7", 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:00.978 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:00.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.980 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.982 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2024-09-05T17:31:00.982 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:00.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6825/1446480840", 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6827/1446480840", 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/1446480840", 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6829/1446480840", 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:00.984 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f5ef5f03-d714-4329-b14b-1881ad1e7358", 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:00.985 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2024-09-05T17:31:00.986 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.987 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.988 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.991 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2024-09-05T17:31:00.991 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/3885625462", 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/3885625462", 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/3885625462", 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/3885625462", 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "7b87b0cc-2484-4a66-be1b-232a7e36dc11", 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 19, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:00.993 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.994 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2024-09-05T17:31:00.996 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2024-09-05T17:31:00.997 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/3027840955", 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/3027840955", 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/3027840955", 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/3027840955", 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:00.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f6d63b1e-2673-4542-a2e2-fbb0c4577864", 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:00.999 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2024-09-05T17:31:01.001 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.002 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/2889879466", 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6819/2889879466", 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6823/2889879466", 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6821/2889879466", 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:01.004 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "273ec4c6-0c2a-41d5-90c1-68b317365484", 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:01.005 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6808", 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6809", 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:01.006 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6810", 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6811", 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:01.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6814", 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6815", 2024-09-05T17:31:01.008 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6812", 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6813", 2024-09-05T17:31:01.009 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6809/1774319792", 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6811/1774319792", 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6815/1774319792", 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6813/1774319792", 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.010 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "5f6cf36b-2dd0-47de-97c4-42e98f849734", 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:01.011 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6816", 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6817", 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:01.012 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6818", 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6819", 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:01.013 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6822", 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6823", 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6820", 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6821", 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.015 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6817/1348894681", 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6819/1348894681", 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6823/1348894681", 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6821/1348894681", 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:31:01.016 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "2d6ed4a6-3d83-4c9d-9e96-2dbab049448a", 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:01.017 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6824", 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6825", 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6826", 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6827", 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:01.019 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6830", 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6831", 2024-09-05T17:31:01.020 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6828", 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.021 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6829", 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6825/792585226", 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6827/792585226", 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6831/792585226", 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6829/792585226", 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "dbe1901b-5f78-419f-864a-89946452f4a6", 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:01.023 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6800", 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6801", 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:01.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6802", 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6803", 2024-09-05T17:31:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6806", 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6807", 2024-09-05T17:31:01.026 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6804", 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.027 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6805", 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6801/2161010500", 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6803/2161010500", 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2161010500", 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2161010500", 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:01.028 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:22.246726+0000", 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:01.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.638940+0000", 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:01.030 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.694544+0000", 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:01.031 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.653253+0000", 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.467561+0000", 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.797765+0000", 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:01.033 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.649372+0000", 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:01.034 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.242988+0000", 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2024-09-05T17:31:01.035 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2024-09-05T17:31:01.036 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2024-09-05T17:31:01.037 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2024-09-05T17:31:01.037 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2024-09-05T17:31:01.037 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2024-09-05T17:31:01.037 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2024-09-05T17:31:01.037 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:01.037 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:01.040 INFO:tasks.thrashosds.thrasher:j is {'epoch': 34, 'fsid': '229efc05-fdc4-4e1f-8246-413b49f3eeda', 'created': '2024-09-05T17:30:12.762369+0000', 'modified': '2024-09-05T17:31:00.487317+0000', 'last_up_change': '2024-09-05T17:30:23.981355+0000', 'last_in_change': '2024-09-05T17:30:15.006059+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T17:30:25.818485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-05T17:30:30.943478+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-05T17:30:42.082168+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 33, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '38dd1565-a37f-4055-acb3-aa82457cf9e7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6824', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6825', 'nonce': 1446480840}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6826', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6827', 'nonce': 1446480840}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6830', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6831', 'nonce': 1446480840}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6828', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6829', 'nonce': 1446480840}]}, 'public_addr': '172.21.15.50:6825/1446480840', 'cluster_addr': '172.21.15.50:6827/1446480840', 'heartbeat_back_addr': '172.21.15.50:6831/1446480840', 'heartbeat_front_addr': '172.21.15.50:6829/1446480840', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f5ef5f03-d714-4329-b14b-1881ad1e7358', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6808', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6809', 'nonce': 3885625462}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6810', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6811', 'nonce': 3885625462}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6814', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6815', 'nonce': 3885625462}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6812', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6813', 'nonce': 3885625462}]}, 'public_addr': '172.21.15.50:6809/3885625462', 'cluster_addr': '172.21.15.50:6811/3885625462', 'heartbeat_back_addr': '172.21.15.50:6815/3885625462', 'heartbeat_front_addr': '172.21.15.50:6813/3885625462', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '7b87b0cc-2484-4a66-be1b-232a7e36dc11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6800', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6801', 'nonce': 3027840955}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6802', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6803', 'nonce': 3027840955}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6806', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6807', 'nonce': 3027840955}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6804', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6805', 'nonce': 3027840955}]}, 'public_addr': '172.21.15.50:6801/3027840955', 'cluster_addr': '172.21.15.50:6803/3027840955', 'heartbeat_back_addr': '172.21.15.50:6807/3027840955', 'heartbeat_front_addr': '172.21.15.50:6805/3027840955', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'f6d63b1e-2673-4542-a2e2-fbb0c4577864', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6816', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6817', 'nonce': 2889879466}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6818', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 2889879466}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6822', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6823', 'nonce': 2889879466}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6820', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6821', 'nonce': 2889879466}]}, 'public_addr': '172.21.15.50:6817/2889879466', 'cluster_addr': '172.21.15.50:6819/2889879466', 'heartbeat_back_addr': '172.21.15.50:6823/2889879466', 'heartbeat_front_addr': '172.21.15.50:6821/2889879466', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '273ec4c6-0c2a-41d5-90c1-68b317365484', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 1774319792}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 1774319792}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 1774319792}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 1774319792}]}, 'public_addr': '172.21.15.110:6809/1774319792', 'cluster_addr': '172.21.15.110:6811/1774319792', 'heartbeat_back_addr': '172.21.15.110:6815/1774319792', 'heartbeat_front_addr': '172.21.15.110:6813/1774319792', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5f6cf36b-2dd0-47de-97c4-42e98f849734', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 1348894681}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 1348894681}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 1348894681}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 1348894681}]}, 'public_addr': '172.21.15.110:6817/1348894681', 'cluster_addr': '172.21.15.110:6819/1348894681', 'heartbeat_back_addr': '172.21.15.110:6823/1348894681', 'heartbeat_front_addr': '172.21.15.110:6821/1348894681', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2d6ed4a6-3d83-4c9d-9e96-2dbab049448a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 792585226}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 792585226}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 792585226}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 792585226}]}, 'public_addr': '172.21.15.110:6825/792585226', 'cluster_addr': '172.21.15.110:6827/792585226', 'heartbeat_back_addr': '172.21.15.110:6831/792585226', 'heartbeat_front_addr': '172.21.15.110:6829/792585226', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dbe1901b-5f78-419f-864a-89946452f4a6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2161010500}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2161010500}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2161010500}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2161010500}]}, 'public_addr': '172.21.15.110:6801/2161010500', 'cluster_addr': '172.21.15.110:6803/2161010500', 'heartbeat_back_addr': '172.21.15.110:6807/2161010500', 'heartbeat_front_addr': '172.21.15.110:6805/2161010500', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:22.246726+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.638940+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.694544+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.653253+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.467561+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.797765+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.649372+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.242988+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-05T17:31:01.040 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:31:01.040 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:01.040+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:01.071 INFO:teuthology.orchestra.run.smithi050.stdout:940 writesame 0x5172f2e thru 0x517ec8a data_size 0x71(0xbd5d bytes) 2024-09-05T17:31:01.075 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:01.076 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:01.076 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:01.076 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:01.076 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:01.096 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:01.138 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:01.138 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:01.140 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:01.139+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:01.171 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:01.171 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:01.196 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:01.196 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:01.229 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:01.230 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:01.241 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:01.239+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:01.261 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:01.261 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:01.274 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:01.274 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:01.287 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:01.288 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:01.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:01.310 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:01.317 INFO:teuthology.orchestra.run.smithi050.stdout:942 trunc from 0xd3bee75 to 0x3e10cd4 2024-09-05T17:31:01.343 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:01.339+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:01.344 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:01.344 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:01.397 INFO:teuthology.orchestra.run.smithi050.stdout:943 trunc from 0x3e10cd4 to 0x9c48af5 2024-09-05T17:31:01.407 INFO:teuthology.orchestra.run.smithi050.stdout:945 read 0x88b58c0 thru 0x88c5065 (0xf7a6 bytes) 2024-09-05T17:31:01.407 INFO:teuthology.orchestra.run.smithi050.stdout:949 read 0x2e979e6 thru 0x2e9c8e8 (0x4f03 bytes) 2024-09-05T17:31:01.421 INFO:teuthology.orchestra.run.smithi050.stdout:950 write 0xb68db65 thru 0xb68e5bd (0xa59 bytes) 2024-09-05T17:31:01.429 INFO:teuthology.orchestra.run.smithi050.stdout:951 read 0x9002df5 thru 0x900d1c0 (0xa3cc bytes) 2024-09-05T17:31:01.433 INFO:teuthology.orchestra.run.smithi050.stdout:952 trunc from 0xb68e5be to 0xec9e052 2024-09-05T17:31:01.435 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:01.435 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:01.443 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:01.444+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:01.444 INFO:teuthology.orchestra.run.smithi050.stdout:954 punch from 0xe81d282 to 0xe8225af, (0x532d bytes) 2024-09-05T17:31:01.444 INFO:teuthology.orchestra.run.smithi050.stdout:955 writesame 0x2fd0fb2 thru 0x2fde794 data_size 0x1(0xd7e3 bytes) 2024-09-05T17:31:01.451 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:01.463 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:31:01.464 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:31:01.485 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-05T17:31:00.492199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":182043228,"num_objects":345,"num_object_clones":122,"num_object_copies":690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":345,"num_whiteouts":104,"num_read":22327,"num_read_kb":48393,"num_write":5643,"num_write_kb":25951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4368,"ondisk_log_size":4368,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":289156,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685564,"statfs":{"total":773094113280,"available":772798017536,"internally_reserved":0,"allocated":6529024,"data_stored":13597534,"data_compressed":767484,"data_compressed_allocated":1617920,"data_compressed_original":11010048,"omap_allocated":12751,"internal_metadata":289394225},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141648697,"num_objects":241,"num_object_clones":122,"num_object_copies":482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":241,"num_whiteouts":104,"num_read":10489,"num_read_kb":32567,"num_write":902,"num_write_kb":10048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.714835"},"pg_stats":[{"pgid":"3.1f","version":"33'76","reported_seq":177,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.517311+0000","last_change":"2024-09-05T17:30:45.596387+0000","last_active":"2024-09-05T17:30:59.517311+0000","last_peered":"2024-09-05T17:30:59.517311+0000","last_clean":"2024-09-05T17:30:59.517311+0000","last_became_active":"2024-09-05T17:30:43.600165+0000","last_became_peered":"2024-09-05T17:30:43.600165+0000","last_unstale":"2024-09-05T17:30:59.517311+0000","last_undegraded":"2024-09-05T17:30:59.517311+0000","last_fullsized":"2024-09-05T17:30:59.517311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:18:56.943393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023314770000000002,"stat_sum":{"num_bytes":2735679,"num_objects":13,"num_object_clones":5,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":82,"num_read_kb":1682,"num_write":107,"num_write_kb":2460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'75","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.681199+0000","last_change":"2024-09-05T17:30:45.601580+0000","last_active":"2024-09-05T17:30:59.681199+0000","last_peered":"2024-09-05T17:30:59.681199+0000","last_clean":"2024-09-05T17:30:59.681199+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:30:59.681199+0000","last_undegraded":"2024-09-05T17:30:59.681199+0000","last_fullsized":"2024-09-05T17:30:59.681199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:29:24.399953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012442379999999999,"stat_sum":{"num_bytes":1968019,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":2,"num_read":44,"num_read_kb":483,"num_write":84,"num_write_kb":1473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"33'68","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.947288+0000","last_change":"2024-09-05T17:30:45.585378+0000","last_active":"2024-09-05T17:30:58.947288+0000","last_peered":"2024-09-05T17:30:58.947288+0000","last_clean":"2024-09-05T17:30:58.947288+0000","last_became_active":"2024-09-05T17:30:43.597087+0000","last_became_peered":"2024-09-05T17:30:43.597087+0000","last_unstale":"2024-09-05T17:30:58.947288+0000","last_undegraded":"2024-09-05T17:30:58.947288+0000","last_fullsized":"2024-09-05T17:30:58.947288+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:45:20.207893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064572499999999999,"stat_sum":{"num_bytes":1051388,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":239,"num_read_kb":201,"num_write":66,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"33'67","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.904942+0000","last_change":"2024-09-05T17:30:45.586287+0000","last_active":"2024-09-05T17:30:58.904942+0000","last_peered":"2024-09-05T17:30:58.904942+0000","last_clean":"2024-09-05T17:30:58.904942+0000","last_became_active":"2024-09-05T17:30:43.604511+0000","last_became_peered":"2024-09-05T17:30:43.604511+0000","last_unstale":"2024-09-05T17:30:58.904942+0000","last_undegraded":"2024-09-05T17:30:58.904942+0000","last_fullsized":"2024-09-05T17:30:58.904942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:58:28.116342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015056150000000001,"stat_sum":{"num_bytes":917853,"num_objects":11,"num_object_clones":3,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":3,"num_read":112,"num_read_kb":400,"num_write":66,"num_write_kb":517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"33'99","reported_seq":175,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.883223+0000","last_change":"2024-09-05T17:30:45.595496+0000","last_active":"2024-09-05T17:30:57.883223+0000","last_peered":"2024-09-05T17:30:57.883223+0000","last_clean":"2024-09-05T17:30:57.883223+0000","last_became_active":"2024-09-05T17:30:43.603009+0000","last_became_peered":"2024-09-05T17:30:43.603009+0000","last_unstale":"2024-09-05T17:30:57.883223+0000","last_undegraded":"2024-09-05T17:30:57.883223+0000","last_fullsized":"2024-09-05T17:30:57.883223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:15:09.611517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001548448,"stat_sum":{"num_bytes":4007938,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":62,"num_read_kb":581,"num_write":96,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"33'99","reported_seq":533,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.015711+0000","last_change":"2024-09-05T17:30:45.576728+0000","last_active":"2024-09-05T17:30:59.015711+0000","last_peered":"2024-09-05T17:30:59.015711+0000","last_clean":"2024-09-05T17:30:59.015711+0000","last_became_active":"2024-09-05T17:30:43.587931+0000","last_became_peered":"2024-09-05T17:30:43.587931+0000","last_unstale":"2024-09-05T17:30:59.015711+0000","last_undegraded":"2024-09-05T17:30:59.015711+0000","last_fullsized":"2024-09-05T17:30:59.015711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:04:01.867335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058024300000000003,"stat_sum":{"num_bytes":438291,"num_objects":4,"num_object_clones":1,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":727,"num_read_kb":1073,"num_write":96,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"33'93","reported_seq":1603,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.839811+0000","last_change":"2024-09-05T17:30:45.579337+0000","last_active":"2024-09-05T17:30:59.839811+0000","last_peered":"2024-09-05T17:30:59.839811+0000","last_clean":"2024-09-05T17:30:59.839811+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:30:59.839811+0000","last_undegraded":"2024-09-05T17:30:59.839811+0000","last_fullsized":"2024-09-05T17:30:59.839811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:31:04.325646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096919599999999997,"stat_sum":{"num_bytes":10220833,"num_objects":6,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":1481,"num_read_kb":2579,"num_write":94,"num_write_kb":924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"31'70","reported_seq":386,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.498405+0000","last_change":"2024-09-05T17:30:45.601823+0000","last_active":"2024-09-05T17:30:57.498405+0000","last_peered":"2024-09-05T17:30:57.498405+0000","last_clean":"2024-09-05T17:30:57.498405+0000","last_became_active":"2024-09-05T17:30:43.591663+0000","last_became_peered":"2024-09-05T17:30:43.591663+0000","last_unstale":"2024-09-05T17:30:57.498405+0000","last_undegraded":"2024-09-05T17:30:57.498405+0000","last_fullsized":"2024-09-05T17:30:57.498405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:51:07.654222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371232,"stat_sum":{"num_bytes":3770974,"num_objects":9,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":287,"num_read_kb":1934,"num_write":75,"num_write_kb":574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"33'88","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.927709+0000","last_change":"2024-09-05T17:30:45.596866+0000","last_active":"2024-09-05T17:30:58.927709+0000","last_peered":"2024-09-05T17:30:58.927709+0000","last_clean":"2024-09-05T17:30:58.927709+0000","last_became_active":"2024-09-05T17:30:43.597194+0000","last_became_peered":"2024-09-05T17:30:43.597194+0000","last_unstale":"2024-09-05T17:30:58.927709+0000","last_undegraded":"2024-09-05T17:30:58.927709+0000","last_fullsized":"2024-09-05T17:30:58.927709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:26:55.291008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024520119999999999,"stat_sum":{"num_bytes":421888,"num_objects":6,"num_object_clones":2,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":53,"num_read_kb":187,"num_write":89,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'193","reported_seq":306,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.789513+0000","last_change":"2024-09-05T17:30:45.586718+0000","last_active":"2024-09-05T17:30:59.789513+0000","last_peered":"2024-09-05T17:30:59.789513+0000","last_clean":"2024-09-05T17:30:59.789513+0000","last_became_active":"2024-09-05T17:30:43.604988+0000","last_became_peered":"2024-09-05T17:30:43.604988+0000","last_unstale":"2024-09-05T17:30:59.789513+0000","last_undegraded":"2024-09-05T17:30:59.789513+0000","last_fullsized":"2024-09-05T17:30:59.789513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:33:09.548733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017597120000000001,"stat_sum":{"num_bytes":2199822,"num_objects":13,"num_object_clones":6,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":598,"num_read_kb":1329,"num_write":268,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'59","reported_seq":134,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.724339+0000","last_change":"2024-09-05T17:30:46.331830+0000","last_active":"2024-09-05T17:30:59.724339+0000","last_peered":"2024-09-05T17:30:59.724339+0000","last_clean":"2024-09-05T17:30:59.724339+0000","last_became_active":"2024-09-05T17:30:43.598646+0000","last_became_peered":"2024-09-05T17:30:43.598646+0000","last_unstale":"2024-09-05T17:30:59.724339+0000","last_undegraded":"2024-09-05T17:30:59.724339+0000","last_fullsized":"2024-09-05T17:30:59.724339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:26:50.847969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010679610000000001,"stat_sum":{"num_bytes":1335296,"num_objects":9,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":46,"num_read_kb":520,"num_write":57,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"33'93","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.993965+0000","last_change":"2024-09-05T17:30:45.577307+0000","last_active":"2024-09-05T17:30:58.993965+0000","last_peered":"2024-09-05T17:30:58.993965+0000","last_clean":"2024-09-05T17:30:58.993965+0000","last_became_active":"2024-09-05T17:30:43.599990+0000","last_became_peered":"2024-09-05T17:30:43.599990+0000","last_unstale":"2024-09-05T17:30:58.993965+0000","last_undegraded":"2024-09-05T17:30:58.993965+0000","last_fullsized":"2024-09-05T17:30:58.993965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:40:42.802451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010724350000000001,"stat_sum":{"num_bytes":2742578,"num_objects":13,"num_object_clones":5,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":81,"num_read_kb":1440,"num_write":100,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.549270+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:30:57.549270+0000","last_peered":"2024-09-05T17:30:57.549270+0000","last_clean":"2024-09-05T17:30:57.549270+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:30:57.549270+0000","last_undegraded":"2024-09-05T17:30:57.549270+0000","last_fullsized":"2024-09-05T17:30:57.549270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"33'194","reported_seq":1097,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.716148+0000","last_change":"2024-09-05T17:30:45.596565+0000","last_active":"2024-09-05T17:30:59.716148+0000","last_peered":"2024-09-05T17:30:59.716148+0000","last_clean":"2024-09-05T17:30:59.716148+0000","last_became_active":"2024-09-05T17:30:43.596844+0000","last_became_peered":"2024-09-05T17:30:43.596844+0000","last_unstale":"2024-09-05T17:30:59.716148+0000","last_undegraded":"2024-09-05T17:30:59.716148+0000","last_fullsized":"2024-09-05T17:30:59.716148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:31:11.057614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024656499999999998,"stat_sum":{"num_bytes":3809458,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":4,"num_read":2400,"num_read_kb":2262,"num_write":185,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.488242+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:30:57.488242+0000","last_peered":"2024-09-05T17:30:57.488242+0000","last_clean":"2024-09-05T17:30:57.488242+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:30:57.488242+0000","last_undegraded":"2024-09-05T17:30:57.488242+0000","last_fullsized":"2024-09-05T17:30:57.488242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"33'94","reported_seq":139,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.025976+0000","last_change":"2024-09-05T17:30:45.600856+0000","last_active":"2024-09-05T17:30:59.025976+0000","last_peered":"2024-09-05T17:30:59.025976+0000","last_clean":"2024-09-05T17:30:59.025976+0000","last_became_active":"2024-09-05T17:30:43.590576+0000","last_became_peered":"2024-09-05T17:30:43.590576+0000","last_unstale":"2024-09-05T17:30:59.025976+0000","last_undegraded":"2024-09-05T17:30:59.025976+0000","last_fullsized":"2024-09-05T17:30:59.025976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:35:33.960949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062572599999999995,"stat_sum":{"num_bytes":958959,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":2,"num_read":15,"num_read_kb":20,"num_write":92,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.501534+0000","last_change":"2024-09-05T17:30:34.286740+0000","last_active":"2024-09-05T17:30:57.501534+0000","last_peered":"2024-09-05T17:30:57.501534+0000","last_clean":"2024-09-05T17:30:57.501534+0000","last_became_active":"2024-09-05T17:30:32.046860+0000","last_became_peered":"2024-09-05T17:30:32.046860+0000","last_unstale":"2024-09-05T17:30:57.501534+0000","last_undegraded":"2024-09-05T17:30:57.501534+0000","last_fullsized":"2024-09-05T17:30:57.501534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:00:40.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"33'80","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.026516+0000","last_change":"2024-09-05T17:30:45.579183+0000","last_active":"2024-09-05T17:30:59.026516+0000","last_peered":"2024-09-05T17:30:59.026516+0000","last_clean":"2024-09-05T17:30:59.026516+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:30:59.026516+0000","last_undegraded":"2024-09-05T17:30:59.026516+0000","last_fullsized":"2024-09-05T17:30:59.026516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:06:49.454401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075116199999999999,"stat_sum":{"num_bytes":605904,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":3,"num_read":70,"num_read_kb":319,"num_write":78,"num_write_kb":434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.488453+0000","last_change":"2024-09-05T17:30:34.074244+0000","last_active":"2024-09-05T17:30:57.488453+0000","last_peered":"2024-09-05T17:30:57.488453+0000","last_clean":"2024-09-05T17:30:57.488453+0000","last_became_active":"2024-09-05T17:30:32.050582+0000","last_became_peered":"2024-09-05T17:30:32.050582+0000","last_unstale":"2024-09-05T17:30:57.488453+0000","last_undegraded":"2024-09-05T17:30:57.488453+0000","last_fullsized":"2024-09-05T17:30:57.488453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:33:10.698117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'111","reported_seq":407,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.892079+0000","last_change":"2024-09-05T17:30:45.585838+0000","last_active":"2024-09-05T17:30:57.892079+0000","last_peered":"2024-09-05T17:30:57.892079+0000","last_clean":"2024-09-05T17:30:57.892079+0000","last_became_active":"2024-09-05T17:30:43.586429+0000","last_became_peered":"2024-09-05T17:30:43.586429+0000","last_unstale":"2024-09-05T17:30:57.892079+0000","last_undegraded":"2024-09-05T17:30:57.892079+0000","last_fullsized":"2024-09-05T17:30:57.892079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:06:36.853210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010231579999999999,"stat_sum":{"num_bytes":3526252,"num_objects":15,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":6,"num_read":712,"num_read_kb":1714,"num_write":101,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"33'95","reported_seq":158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.483272+0000","last_change":"2024-09-05T17:30:45.577008+0000","last_active":"2024-09-05T17:30:57.483272+0000","last_peered":"2024-09-05T17:30:57.483272+0000","last_clean":"2024-09-05T17:30:57.483272+0000","last_became_active":"2024-09-05T17:30:43.594808+0000","last_became_peered":"2024-09-05T17:30:43.594808+0000","last_unstale":"2024-09-05T17:30:57.483272+0000","last_undegraded":"2024-09-05T17:30:57.483272+0000","last_fullsized":"2024-09-05T17:30:57.483272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:39:45.014457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077238000000000003,"stat_sum":{"num_bytes":1499136,"num_objects":5,"num_object_clones":2,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":45,"num_read_kb":464,"num_write":93,"num_write_kb":243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.489443+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:30:57.489443+0000","last_peered":"2024-09-05T17:30:57.489443+0000","last_clean":"2024-09-05T17:30:57.489443+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:30:57.489443+0000","last_undegraded":"2024-09-05T17:30:57.489443+0000","last_fullsized":"2024-09-05T17:30:57.489443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"33'111","reported_seq":243,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.752070+0000","last_change":"2024-09-05T17:30:45.580126+0000","last_active":"2024-09-05T17:30:59.752070+0000","last_peered":"2024-09-05T17:30:59.752070+0000","last_clean":"2024-09-05T17:30:59.752070+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:30:59.752070+0000","last_undegraded":"2024-09-05T17:30:59.752070+0000","last_fullsized":"2024-09-05T17:30:59.752070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:57:58.811988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093389999999999999,"stat_sum":{"num_bytes":3285927,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":120,"num_read_kb":669,"num_write":117,"num_write_kb":1228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.663509+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:30:57.663509+0000","last_peered":"2024-09-05T17:30:57.663509+0000","last_clean":"2024-09-05T17:30:57.663509+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:30:57.663509+0000","last_undegraded":"2024-09-05T17:30:57.663509+0000","last_fullsized":"2024-09-05T17:30:57.663509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"33'108","reported_seq":357,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.815415+0000","last_change":"2024-09-05T17:30:45.595155+0000","last_active":"2024-09-05T17:30:58.815415+0000","last_peered":"2024-09-05T17:30:58.815415+0000","last_clean":"2024-09-05T17:30:58.815415+0000","last_became_active":"2024-09-05T17:30:43.603052+0000","last_became_peered":"2024-09-05T17:30:43.603052+0000","last_unstale":"2024-09-05T17:30:58.815415+0000","last_undegraded":"2024-09-05T17:30:58.815415+0000","last_fullsized":"2024-09-05T17:30:58.815415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:20:05.246997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001490367,"stat_sum":{"num_bytes":19851772,"num_objects":13,"num_object_clones":5,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":5,"num_read":576,"num_read_kb":821,"num_write":117,"num_write_kb":1530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.499331+0000","last_change":"2024-09-05T17:30:34.286855+0000","last_active":"2024-09-05T17:30:57.499331+0000","last_peered":"2024-09-05T17:30:57.499331+0000","last_clean":"2024-09-05T17:30:57.499331+0000","last_became_active":"2024-09-05T17:30:32.050265+0000","last_became_peered":"2024-09-05T17:30:32.050265+0000","last_unstale":"2024-09-05T17:30:57.499331+0000","last_undegraded":"2024-09-05T17:30:57.499331+0000","last_fullsized":"2024-09-05T17:30:57.499331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:22:54.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"33'1358","reported_seq":2477,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.797499+0000","last_change":"2024-09-05T17:30:45.600843+0000","last_active":"2024-09-05T17:30:58.797499+0000","last_peered":"2024-09-05T17:30:58.797499+0000","last_clean":"2024-09-05T17:30:58.797499+0000","last_became_active":"2024-09-05T17:30:43.587691+0000","last_became_peered":"2024-09-05T17:30:43.587691+0000","last_unstale":"2024-09-05T17:30:58.797499+0000","last_undegraded":"2024-09-05T17:30:58.797499+0000","last_fullsized":"2024-09-05T17:30:58.797499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1358,"log_dups_size":0,"ondisk_log_size":1358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:08:19.134051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069190400000000002,"stat_sum":{"num_bytes":19228817,"num_objects":13,"num_object_clones":4,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":8366,"num_read_kb":8578,"num_write":2502,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.489421+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:30:57.489421+0000","last_peered":"2024-09-05T17:30:57.489421+0000","last_clean":"2024-09-05T17:30:57.489421+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:30:57.489421+0000","last_undegraded":"2024-09-05T17:30:57.489421+0000","last_fullsized":"2024-09-05T17:30:57.489421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.499600+0000","last_change":"2024-09-05T17:30:27.328259+0000","last_active":"2024-09-05T17:30:57.499600+0000","last_peered":"2024-09-05T17:30:57.499600+0000","last_clean":"2024-09-05T17:30:57.499600+0000","last_became_active":"2024-09-05T17:30:27.326202+0000","last_became_peered":"2024-09-05T17:30:27.326202+0000","last_unstale":"2024-09-05T17:30:57.499600+0000","last_undegraded":"2024-09-05T17:30:57.499600+0000","last_fullsized":"2024-09-05T17:30:57.499600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:40.749016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"33'89","reported_seq":1118,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.498890+0000","last_change":"2024-09-05T17:30:45.601218+0000","last_active":"2024-09-05T17:30:57.498890+0000","last_peered":"2024-09-05T17:30:57.498890+0000","last_clean":"2024-09-05T17:30:57.498890+0000","last_became_active":"2024-09-05T17:30:43.584933+0000","last_became_peered":"2024-09-05T17:30:43.584933+0000","last_unstale":"2024-09-05T17:30:57.498890+0000","last_undegraded":"2024-09-05T17:30:57.498890+0000","last_fullsized":"2024-09-05T17:30:57.498890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:34:57.331713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097333599999999999,"stat_sum":{"num_bytes":5137017,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":1072,"num_read_kb":3709,"num_write":94,"num_write_kb":587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"31'61","reported_seq":1185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.483155+0000","last_change":"2024-09-05T17:30:45.577452+0000","last_active":"2024-09-05T17:30:57.483155+0000","last_peered":"2024-09-05T17:30:57.483155+0000","last_clean":"2024-09-05T17:30:57.483155+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:30:57.483155+0000","last_undegraded":"2024-09-05T17:30:57.483155+0000","last_fullsized":"2024-09-05T17:30:57.483155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:02:34.893495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00119338,"stat_sum":{"num_bytes":7114844,"num_objects":11,"num_object_clones":5,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":4,"num_read":1101,"num_read_kb":4434,"num_write":59,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'121","reported_seq":185,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.261169+0000","last_change":"2024-09-05T17:30:45.806921+0000","last_active":"2024-09-05T17:30:58.261169+0000","last_peered":"2024-09-05T17:30:58.261169+0000","last_clean":"2024-09-05T17:30:58.261169+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:30:58.261169+0000","last_undegraded":"2024-09-05T17:30:58.261169+0000","last_fullsized":"2024-09-05T17:30:58.261169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:36:01.665819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092165900000000002,"stat_sum":{"num_bytes":1525790,"num_objects":10,"num_object_clones":3,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":167,"num_read_kb":428,"num_write":138,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"33'50","reported_seq":2104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.695760+0000","last_change":"2024-09-05T17:30:45.601316+0000","last_active":"2024-09-05T17:30:59.695760+0000","last_peered":"2024-09-05T17:30:59.695760+0000","last_clean":"2024-09-05T17:30:59.695760+0000","last_became_active":"2024-09-05T17:30:43.595055+0000","last_became_peered":"2024-09-05T17:30:43.595055+0000","last_unstale":"2024-09-05T17:30:59.695760+0000","last_undegraded":"2024-09-05T17:30:59.695760+0000","last_fullsized":"2024-09-05T17:30:59.695760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:15:17.928154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053415,"stat_sum":{"num_bytes":21140786,"num_objects":9,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":2,"num_read":2054,"num_read_kb":4399,"num_write":50,"num_write_kb":714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"33'106","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.490653+0000","last_change":"2024-09-05T17:30:45.586557+0000","last_active":"2024-09-05T17:30:57.490653+0000","last_peered":"2024-09-05T17:30:57.490653+0000","last_clean":"2024-09-05T17:30:57.490653+0000","last_became_active":"2024-09-05T17:30:43.586452+0000","last_became_peered":"2024-09-05T17:30:43.586452+0000","last_unstale":"2024-09-05T17:30:57.490653+0000","last_undegraded":"2024-09-05T17:30:57.490653+0000","last_fullsized":"2024-09-05T17:30:57.490653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:41.553340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012305,"stat_sum":{"num_bytes":2159275,"num_objects":13,"num_object_clones":6,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":6,"num_read":76,"num_read_kb":1213,"num_write":100,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"33'122","reported_seq":244,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.798581+0000","last_change":"2024-09-05T17:30:46.333102+0000","last_active":"2024-09-05T17:30:58.798581+0000","last_peered":"2024-09-05T17:30:58.798581+0000","last_clean":"2024-09-05T17:30:58.798581+0000","last_became_active":"2024-09-05T17:30:43.600919+0000","last_became_peered":"2024-09-05T17:30:43.600919+0000","last_unstale":"2024-09-05T17:30:58.798581+0000","last_undegraded":"2024-09-05T17:30:58.798581+0000","last_fullsized":"2024-09-05T17:30:58.798581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:51:31.453816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002229342,"stat_sum":{"num_bytes":4854243,"num_objects":15,"num_object_clones":6,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":4,"num_read":118,"num_read_kb":1650,"num_write":119,"num_write_kb":728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"33'31","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.812652+0000","last_change":"2024-09-05T17:30:46.333307+0000","last_active":"2024-09-05T17:30:58.812652+0000","last_peered":"2024-09-05T17:30:58.812652+0000","last_clean":"2024-09-05T17:30:58.812652+0000","last_became_active":"2024-09-05T17:30:43.600952+0000","last_became_peered":"2024-09-05T17:30:43.600952+0000","last_unstale":"2024-09-05T17:30:58.812652+0000","last_undegraded":"2024-09-05T17:30:58.812652+0000","last_fullsized":"2024-09-05T17:30:58.812652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:25:49.795630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019952949999999998,"stat_sum":{"num_bytes":1153024,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":41,"num_read_kb":328,"num_write":29,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"33'100","reported_seq":1207,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.542094+0000","last_change":"2024-09-05T17:30:46.332586+0000","last_active":"2024-09-05T17:30:59.542094+0000","last_peered":"2024-09-05T17:30:59.542094+0000","last_clean":"2024-09-05T17:30:59.542094+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:30:59.542094+0000","last_undegraded":"2024-09-05T17:30:59.542094+0000","last_fullsized":"2024-09-05T17:30:59.542094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:52:56.640573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001698326,"stat_sum":{"num_bytes":8077843,"num_objects":14,"num_object_clones":5,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":1084,"num_read_kb":766,"num_write":97,"num_write_kb":581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"33'128","reported_seq":207,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.636890+0000","last_change":"2024-09-05T17:30:45.806898+0000","last_active":"2024-09-05T17:30:58.636890+0000","last_peered":"2024-09-05T17:30:58.636890+0000","last_clean":"2024-09-05T17:30:58.636890+0000","last_became_active":"2024-09-05T17:30:43.588731+0000","last_became_peered":"2024-09-05T17:30:43.588731+0000","last_unstale":"2024-09-05T17:30:58.636890+0000","last_undegraded":"2024-09-05T17:30:58.636890+0000","last_fullsized":"2024-09-05T17:30:58.636890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:25:41.862220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000919516,"stat_sum":{"num_bytes":22100343,"num_objects":11,"num_object_clones":4,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":4,"num_read":62,"num_read_kb":606,"num_write":125,"num_write_kb":871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"33'86","reported_seq":170,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:58.812656+0000","last_change":"2024-09-05T17:30:46.332397+0000","last_active":"2024-09-05T17:30:58.812656+0000","last_peered":"2024-09-05T17:30:58.812656+0000","last_clean":"2024-09-05T17:30:58.812656+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:30:58.812656+0000","last_undegraded":"2024-09-05T17:30:58.812656+0000","last_fullsized":"2024-09-05T17:30:58.812656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:21:52.963105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015389449999999999,"stat_sum":{"num_bytes":1450118,"num_objects":9,"num_object_clones":3,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":3,"num_read":67,"num_read_kb":678,"num_write":83,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"32'101","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:57.488793+0000","last_change":"2024-09-05T17:30:45.594968+0000","last_active":"2024-09-05T17:30:57.488793+0000","last_peered":"2024-09-05T17:30:57.488793+0000","last_clean":"2024-09-05T17:30:57.488793+0000","last_became_active":"2024-09-05T17:30:43.602339+0000","last_became_peered":"2024-09-05T17:30:43.602339+0000","last_unstale":"2024-09-05T17:30:57.488793+0000","last_undegraded":"2024-09-05T17:30:57.488793+0000","last_fullsized":"2024-09-05T17:30:57.488793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:29:11.934141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164483,"stat_sum":{"num_bytes":20770134,"num_objects":16,"num_object_clones":8,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":7,"num_read":77,"num_read_kb":1711,"num_write":100,"num_write_kb":1844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"33'67","reported_seq":207,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-05T17:30:59.035468+0000","last_change":"2024-09-05T17:30:46.331733+0000","last_active":"2024-09-05T17:30:59.035468+0000","last_peered":"2024-09-05T17:30:59.035468+0000","last_clean":"2024-09-05T17:30:59.035468+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:30:59.035468+0000","last_undegraded":"2024-09-05T17:30:59.035468+0000","last_fullsized":"2024-09-05T17:30:59.035468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:38:53.535024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099853899999999989,"stat_sum":{"num_bytes":1392640,"num_objects":9,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":2,"num_read":226,"num_read_kb":1160,"num_write":63,"num_write_kb":192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":181452841,"num_objects":341,"num_object_clones":122,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":104,"num_read":22261,"num_read_kb":48338,"num_write":5540,"num_write_kb":24321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4169728,"data_stored":16700470,"data_compressed":833838,"data_compressed_allocated":1908736,"data_compressed_original":15106048,"omap_allocated":0,"internal_metadata":0},"log_size":4293,"ondisk_log_size":4293,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1003520,"data_stored":3060358,"data_compressed":131796,"data_compressed_allocated":303104,"data_compressed_original":2670592,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":528384,"data_stored":328105,"data_compressed":51192,"data_compressed_allocated":65536,"data_compressed_original":114688,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40224,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331616,"statfs":{"total":96636764160,"available":96595574784,"internally_reserved":0,"allocated":733184,"data_stored":1142763,"data_compressed":38169,"data_compressed_allocated":102400,"data_compressed_original":794624,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":946176,"data_stored":2310654,"data_compressed":86196,"data_compressed_allocated":253952,"data_compressed_original":1945600,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40392,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331448,"statfs":{"total":96636764160,"available":96595402752,"internally_reserved":0,"allocated":909312,"data_stored":1340416,"data_compressed":123837,"data_compressed_allocated":221184,"data_compressed_original":978944,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":503808,"data_stored":527811,"data_compressed":12358,"data_compressed_allocated":32768,"data_compressed_original":294912,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35912,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335928,"statfs":{"total":96636764160,"available":96599990272,"internally_reserved":0,"allocated":581632,"data_stored":371011,"data_compressed":35847,"data_compressed_allocated":45056,"data_compressed_original":110592,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36644,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335196,"statfs":{"total":96636764160,"available":96599240704,"internally_reserved":0,"allocated":1323008,"data_stored":4516416,"data_compressed":288089,"data_compressed_allocated":593920,"data_compressed_original":4100096,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":987136,"data_stored":4339063,"data_compressed":288019,"data_compressed_allocated":589824,"data_compressed_original":4050944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":1306247,"data_compressed":51096,"data_compressed_allocated":118784,"data_compressed_original":1159168,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":646488,"data_compressed":13610,"data_compressed_allocated":49152,"data_compressed_original":557056,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":708608,"data_stored":2551289,"data_compressed":144891,"data_compressed_allocated":315392,"data_compressed_original":2289664,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":2708390,"data_compressed":95574,"data_compressed_allocated":290816,"data_compressed_original":2469888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":1551861,"data_compressed":47537,"data_compressed_allocated":139264,"data_compressed_original":1318912,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":715070,"data_compressed":57533,"data_compressed_allocated":102400,"data_compressed_original":638976,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":667648,"data_stored":2882062,"data_compressed":135578,"data_compressed_allocated":303104,"data_compressed_original":2621440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:31:01.488 INFO:tasks.thrashosds.thrasher:Setting 2.0 to [2, 3, 1, 4] 2024-09-05T17:31:01.488 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.0', '2', '3', '1', '4'] 2024-09-05T17:31:01.488 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.0 2 3 1 4 2024-09-05T17:31:01.545 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:01.543+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:01.612 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:01.612 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:01.628 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:01.673 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:01.676+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:01.690 INFO:teuthology.orchestra.run.smithi050.stdout:956 read 0x80725ee thru 0x807f55b (0xcf6e bytes) 2024-09-05T17:31:01.690 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:01.690 INFO:teuthology.orchestra.run.smithi050.stdout:960 write 0x76e9337 thru 0x76f426e (0xaf38 bytes) 2024-09-05T17:31:01.713 INFO:teuthology.orchestra.run.smithi050.stdout:961 write 0x6fc4306 thru 0x6fc5b55 (0x1850 bytes) 2024-09-05T17:31:01.725 INFO:teuthology.orchestra.run.smithi050.stdout:962 read 0xafcaebf thru 0xafd2752 (0x7894 bytes) 2024-09-05T17:31:01.736 INFO:teuthology.orchestra.run.smithi050.stdout:964 trunc from 0xec9e052 to 0x508f5b3 2024-09-05T17:31:01.746 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:01.743+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:01.761 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:01.761 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:01.763 INFO:teuthology.orchestra.run.smithi050.stdout:965 punch from 0x4447803 to 0x444a815, (0x3012 bytes) 2024-09-05T17:31:01.763 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:01.779 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:01.780 INFO:teuthology.orchestra.run.smithi050.stdout:967 writesame 0x9fe2e6c thru 0x9fec01d data_size 0x11(0x91b2 bytes) 2024-09-05T17:31:01.781 INFO:teuthology.orchestra.run.smithi050.stdout:968 read 0x96d035f thru 0x96d6874 (0x6516 bytes) 2024-09-05T17:31:01.781 INFO:teuthology.orchestra.run.smithi050.stdout:969 punch from 0x9d7460f to 0x9d79d1b, (0x570c bytes) 2024-09-05T17:31:01.794 INFO:teuthology.orchestra.run.smithi050.stdout:970 write 0xb276325 thru 0xb282238 (0xbf14 bytes) 2024-09-05T17:31:01.817 INFO:teuthology.orchestra.run.smithi050.stdout:971 trunc from 0xb282239 to 0xe85893e 2024-09-05T17:31:01.825 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:01.825 INFO:teuthology.orchestra.run.smithi050.stdout:974 punch from 0x44f5f62 to 0x44fc1fe, (0x629c bytes) 2024-09-05T17:31:01.841 INFO:teuthology.orchestra.run.smithi050.stdout:975 trunc from 0xe85893e to 0x751f41 2024-09-05T17:31:01.846 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:01.848+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:01.936 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:01.936 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:01.948 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:01.947+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:01.952 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:02.049 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:02.052+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:02.118 INFO:teuthology.orchestra.run.smithi050.stdout:976 punch from 0x3ad648 to 0x3b073b, (0x30f3 bytes) 2024-09-05T17:31:02.127 INFO:teuthology.orchestra.run.smithi050.stdout:977 trunc from 0x751f41 to 0x4619cdc 2024-09-05T17:31:02.137 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:02.137 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:02.149 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:02.147+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:02.151 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:02.158 INFO:teuthology.orchestra.run.smithi050.stdout:979 writesame 0x98c1dc7 thru 0x98c370f data_size 0x1(0x1949 bytes) 2024-09-05T17:31:02.173 INFO:teuthology.orchestra.run.smithi050.stdout:980 write 0xbf5eaa9 thru 0xbf6a931 (0xbe89 bytes) 2024-09-05T17:31:02.190 INFO:teuthology.orchestra.run.smithi050.stdout:981 read 0x86cc9a1 thru 0x86d1345 (0x49a5 bytes) 2024-09-05T17:31:02.190 INFO:teuthology.orchestra.run.smithi050.stdout:982 writesame 0xb55d5a thru 0xb5aafa data_size 0x11(0x4da1 bytes) 2024-09-05T17:31:02.205 INFO:teuthology.orchestra.run.smithi050.stdout:984 read 0xbc2d56d thru 0xbc3d558 (0xffec bytes) 2024-09-05T17:31:02.223 INFO:teuthology.orchestra.run.smithi050.stdout:986 writesame 0xeb8e91b thru 0xeb9d96f data_size 0x1(0xf055 bytes) 2024-09-05T17:31:02.223 INFO:teuthology.orchestra.run.smithi050.stdout:987 clone 6 order 18 su 4096 sc 3 2024-09-05T17:31:02.250 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:02.247+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:02.315 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:02.315 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:02.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:02.351 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:02.352+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:02.452 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:02.452+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:02.503 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:02.503 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:02.505 INFO:teuthology.orchestra.run.smithi050.stderr:set 2.0 pg_upmap_items mapping to [2->3,1->4] 2024-09-05T17:31:02.520 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:02.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:31:02.564 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:02.563+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:02.645 INFO:teuthology.orchestra.run.smithi050.stdout:flattening image image_client.0-clone5 2024-09-05T17:31:02.649 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:02.649 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:02.653 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:02.656+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:02.664 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:02.754 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:02.751+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:02.838 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:02.839 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:02.853 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:02.896 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:02.895+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:02.956 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:02.956+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:03.045 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:03.046 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:03.057 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:03.060+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:03.061 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:03.158 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:03.160+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:03.194 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:03.194 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:03.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:03.259 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:03.260+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:03.336 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:03.336 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:03.351 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:03.357 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-05T17:31:03.359 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:03.360+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:03.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:03.460 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:03.460+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:03.472 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:03.472 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:03.486 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:03.502 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:31:03.535 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:03.536 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:03.553 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:03.553 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:03.561 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:03.559+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:03.578 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:03.579 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:03.597 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:03.597 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:03.609 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:03.609 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:03.617 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:03.617 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:03.623 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:03.635 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:03.635 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:03.653 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:03.653 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:03.668 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:03.667+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:03.673 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:03.673 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:03.674 INFO:teuthology.orchestra.run.smithi050.stdout:988 write 0x6336aa0 thru 0x63386ad (0x1c0e bytes) 2024-09-05T17:31:03.687 INFO:teuthology.orchestra.run.smithi050.stdout:989 write 0x98b0602 thru 0x98bbdec (0xb7eb bytes) 2024-09-05T17:31:03.698 INFO:teuthology.orchestra.run.smithi050.stdout:990 trunc from 0xeb9d970 to 0xabc3d2c 2024-09-05T17:31:03.722 INFO:teuthology.orchestra.run.smithi050.stdout:991 write 0xe5c35ec thru 0xe5d31b4 (0xfbc9 bytes) 2024-09-05T17:31:03.726 INFO:teuthology.orchestra.run.smithi050.stdout:992 write 0x78239a thru 0x78ebbe (0xc825 bytes) 2024-09-05T17:31:03.744 INFO:teuthology.orchestra.run.smithi050.stdout:993 punch from 0x560d07d to 0x56136d2, (0x6655 bytes) 2024-09-05T17:31:03.744 INFO:teuthology.orchestra.run.smithi050.stdout:994 punch from 0xd1b709d to 0xd1bb0b8, (0x401b bytes) 2024-09-05T17:31:03.744 INFO:teuthology.orchestra.run.smithi050.stdout:995 write 0xb586609 thru 0xb595e7c (0xf874 bytes) 2024-09-05T17:31:03.750 INFO:teuthology.orchestra.run.smithi050.stdout:996 write 0x816b39a thru 0x817abb8 (0xf81f bytes) 2024-09-05T17:31:03.760 INFO:teuthology.orchestra.run.smithi050.stdout:999 write 0x233831c thru 0x2341397 (0x907c bytes) 2024-09-05T17:31:03.762 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:03.759+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:03.770 INFO:teuthology.orchestra.run.smithi050.stdout:1000 writesame 0x9c7564f thru 0x9c7829e data_size 0x8(0x2c50 bytes) 2024-09-05T17:31:03.777 INFO:teuthology.orchestra.run.smithi050.stdout:1001 read 0x2aa3240 thru 0x2aa35f7 (0x3b8 bytes) 2024-09-05T17:31:03.777 INFO:teuthology.orchestra.run.smithi050.stdout:1002 write 0xc4c2c71 thru 0xc4cc943 (0x9cd3 bytes) 2024-09-05T17:31:03.783 INFO:teuthology.orchestra.run.smithi050.stdout:1004 writesame 0x9f562a4 thru 0x9f5c879 data_size 0x4f(0x65d6 bytes) 2024-09-05T17:31:03.789 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.789 INFO:teuthology.orchestra.run.smithi050.stdout:1007 write 0x2a58ad8 thru 0x2a6482b (0xbd54 bytes) 2024-09-05T17:31:03.795 INFO:teuthology.orchestra.run.smithi050.stdout:1008 write 0x266fae3 thru 0x267659f (0x6abd bytes) 2024-09-05T17:31:03.802 INFO:teuthology.orchestra.run.smithi050.stdout:1009 read 0x5110049 thru 0x5111d2f (0x1ce7 bytes) 2024-09-05T17:31:03.802 INFO:teuthology.orchestra.run.smithi050.stdout:1010 read 0xc6ebd20 thru 0xc6f6b57 (0xae38 bytes) 2024-09-05T17:31:03.802 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.803 INFO:teuthology.orchestra.run.smithi050.stdout:1012 write 0x997d52 thru 0x9a2d95 (0xb044 bytes) 2024-09-05T17:31:03.808 INFO:teuthology.orchestra.run.smithi050.stdout:1013 read 0xd3272da thru 0xd3322ad (0xafd4 bytes) 2024-09-05T17:31:03.814 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:03.814 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:03.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:03.814 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:03.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.814 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:31:03.814 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.798296802999999, 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:31:03.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:31:03.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:31:03.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:03.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:31:03.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:31:03.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:31:03.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12645 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 13072384~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.927136+0000", 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8880121509999999, 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043781948000000001, 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.822 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.823 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.823 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12645 2024-09-05T17:31:03.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.824 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.927136+0000", 2024-09-05T17:31:03.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.927136+0000", 2024-09-05T17:31:03.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.934749+0000", 2024-09-05T17:31:03.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0076135259999999998 2024-09-05T17:31:03.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.934757+0000", 2024-09-05T17:31:03.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7139999999999993e-06 2024-09-05T17:31:03.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.934768+0000", 2024-09-05T17:31:03.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1255e-05 2024-09-05T17:31:03.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.934776+0000", 2024-09-05T17:31:03.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1960000000000008e-06 2024-09-05T17:31:03.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.970816+0000", 2024-09-05T17:31:03.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.036039984999999997 2024-09-05T17:31:03.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.970867+0000", 2024-09-05T17:31:03.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0302000000000001e-05 2024-09-05T17:31:03.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.970918+0000", 2024-09-05T17:31:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0970000000000002e-05 2024-09-05T17:31:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12686 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 13760512~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.935383+0000", 2024-09-05T17:31:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8797644990000002, 2024-09-05T17:31:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042820947999999998, 2024-09-05T17:31:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.832 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12686 2024-09-05T17:31:03.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.935383+0000", 2024-09-05T17:31:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.935383+0000", 2024-09-05T17:31:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.942665+0000", 2024-09-05T17:31:03.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072816770000000003 2024-09-05T17:31:03.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.942668+0000", 2024-09-05T17:31:03.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.937e-06 2024-09-05T17:31:03.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.942675+0000", 2024-09-05T17:31:03.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7410000000000003e-06 2024-09-05T17:31:03.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.942679+0000", 2024-09-05T17:31:03.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6310000000000002e-06 2024-09-05T17:31:03.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.978038+0000", 2024-09-05T17:31:03.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.035358392000000002 2024-09-05T17:31:03.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.978123+0000", 2024-09-05T17:31:03.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5439000000000006e-05 2024-09-05T17:31:03.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.978204+0000", 2024-09-05T17:31:03.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1131000000000006e-05 2024-09-05T17:31:03.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.841 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.842 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12724 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14383104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.842 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943235+0000", 2024-09-05T17:31:03.842 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8719127259999997, 2024-09-05T17:31:03.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042956606000000001, 2024-09-05T17:31:03.843 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.843 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.843 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.843 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.843 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.844 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12724 2024-09-05T17:31:03.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943235+0000", 2024-09-05T17:31:03.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943235+0000", 2024-09-05T17:31:03.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943235+0000", 2024-09-05T17:31:03.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:31:03.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943237+0000", 2024-09-05T17:31:03.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:31:03.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943240+0000", 2024-09-05T17:31:03.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.552e-06 2024-09-05T17:31:03.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943243+0000", 2024-09-05T17:31:03.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0599999999999999e-06 2024-09-05T17:31:03.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986035+0000", 2024-09-05T17:31:03.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042791795000000001 2024-09-05T17:31:03.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986114+0000", 2024-09-05T17:31:03.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9195000000000003e-05 2024-09-05T17:31:03.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986192+0000", 2024-09-05T17:31:03.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7581000000000001e-05 2024-09-05T17:31:03.851 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.852 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12725 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14399488~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.852 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943247+0000", 2024-09-05T17:31:03.853 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8719008649999997, 2024-09-05T17:31:03.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043146497999999998, 2024-09-05T17:31:03.853 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12725 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943247+0000", 2024-09-05T17:31:03.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943247+0000", 2024-09-05T17:31:03.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943247+0000", 2024-09-05T17:31:03.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8299999999999998e-07 2024-09-05T17:31:03.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943248+0000", 2024-09-05T17:31:03.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.17e-06 2024-09-05T17:31:03.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943254+0000", 2024-09-05T17:31:03.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6280000000000002e-06 2024-09-05T17:31:03.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943257+0000", 2024-09-05T17:31:03.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1860000000000001e-06 2024-09-05T17:31:03.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986232+0000", 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042974525999999999 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986317+0000", 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4747999999999996e-05 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986394+0000", 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6957000000000002e-05 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12726 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14415872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943273+0000", 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8718746020000001, 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043317249000000002, 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12726 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943273+0000", 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943273+0000", 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943274+0000", 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0800000000000005e-07 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943279+0000", 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.648e-06 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943284+0000", 2024-09-05T17:31:03.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3579999999999996e-06 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943287+0000", 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2279999999999998e-06 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986432+0000", 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043145402999999999 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986511+0000", 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8577000000000003e-05 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986591+0000", 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9526999999999999e-05 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12727 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14432256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.864 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943292+0000", 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8718561490000001, 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043515229000000002, 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12727 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943292+0000", 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943292+0000", 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943292+0000", 2024-09-05T17:31:03.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9400000000000001e-07 2024-09-05T17:31:03.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943293+0000", 2024-09-05T17:31:03.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.263e-06 2024-09-05T17:31:03.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943297+0000", 2024-09-05T17:31:03.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5389999999999999e-06 2024-09-05T17:31:03.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943300+0000", 2024-09-05T17:31:03.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.066e-06 2024-09-05T17:31:03.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986641+0000", 2024-09-05T17:31:03.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043341478000000003 2024-09-05T17:31:03.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986731+0000", 2024-09-05T17:31:03.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9098000000000007e-05 2024-09-05T17:31:03.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986807+0000", 2024-09-05T17:31:03.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6390999999999994e-05 2024-09-05T17:31:03.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.872 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.872 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12728 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14448640~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.873 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943304+0000", 2024-09-05T17:31:03.873 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8718441459999999, 2024-09-05T17:31:03.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043706710000000003, 2024-09-05T17:31:03.873 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.873 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.873 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.874 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.874 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.874 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.874 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12728 2024-09-05T17:31:03.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.874 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943304+0000", 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943304+0000", 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943304+0000", 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6600000000000003e-07 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943305+0000", 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.136e-06 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943309+0000", 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943312+0000", 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0089999999999999e-06 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986851+0000", 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043539841000000003 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.986931+0000", 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9245000000000004e-05 2024-09-05T17:31:03.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987010+0000", 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9739000000000003e-05 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12729 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14465024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943316+0000", 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8718323430000003, 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043882867999999998, 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.878 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12729 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943316+0000", 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943316+0000", 2024-09-05T17:31:03.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943316+0000", 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7500000000000001e-07 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943317+0000", 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.291e-06 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943321+0000", 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5240000000000001e-06 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943324+0000", 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1e-06 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987037+0000", 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043713230999999998 2024-09-05T17:31:03.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987121+0000", 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4518999999999995e-05 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987198+0000", 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6928000000000006e-05 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12730 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14481408~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943328+0000", 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8718203349999998, 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044080319999999999, 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12730 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943328+0000", 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943328+0000", 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943328+0000", 2024-09-05T17:31:03.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943329+0000", 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943332+0000", 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.478e-06 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943335+0000", 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0580000000000002e-06 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987245+0000", 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043909721999999998 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987327+0000", 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2224000000000004e-05 2024-09-05T17:31:03.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987408+0000", 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0432999999999994e-05 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12731 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14497792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943339+0000", 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8718085320000002, 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044291170999999997, 2024-09-05T17:31:03.887 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12731 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943339+0000", 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943339+0000", 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943340+0000", 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6399999999999998e-07 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943341+0000", 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943344+0000", 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4920000000000002e-06 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943347+0000", 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2329999999999998e-06 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987460+0000", 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044112871999999997 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987551+0000", 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0447999999999999e-05 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987631+0000", 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9784999999999996e-05 2024-09-05T17:31:03.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.892 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.892 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.892 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12732 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14514176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.893 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943351+0000", 2024-09-05T17:31:03.893 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8717966080000004, 2024-09-05T17:31:03.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044489571999999998, 2024-09-05T17:31:03.893 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.893 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.893 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12732 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943351+0000", 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943351+0000", 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943352+0000", 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6e-07 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943353+0000", 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.314e-06 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943356+0000", 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.478e-06 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943359+0000", 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0910000000000001e-06 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987675+0000", 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044315977999999999 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987761+0000", 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5308000000000004e-05 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987841+0000", 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0142999999999995e-05 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12733 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14530560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943363+0000", 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8717846930000004, 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044690949000000001, 2024-09-05T17:31:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12733 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943363+0000", 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943363+0000", 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943363+0000", 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943365+0000", 2024-09-05T17:31:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1209999999999999e-06 2024-09-05T17:31:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943368+0000", 2024-09-05T17:31:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4800000000000001e-06 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943371+0000", 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.016e-06 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987890+0000", 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044518580000000002 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.987975+0000", 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5035000000000002e-05 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988054+0000", 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9456000000000006e-05 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12734 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14563328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943375+0000", 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8717729720000005, 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044887950000000003, 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12734 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943375+0000", 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943375+0000", 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943375+0000", 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7099999999999998e-07 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943376+0000", 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943380+0000", 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.433e-06 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943383+0000", 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1439999999999999e-06 2024-09-05T17:31:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988098+0000", 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044714853999999998 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988181+0000", 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2750999999999994e-05 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988263+0000", 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2262999999999995e-05 2024-09-05T17:31:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12735 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14546944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943387+0000", 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8717609299999998, 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045087815000000003, 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12735 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943387+0000", 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943387+0000", 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943387+0000", 2024-09-05T17:31:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6e-07 2024-09-05T17:31:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943388+0000", 2024-09-05T17:31:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.22e-06 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943392+0000", 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.439e-06 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943395+0000", 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9950000000000001e-06 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988313+0000", 2024-09-05T17:31:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044918538000000001 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988400+0000", 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6216000000000003e-05 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988475+0000", 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5147000000000004e-05 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12736 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14579712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943399+0000", 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8717492790000003, 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045283557000000002, 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12736 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943399+0000", 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943399+0000", 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943399+0000", 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6300000000000001e-07 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943400+0000", 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2470000000000001e-06 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943404+0000", 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4800000000000001e-06 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943407+0000", 2024-09-05T17:31:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.039e-06 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988518+0000", 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045111142 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988600+0000", 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1987e-05 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988682+0000", 2024-09-05T17:31:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2398999999999995e-05 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12737 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14612480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943411+0000", 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8717372709999998, 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045484793000000003, 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12737 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943411+0000", 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943411+0000", 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943411+0000", 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943412+0000", 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2330000000000001e-06 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943416+0000", 2024-09-05T17:31:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4819999999999999e-06 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943419+0000", 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8519999999999997e-06 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988729+0000", 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045309508999999998 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988816+0000", 2024-09-05T17:31:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988895+0000", 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9698999999999997e-05 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12738 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14596096~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943423+0000", 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8717244710000003, 2024-09-05T17:31:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045686732000000001, 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12738 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943423+0000", 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943423+0000", 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943424+0000", 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8799999999999998e-07 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943428+0000", 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2590000000000002e-06 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943432+0000", 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0489999999999997e-06 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943435+0000", 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.095e-06 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.988938+0000", 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045502948000000001 2024-09-05T17:31:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989022+0000", 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4017999999999994e-05 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989110+0000", 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8075e-05 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12739 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14628864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943453+0000", 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8716948499999999, 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045863226, 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12739 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943453+0000", 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943453+0000", 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943453+0000", 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.72e-07 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943455+0000", 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4470000000000001e-06 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943459+0000", 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0110000000000002e-06 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943462+0000", 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0900000000000001e-06 2024-09-05T17:31:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989159+0000", 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.045696579000000001 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989243+0000", 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4039e-05 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989316+0000", 2024-09-05T17:31:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3688000000000003e-05 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:12740 3.f 3:f6c8a987:::rbd_data.11403f2d9bbd.0000000000000006:6 [read 14645248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:58.943466+0000", 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8716814450000001, 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.046056694000000002, 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 12740 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943466+0000", 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.943466+0000", 2024-09-05T17:31:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.950624+0000", 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071575809999999997 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.950629+0000", 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7979999999999996e-06 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.950645+0000", 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.950652+0000", 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3749999999999999e-06 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989359+0000", 2024-09-05T17:31:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.038707631999999999 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989441+0000", 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1532999999999993e-05 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:58.989523+0000", 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2253e-05 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:03.934 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:03.934 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:03.936 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:1014 trunc from 0xe5d31b5 to 0x6abcfad 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:1015 write 0x7c2f99e thru 0x7c3d8f2 (0xdf55 bytes) 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:1019 punch from 0x2f3ac3c to 0x2f3fa08, (0x4dcc bytes) 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:1024 read 0x234119a thru 0x23413af (0x216 bytes) 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:1029 read 0x1bb605f thru 0x1bbfa7b (0x9a1d bytes) 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:1031 writesame 0x1c65aaf thru 0x1c70e73 data_size 0x1(0xb3c5 bytes) 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.937 INFO:teuthology.orchestra.run.smithi050.stdout:1035 punch from 0x577ae48 to 0x5786a8b, (0xbc43 bytes) 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:1037 write 0x600eecc thru 0x601deb7 (0xefec bytes) 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:1038 writesame 0xb6254f2 thru 0xb62d35c data_size 0x1(0x7e6b bytes) 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:1039 write 0x72e543b thru 0x72f454d (0xf113 bytes) 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:1041 write 0xa01bbb8 thru 0xa021826 (0x5c6f bytes) 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:1042 read 0xaf68ee5 thru 0xaf779c0 (0xeadc bytes) 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:1043 read 0x7e53e23 thru 0x7e55972 (0x1b50 bytes) 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.938 INFO:teuthology.orchestra.run.smithi050.stdout:1045 punch from 0x9a0bc3 to 0x9a9901, (0x8d3e bytes) 2024-09-05T17:31:03.938 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:03.936+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:03.939 INFO:teuthology.orchestra.run.smithi050.stdout:1046 trunc from 0xb62d35d to 0x635ef99 2024-09-05T17:31:03.964 INFO:teuthology.orchestra.run.smithi050.stdout:1047 write 0x569186f thru 0x56a10b7 (0xf849 bytes) 2024-09-05T17:31:03.977 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.977 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:03.977 INFO:teuthology.orchestra.run.smithi050.stdout:1050 read 0x2728d40 thru 0x2728fcf (0x290 bytes) 2024-09-05T17:31:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:1051 trunc from 0x635ef99 to 0xed1d662 2024-09-05T17:31:03.999 INFO:teuthology.orchestra.run.smithi050.stdout:1052 read 0x27e88de thru 0x27f7160 (0xe883 bytes) 2024-09-05T17:31:03.999 INFO:teuthology.orchestra.run.smithi050.stdout:1053 writesame 0x9f38615 thru 0x9f41c02 data_size 0x3(0x95ee bytes) 2024-09-05T17:31:04.016 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.016 INFO:teuthology.orchestra.run.smithi050.stdout:1056 write 0x9f175b7 thru 0x9f208c0 (0x930a bytes) 2024-09-05T17:31:04.020 INFO:teuthology.orchestra.run.smithi050.stdout:1057 punch from 0x8a51eaf to 0x8a5c2da, (0xa42b bytes) 2024-09-05T17:31:04.020 INFO:teuthology.orchestra.run.smithi050.stdout:1060 write 0xeb1fe39 thru 0xeb2d4b6 (0xd67e bytes) 2024-09-05T17:31:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:1063 read 0xaa2f208 thru 0xaa3a667 (0xb460 bytes) 2024-09-05T17:31:04.029 INFO:teuthology.orchestra.run.smithi050.stdout:1065 write 0x512e1f1 thru 0x5137b28 (0x9938 bytes) 2024-09-05T17:31:04.036 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:04.036+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:04.041 INFO:teuthology.orchestra.run.smithi050.stdout:1066 write 0x3428133 thru 0x34378c8 (0xf796 bytes) 2024-09-05T17:31:04.052 INFO:teuthology.orchestra.run.smithi050.stdout:1067 write 0xd4a6e67 thru 0xd4ac12d (0x52c7 bytes) 2024-09-05T17:31:04.074 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:04.075 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:04.075 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:04.075 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:04.075 INFO:teuthology.orchestra.run.smithi050.stdout:1068 writesame 0xedbcbd5 thru 0xedc004d data_size 0x13(0x3479 bytes) 2024-09-05T17:31:04.094 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:04.095 INFO:teuthology.orchestra.run.smithi050.stdout:1069 trunc from 0xedc004e to 0x5157710 2024-09-05T17:31:04.122 INFO:teuthology.orchestra.run.smithi050.stdout:1070 punch from 0x1c801af to 0x1c85193, (0x4fe4 bytes) 2024-09-05T17:31:04.122 INFO:teuthology.orchestra.run.smithi050.stdout:1071 read 0x2268033 thru 0x226d66d (0x563b bytes) 2024-09-05T17:31:04.130 INFO:teuthology.orchestra.run.smithi050.stdout:1073 trunc from 0x5157710 to 0xcacc86d 2024-09-05T17:31:04.137 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:04.140+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:04.154 INFO:teuthology.orchestra.run.smithi050.stdout:1077 writesame 0xd01b5f3 thru 0xd0200a1 data_size 0x1(0x4aaf bytes) 2024-09-05T17:31:04.155 INFO:teuthology.orchestra.run.smithi050.stdout:1078 read 0x951e9a4 thru 0x952ab9e (0xc1fb bytes) 2024-09-05T17:31:04.158 INFO:teuthology.orchestra.run.smithi050.stdout:1079 trunc from 0xd0200a2 to 0x9c55ba6 2024-09-05T17:31:04.171 INFO:teuthology.orchestra.run.smithi050.stdout:1080 read 0x1e6aae7 thru 0x1e6b372 (0x88c bytes) 2024-09-05T17:31:04.171 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.186 INFO:teuthology.orchestra.run.smithi050.stdout:1082 writesame 0xc321639 thru 0xc3256d4 data_size 0xa(0x409c bytes) 2024-09-05T17:31:04.186 INFO:teuthology.orchestra.run.smithi050.stdout:1083 write 0x574d4de thru 0x5757fb8 (0xaadb bytes) 2024-09-05T17:31:04.196 INFO:teuthology.orchestra.run.smithi050.stdout:1084 writesame 0x3870309 thru 0x3873e53 data_size 0x1(0x3b4b bytes) 2024-09-05T17:31:04.211 INFO:teuthology.orchestra.run.smithi050.stdout:1085 punch from 0x401c9d6 to 0x4027ddf, (0xb409 bytes) 2024-09-05T17:31:04.211 INFO:teuthology.orchestra.run.smithi050.stdout:1086 write 0x2406146 thru 0x241056c (0xa427 bytes) 2024-09-05T17:31:04.223 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.223 INFO:teuthology.orchestra.run.smithi050.stdout:1090 write 0x6f8a761 thru 0x6f95304 (0xaba4 bytes) 2024-09-05T17:31:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:04.226 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:04.226 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:04.226 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:04.226 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:04.234 INFO:teuthology.orchestra.run.smithi050.stdout:1091 write 0x801408a thru 0x8016d0e (0x2c85 bytes) 2024-09-05T17:31:04.237 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:04.240+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:04.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:04.246 INFO:teuthology.orchestra.run.smithi050.stdout:1093 writesame 0x8e982ed thru 0x8ea36af data_size 0x1(0xb3c3 bytes) 2024-09-05T17:31:04.286 INFO:teuthology.orchestra.run.smithi050.stdout:1097 trunc from 0xc3256d5 to 0x66217cf 2024-09-05T17:31:04.309 INFO:teuthology.orchestra.run.smithi050.stdout:1098 punch from 0x1d60117 to 0x1d61230, (0x1119 bytes) 2024-09-05T17:31:04.309 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.309 INFO:teuthology.orchestra.run.smithi050.stdout:1100 write 0x2c48cc2 thru 0x2c4b60f (0x294e bytes) 2024-09-05T17:31:04.317 INFO:teuthology.orchestra.run.smithi050.stdout:1101 read 0x35b0b38 thru 0x35be120 (0xd5e9 bytes) 2024-09-05T17:31:04.323 INFO:teuthology.orchestra.run.smithi050.stdout:1104 trunc from 0x66217cf to 0x23086ca 2024-09-05T17:31:04.337 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:04.340+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:04.357 INFO:teuthology.orchestra.run.smithi050.stdout:1105 punch from 0x18c2ee1 to 0x18cffa2, (0xd0c1 bytes) 2024-09-05T17:31:04.372 INFO:teuthology.orchestra.run.smithi050.stdout:1106 trunc from 0x23086ca to 0xbd7b155 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3051895949999999, 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:31:04.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3051611789999997, 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.391 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:31:04.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.395 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3051392530000001, 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.396 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:04.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.400 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3051178060000002, 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.401 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:31:04.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.405 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3050795160000002, 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:31:04.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3050647, 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:31:04.410 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:31:04.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3050535009999997, 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:31:04.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.419 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.305042662, 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:31:04.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.305032185, 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:31:04.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:31:04.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:31:04.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:04.429 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3050213629999998, 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:04.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:31:04.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.305010963, 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:31:04.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3049926110000003, 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:31:04.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:31:04.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.443 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3048089870000004, 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:31:04.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16657 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7360512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091766+0000", 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2961866390000001, 2024-09-05T17:31:04.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053082995000000001, 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16657 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091766+0000", 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091766+0000", 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091766+0000", 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4600000000000005e-07 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091770+0000", 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1669999999999999e-06 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091778+0000", 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.242e-06 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091784+0000", 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0469999999999999e-06 2024-09-05T17:31:04.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144745+0000", 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052960636999999998 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144790+0000", 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5587000000000002e-05 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144849+0000", 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8768999999999999e-05 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2961496930000003, 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.453 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2961091519999997, 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:31:04.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:31:04.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2960693230000002, 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.463 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:31:04.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:04.467 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2960418479999998, 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:31:04.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2960033390000003, 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:31:04.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:31:04.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2959605989999998, 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:04.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:04.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:04.482 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:04.482 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.482 INFO:teuthology.orchestra.run.smithi050.stdout:1108 write 0xcd571b thru 0xcdfee9 (0xa7cf bytes) 2024-09-05T17:31:04.482 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.482 INFO:teuthology.orchestra.run.smithi050.stdout:1113 read 0x55e9b62 thru 0x55ea30c (0x7ab bytes) 2024-09-05T17:31:04.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:04.484 INFO:teuthology.orchestra.run.smithi050.stdout:1116 write 0xdb9ef6f thru 0xdba8d30 (0x9dc2 bytes) 2024-09-05T17:31:04.484 INFO:teuthology.orchestra.run.smithi050.stdout:1117 read 0x379f7e0 thru 0x37a05f5 (0xe16 bytes) 2024-09-05T17:31:04.484 INFO:teuthology.orchestra.run.smithi050.stdout:1118 writesame 0x37db8ca thru 0x37e4721 data_size 0x14(0x8e58 bytes) 2024-09-05T17:31:04.485 INFO:teuthology.orchestra.run.smithi050.stdout:1119 write 0x68a79b6 thru 0x68b5d3e (0xe389 bytes) 2024-09-05T17:31:04.485 INFO:teuthology.orchestra.run.smithi050.stdout:1120 read 0xcfe0e47 thru 0xcfec1c2 (0xb37c bytes) 2024-09-05T17:31:04.485 INFO:teuthology.orchestra.run.smithi050.stdout:1122 trunc from 0xdba8d31 to 0x4b8ff95 2024-09-05T17:31:04.486 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:04.483+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:04.487 INFO:teuthology.orchestra.run.smithi050.stdout:1123 read 0x170734d thru 0x17110a7 (0x9d5b bytes) 2024-09-05T17:31:04.520 INFO:teuthology.orchestra.run.smithi050.stdout:1124 writesame 0xc181523 thru 0xc18fe99 data_size 0x1(0xe977 bytes) 2024-09-05T17:31:04.520 INFO:teuthology.orchestra.run.smithi050.stdout:1125 read 0x554db74 thru 0x5553f55 (0x63e2 bytes) 2024-09-05T17:31:04.520 INFO:teuthology.orchestra.run.smithi050.stdout:1126 punch from 0x48b55e to 0x48f1c2, (0x3c64 bytes) 2024-09-05T17:31:04.520 INFO:teuthology.orchestra.run.smithi050.stdout:1127 read 0x479a1b8 thru 0x47a44e7 (0xa330 bytes) 2024-09-05T17:31:04.524 INFO:teuthology.orchestra.run.smithi050.stdout:1129 trunc from 0xc18fe9a to 0xa57efa3 2024-09-05T17:31:04.536 INFO:teuthology.orchestra.run.smithi050.stdout:1130 writesame 0x50264f7 thru 0x502dc4a data_size 0xe(0x7754 bytes) 2024-09-05T17:31:04.546 INFO:teuthology.orchestra.run.smithi050.stdout:1131 writesame 0xa5206be thru 0xa52a21d data_size 0x71(0x9b60 bytes) 2024-09-05T17:31:04.570 INFO:teuthology.orchestra.run.smithi050.stdout:1133 write 0xbe2f55a thru 0xbe303cd (0xe74 bytes) 2024-09-05T17:31:04.586 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:04.583+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:04.600 INFO:teuthology.orchestra.run.smithi050.stdout:1135 write 0xeba5779 thru 0xeba6759 (0xfe1 bytes) 2024-09-05T17:31:04.629 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:04.629 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:04.629 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:04.630 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:04.639 INFO:teuthology.orchestra.run.smithi050.stdout:1136 trunc from 0xeba675a to 0x9b4cd1 2024-09-05T17:31:04.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:04.693 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:04.696+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:04.716 INFO:teuthology.orchestra.run.smithi050.stdout:1137 writesame 0xb63989f thru 0xb644e94 data_size 0x1(0xb5f6 bytes) 2024-09-05T17:31:04.716 INFO:teuthology.orchestra.run.smithi050.stdout:1138 read 0x2b1e182 thru 0x2b2786d (0x96ec bytes) 2024-09-05T17:31:04.734 INFO:teuthology.orchestra.run.smithi050.stdout:1140 write 0xd9b5a83 thru 0xd9c17f4 (0xbd72 bytes) 2024-09-05T17:31:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:1144 read 0x310e219 thru 0x31129ca (0x47b2 bytes) 2024-09-05T17:31:04.745 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.773 INFO:teuthology.orchestra.run.smithi050.stdout:1147 trunc from 0xd9c17f5 to 0x1cc29a7 2024-09-05T17:31:04.823 INFO:teuthology.orchestra.run.smithi050.stdout:1148 writesame 0x4464d93 thru 0x4468f7d data_size 0x4b(0x41eb bytes) 2024-09-05T17:31:04.823 INFO:teuthology.orchestra.run.smithi050.stdout:1149 read 0x102abae thru 0x1036493 (0xb8e6 bytes) 2024-09-05T17:31:04.823 INFO:teuthology.orchestra.run.smithi050.stdout:1150 read 0x30d7785 thru 0x30dc281 (0x4afd bytes) 2024-09-05T17:31:04.824 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.824 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.824 INFO:teuthology.orchestra.run.smithi050.stdout:1154 read 0x42cd714 thru 0x42d2801 (0x50ee bytes) 2024-09-05T17:31:04.824 INFO:teuthology.orchestra.run.smithi050.stdout:1155 punch from 0x3b802b0 to 0x3b8634e, (0x609e bytes) 2024-09-05T17:31:04.824 INFO:teuthology.orchestra.run.smithi050.stdout:1158 writesame 0xdd7d60 thru 0xddae62 data_size 0x1(0x3103 bytes) 2024-09-05T17:31:04.825 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:04.818+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:04.834 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:04.835 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:04.835 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:04.835 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:04.835 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:04.837 INFO:teuthology.orchestra.run.smithi050.stdout:1159 punch from 0x1e3dad1 to 0x1e441f3, (0x6722 bytes) 2024-09-05T17:31:04.861 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:04.862 INFO:teuthology.orchestra.run.smithi050.stdout:1160 writesame 0xaa783b8 thru 0xaa841db data_size 0x2b(0xbe24 bytes) 2024-09-05T17:31:04.865 INFO:teuthology.orchestra.run.smithi050.stdout:1161 trunc from 0xaa841dc to 0xccad32c 2024-09-05T17:31:04.878 INFO:teuthology.orchestra.run.smithi050.stdout:1163 read 0x610604 thru 0x615087 (0x4a84 bytes) 2024-09-05T17:31:04.885 INFO:teuthology.orchestra.run.smithi050.stdout:1164 trunc from 0xccad32c to 0x93f79a6 2024-09-05T17:31:04.896 INFO:teuthology.orchestra.run.smithi050.stdout:1165 read 0x42c5c95 thru 0x42d0e4b (0xb1b7 bytes) 2024-09-05T17:31:04.897 INFO:teuthology.orchestra.run.smithi050.stdout:1167 write 0x8f3f88 thru 0x8fcc7b (0x8cf4 bytes) 2024-09-05T17:31:04.923 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:04.918+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:04.926 INFO:teuthology.orchestra.run.smithi050.stdout:1168 writesame 0xce64651 thru 0xce6698e data_size 0x2(0x233e bytes) 2024-09-05T17:31:04.926 INFO:teuthology.orchestra.run.smithi050.stdout:1169 write 0x9b2da5 thru 0x9b3580 (0x7dc bytes) 2024-09-05T17:31:04.929 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:04.929 INFO:teuthology.orchestra.run.smithi050.stdout:1171 write 0x628e544 thru 0x629d33f (0xedfc bytes) 2024-09-05T17:31:04.942 INFO:teuthology.orchestra.run.smithi050.stdout:1172 read 0x4397e36 thru 0x439fd64 (0x7f2f bytes) 2024-09-05T17:31:04.960 INFO:teuthology.orchestra.run.smithi050.stdout:1173 trunc from 0xce6698f to 0x342b338 2024-09-05T17:31:04.989 INFO:teuthology.orchestra.run.smithi050.stdout:1174 trunc from 0x342b338 to 0x790a0a7 2024-09-05T17:31:04.995 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:04.995 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:04.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:04.995 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:04.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.995 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15042 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8564736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:04.995 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2351800439999998, 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054711072999999999, 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15042 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:04.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:04.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763434+0000", 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3910000000000001e-06 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763441+0000", 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1130000000000003e-06 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:04.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763449+0000", 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4059999999999999e-06 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.817943+0000", 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054494611999999998 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818037+0000", 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3430999999999994e-05 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:04.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818143+0000", 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010574 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15043 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8581120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2351552889999997, 2024-09-05T17:31:05.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054839756000000003, 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15043 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763457+0000", 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9700000000000002e-07 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763459+0000", 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2079999999999999e-06 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763466+0000", 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4869999999999996e-06 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763472+0000", 2024-09-05T17:31:05.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4099999999999999e-06 2024-09-05T17:31:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818179+0000", 2024-09-05T17:31:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054706751999999997 2024-09-05T17:31:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818235+0000", 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6433e-05 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818296+0000", 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1068999999999994e-05 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15044 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8597504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2351319370000002, 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055068822000000003, 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15044 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763482+0000", 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3120000000000001e-06 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763489+0000", 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8020000000000003e-06 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763494+0000", 2024-09-05T17:31:05.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.276e-06 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818342+0000", 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054847104000000001 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818431+0000", 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9835999999999998e-05 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818548+0000", 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011708499999999999 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15045 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8613888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:05.010 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2351096840000002, 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055286647000000001, 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15045 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763505+0000", 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763511+0000", 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.533e-06 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763517+0000", 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3979999999999998e-06 2024-09-05T17:31:05.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818594+0000", 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055077706999999997 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818679+0000", 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4797999999999997e-05 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818789+0000", 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109369 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15046 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8630272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2350728230000003, 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055492107999999998, 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15046 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5699999999999998e-07 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763542+0000", 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6860000000000002e-06 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763550+0000", 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9859999999999994e-06 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763556+0000", 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0610000000000001e-06 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818833+0000", 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055276618 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818932+0000", 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9474000000000003e-05 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819031+0000", 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8826000000000006e-05 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.019 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15047 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8646656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2350465460000004, 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055685474999999998, 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.020 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15047 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763566+0000", 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763568+0000", 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7049999999999999e-06 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763576+0000", 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6340000000000001e-06 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763581+0000", 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.519e-06 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819078+0000", 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055496668999999998 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819175+0000", 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6883000000000001e-05 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819250+0000", 2024-09-05T17:31:05.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5462000000000004e-05 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15048 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8663040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2350216290000002, 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055952927999999999, 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15048 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:05.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3599999999999999e-07 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763593+0000", 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6589999999999999e-06 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763600+0000", 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0879999999999997e-06 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763607+0000", 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6649999999999997e-06 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819308+0000", 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055701181000000002 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819418+0000", 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109755 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819543+0000", 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012514399999999999 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.029 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15049 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8679424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2349966129999999, 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056101897999999997, 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15049 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:05.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.63e-07 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763618+0000", 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5959999999999998e-06 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763625+0000", 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9879999999999998e-06 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763631+0000", 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6069999999999998e-06 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819610+0000", 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055979244999999997 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819655+0000", 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5488999999999998e-05 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819717+0000", 2024-09-05T17:31:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1509999999999999e-05 2024-09-05T17:31:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.034 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.036 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15050 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8695808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2349683020000004, 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056583593000000001, 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15050 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763644+0000", 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2600000000000002e-07 2024-09-05T17:31:05.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763647+0000", 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763654+0000", 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0119999999999999e-06 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763659+0000", 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639999999999997e-06 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819747+0000", 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056088302 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820111+0000", 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036350299999999999 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820227+0000", 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011605 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15051 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8712192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2349444170000003, 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056866834999999998, 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.041 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15051 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763668+0000", 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7899999999999999e-07 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763670+0000", 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3580000000000001e-06 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763677+0000", 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9809999999999997e-06 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763682+0000", 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3499999999999996e-06 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820263+0000", 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056581285000000002 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820427+0000", 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016371100000000001 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820534+0000", 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106771 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.046 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15052 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8728576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2349218759999996, 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057071953000000002, 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15052 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.047 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9099999999999999e-07 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763692+0000", 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.092e-06 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763699+0000", 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5470000000000002e-06 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763704+0000", 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1039999999999998e-06 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820568+0000", 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056863805000000003 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820665+0000", 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7090999999999996e-05 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820762+0000", 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6922999999999993e-05 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15053 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8744960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2348998829999998, 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057269911999999999, 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15053 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763714+0000", 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3489999999999999e-06 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763721+0000", 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3119999999999999e-06 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763725+0000", 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.741e-06 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820794+0000", 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057069021999999997 2024-09-05T17:31:05.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820883+0000", 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8739999999999994e-05 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820982+0000", 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8368000000000004e-05 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15054 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8761344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2348770240000002, 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057438612999999999, 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15054 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2e-07 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763737+0000", 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4140000000000001e-06 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763744+0000", 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8279999999999997e-06 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763755+0000", 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1126e-05 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821013+0000", 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057257844000000002 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821087+0000", 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3651000000000003e-05 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821173+0000", 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6329999999999995e-05 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.061 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15055 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8777728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2348494250000002, 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.05769469, 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.062 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15055 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763763+0000", 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0600000000000001e-07 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763765+0000", 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.12e-06 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763770+0000", 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8209999999999998e-06 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763777+0000", 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999999e-06 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821205+0000", 2024-09-05T17:31:05.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057428078 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821292+0000", 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6842000000000006e-05 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821457+0000", 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016531299999999999 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15056 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8794112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2348275749999997, 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057974700999999997, 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15056 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763786+0000", 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1229999999999998e-06 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763794+0000", 2024-09-05T17:31:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1590000000000004e-06 2024-09-05T17:31:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763799+0000", 2024-09-05T17:31:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9309999999999999e-06 2024-09-05T17:31:05.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821490+0000", 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057691872999999998 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821616+0000", 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125327 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821759+0000", 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014289500000000001 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15057 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8810496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2348059720000002, 2024-09-05T17:31:05.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058215998999999997, 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15057 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:05.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4300000000000003e-07 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763808+0000", 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0379999999999998e-06 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763816+0000", 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763821+0000", 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0429999999999998e-06 2024-09-05T17:31:05.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821799+0000", 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057977385999999999 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821909+0000", 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110801 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822022+0000", 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000112185 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15058 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8826880~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2347676950000004, 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058413768999999997, 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.078 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15058 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770678+0000", 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068342020000000002 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770685+0000", 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.063e-06 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770696+0000", 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1225e-05 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770704+0000", 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3880000000000002e-06 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822073+0000", 2024-09-05T17:31:05.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.051369608999999997 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822153+0000", 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9225000000000001e-05 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822258+0000", 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010505699999999999 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15079 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9170944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.227630714, 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054753171000000003, 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15079 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7500000000000001e-07 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770982+0000", 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770986+0000", 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.225e-06 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770989+0000", 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825631+0000", 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054642257999999999 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825680+0000", 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9026000000000001e-05 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825734+0000", 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4218000000000002e-05 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15080 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9187328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2276018649999996, 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054872632999999997, 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15080 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.088 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:05.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8599999999999999e-07 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771012+0000", 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.57e-06 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771016+0000", 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1919999999999998e-06 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771019+0000", 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0790000000000001e-06 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825770+0000", 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054750974000000001 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825820+0000", 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9873999999999997e-05 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825882+0000", 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2558000000000007e-05 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.092 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15081 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9203712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.2275786750000002, 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054991252999999997, 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15081 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778817+0000", 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077838489999999998 2024-09-05T17:31:05.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778822+0000", 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9910000000000002e-06 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778831+0000", 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2089999999999994e-06 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778837+0000", 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8289999999999996e-06 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825928+0000", 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047091230999999997 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825972+0000", 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3964000000000001e-05 2024-09-05T17:31:05.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.826024+0000", 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2179999999999998e-05 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.097 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:05.098 INFO:teuthology.orchestra.run.smithi050.stdout:1175 writesame 0x3617186 thru 0x3617dac data_size 0x11(0xc27 bytes) 2024-09-05T17:31:05.098 INFO:teuthology.orchestra.run.smithi050.stdout:1177 read 0x76edd07 thru 0x76f1baa (0x3ea4 bytes) 2024-09-05T17:31:05.098 INFO:teuthology.orchestra.run.smithi050.stdout:1178 writesame 0x3d486ff thru 0x3d57c07 data_size 0x95(0xf509 bytes) 2024-09-05T17:31:05.100 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:1180 write 0xf6db28 thru 0xf7441f (0x68f8 bytes) 2024-09-05T17:31:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:1181 read 0x37c9d6 thru 0x38bc6c (0xf297 bytes) 2024-09-05T17:31:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:1182 read 0x5ac119e thru 0x5acad93 (0x9bf6 bytes) 2024-09-05T17:31:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:1183 read 0x4655b11 thru 0x4659d0c (0x41fc bytes) 2024-09-05T17:31:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:1185 read 0x6689e13 thru 0x668b4d2 (0x16c0 bytes) 2024-09-05T17:31:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:1187 write 0x7c26bf2 thru 0x7c3696a (0xfd79 bytes) 2024-09-05T17:31:05.101 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:05.102 INFO:teuthology.orchestra.run.smithi050.stdout:1190 write 0x2f985dc thru 0x2f9fafa (0x751f bytes) 2024-09-05T17:31:05.102 INFO:teuthology.orchestra.run.smithi050.stdout:1192 write 0x8d4c505 thru 0x8d541e0 (0x7cdc bytes) 2024-09-05T17:31:05.102 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:05.094+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:05.117 INFO:teuthology.orchestra.run.smithi050.stdout:1194 write 0x9cc8439 thru 0x9ccad5f (0x2927 bytes) 2024-09-05T17:31:05.128 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:05.142 INFO:teuthology.orchestra.run.smithi050.stdout:1197 trunc from 0x9ccad60 to 0x4f43bf5 2024-09-05T17:31:05.191 INFO:teuthology.orchestra.run.smithi050.stdout:1198 write 0x7df9612 thru 0x7dfef79 (0x5968 bytes) 2024-09-05T17:31:05.200 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:05.198+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:05.202 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:05.202 INFO:teuthology.orchestra.run.smithi050.stdout:1201 punch from 0x7b036e1 to 0x7b0617c, (0x2a9b bytes) 2024-09-05T17:31:05.202 INFO:teuthology.orchestra.run.smithi050.stdout:1202 writesame 0x1870a0 thru 0x18b1de data_size 0x1(0x413f bytes) 2024-09-05T17:31:05.268 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:05.268 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:05.268 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:05.285 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:05.290 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:05.290 INFO:teuthology.orchestra.run.smithi050.stdout:1206 punch from 0x5dcc6f5 to 0x5dd070a, (0x4015 bytes) 2024-09-05T17:31:05.290 INFO:teuthology.orchestra.run.smithi050.stdout:1207 read 0x4e18b4a thru 0x4e1cf01 (0x43b8 bytes) 2024-09-05T17:31:05.290 INFO:teuthology.orchestra.run.smithi050.stdout:1208 punch from 0x6469d74 to 0x6474a3f, (0xaccb bytes) 2024-09-05T17:31:05.290 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:05.291 INFO:teuthology.orchestra.run.smithi050.stdout:1210 read 0x990fed thru 0x99b04a (0xa05e bytes) 2024-09-05T17:31:05.301 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:05.298+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:05.304 INFO:teuthology.orchestra.run.smithi050.stdout:1211 write 0x7fcd6f4 thru 0x7fdcd4d (0xf65a bytes) 2024-09-05T17:31:05.313 INFO:teuthology.orchestra.run.smithi050.stdout:1214 punch from 0x76aeabf to 0x76bcb66, (0xe0a7 bytes) 2024-09-05T17:31:05.313 INFO:teuthology.orchestra.run.smithi050.stdout:1218 write 0x756caad thru 0x757032e (0x3882 bytes) 2024-09-05T17:31:05.323 INFO:teuthology.orchestra.run.smithi050.stdout:1219 clone 7 order 18 su 32768 sc 13 2024-09-05T17:31:05.401 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:05.404+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:05.441 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:05.442 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:05.442 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:05.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:05.502 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:05.498+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:05.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:31:05.603 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:05.604+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:05.623 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.623 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4257.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.576998519, 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002468479, 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049864+0000", 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0800000000000004e-07 2024-09-05T17:31:05.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049878+0000", 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4165000000000001e-05 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049896+0000", 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8436000000000001e-05 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049914+0000", 2024-09-05T17:31:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7229999999999999e-05 2024-09-05T17:31:05.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050094+0000", 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180564 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050134+0000", 2024-09-05T17:31:05.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9595000000000003e-05 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052268+0000", 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021347580000000001 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052332+0000", 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3022999999999996e-05 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.629 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3446 3.9 e28/24 3:91eb5b84:::rbd_data.114070605229.00000000000000ab:head v 28'5, mlcod=28'3)", 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.383375436, 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019348169999999999, 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243489+0000", 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8059999999999999e-06 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243530+0000", 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1083e-05 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243568+0000", 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7987000000000001e-05 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243583+0000", 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5492999999999999e-05 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243709+0000", 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012500799999999999 2024-09-05T17:31:05.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243759+0000", 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0838999999999999e-05 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.245343+0000", 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001584006 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.245421+0000", 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7595000000000005e-05 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.380548088999999, 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.635 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:31:05.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:31:05.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:31:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:31:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3604 3.4 e28/24 3:27555207:::rbd_data.114070605229.00000000000000e7:head v 28'21, mlcod=28'19)", 2024-09-05T17:31:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.178558369999999, 2024-09-05T17:31:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028585849999999999, 2024-09-05T17:31:05.643 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:05.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448306+0000", 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448357+0000", 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0719e-05 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448402+0000", 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5166000000000001e-05 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448426+0000", 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3813999999999999e-05 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448574+0000", 2024-09-05T17:31:05.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014806500000000001 2024-09-05T17:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448613+0000", 2024-09-05T17:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8353999999999999e-05 2024-09-05T17:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.647 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.649 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451052+0000", 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024396909999999999 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451162+0000", 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109533 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.650 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:7801 3.0 e30/24 3:00d91651:::rbd_data.1140d4ae3aec.0000000000000025:head v 30'105, mlcod=30'102)", 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.28987339, 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022194089999999999, 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336989+0000", 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.316e-06 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337179+0000", 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018963199999999999 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337195+0000", 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5880999999999999e-05 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337202+0000", 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3189999999999997e-06 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337272+0000", 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9333999999999997e-05 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337289+0000", 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7445999999999999e-05 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339156+0000", 2024-09-05T17:31:05.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001866988 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339208+0000", 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1493000000000003e-05 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:12781 3.4 e33/24 3:2593df46:::rbd_data.11403aa71fdc.00000000000002f3:head v 33'79, mlcod=30'76)", 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:05.655 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.6025919689999997, 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019698900000000002, 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024272+0000", 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3889999999999999e-06 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024292+0000", 2024-09-05T17:31:05.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0434000000000001e-05 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024324+0000", 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1615000000000001e-05 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024338+0000", 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024491+0000", 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015269900000000001 2024-09-05T17:31:05.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024555+0000", 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3398000000000005e-05 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026149+0000", 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00159431 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026239+0000", 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0637000000000007e-05 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27055 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'125, mlcod=36'123)", 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:03.867050+0000", 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.7598119859999999, 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018541479999999999, 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.660 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867050+0000", 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867050+0000", 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867051+0000", 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7039999999999999e-06 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867061+0000", 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9329999999999996e-06 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867088+0000", 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6766000000000001e-05 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867101+0000", 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2831e-05 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867245+0000", 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014468099999999999 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867281+0000", 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5706e-05 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.868838+0000", 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015569589999999999 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.868904+0000", 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5568000000000006e-05 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27061 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'128, mlcod=36'126)", 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.7386058879999999, 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019078750000000001, 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:05.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888257+0000", 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.173e-06 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888263+0000", 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1149999999999999e-06 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888283+0000", 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9684e-05 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888289+0000", 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4649999999999999e-06 2024-09-05T17:31:05.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888406+0000", 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011736299999999999 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888473+0000", 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6657999999999998e-05 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.890104+0000", 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016305410000000001 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.890164+0000", 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9876000000000001e-05 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.669 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27251 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'174, mlcod=36'172)", 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.4079183419999999, 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025164060000000001, 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218944+0000", 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.057e-06 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218953+0000", 2024-09-05T17:31:05.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5369999999999997e-06 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218974+0000", 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0772e-05 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218986+0000", 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219118+0000", 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132638 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219177+0000", 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8270000000000003e-05 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221306+0000", 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002128956 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221460+0000", 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000153991 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27253 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'176, mlcod=36'172)", 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.222014+0000", 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.4048476299999999, 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001843353, 2024-09-05T17:31:05.674 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.222014+0000", 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.222014+0000", 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.222015+0000", 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.457e-06 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.222024+0000", 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.585e-06 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.222047+0000", 2024-09-05T17:31:05.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3006999999999998e-05 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.222059+0000", 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2072000000000001e-05 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.222173+0000", 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114317 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.222226+0000", 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2626000000000001e-05 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.223813+0000", 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001587162 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.223857+0000", 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4127e-05 2024-09-05T17:31:05.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27272 3.9 e36/24 3:961ac59e:::rbd_data.1140f3505917.000000000000023a:head v 36'186, mlcod=36'184)", 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.357666408, 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026438630000000002, 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269196+0000", 2024-09-05T17:31:05.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2610000000000001e-06 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270692+0000", 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495365 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270721+0000", 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9036000000000001e-05 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270736+0000", 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4979e-05 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270814+0000", 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8010999999999996e-05 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270836+0000", 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2651999999999999e-05 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271799+0000", 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096227200000000002 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271839+0000", 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0287000000000002e-05 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27439 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'228, mlcod=36'226)", 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.0497456979999999, 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031113629999999998, 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:05.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577119+0000", 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7549999999999999e-06 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577132+0000", 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3699e-05 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577165+0000", 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2645999999999999e-05 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577181+0000", 2024-09-05T17:31:05.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5764999999999999e-05 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577311+0000", 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013032399999999999 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577375+0000", 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3532000000000001e-05 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580116+0000", 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027411520000000002 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580227+0000", 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011149 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.688 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27440 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'229, mlcod=36'226)", 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.0480553399999999, 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022421120000000001, 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578808+0000", 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0499999999999999e-06 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578823+0000", 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4290999999999999e-05 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578855+0000", 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2682999999999999e-05 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578875+0000", 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9881000000000002e-05 2024-09-05T17:31:05.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579029+0000", 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015355499999999999 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579173+0000", 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014394599999999999 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580954+0000", 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001781134 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.581048+0000", 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4572000000000002e-05 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27514 3.0 e36/24 3:07a8b63a:::rbd_data.1140f3505917.0000000000000367:head v 36'132, mlcod=36'130)", 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.748279+0000", 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.87858298000000001, 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018615159999999999, 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748279+0000", 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748279+0000", 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748280+0000", 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1179999999999999e-06 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748305+0000", 2024-09-05T17:31:05.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5605e-05 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748322+0000", 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6762999999999999e-05 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748331+0000", 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7020000000000007e-06 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748459+0000", 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012819599999999999 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748519+0000", 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9731999999999997e-05 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.750087+0000", 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015678599999999999 2024-09-05T17:31:05.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.750140+0000", 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3539999999999999e-05 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27516 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'242, mlcod=36'240)", 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:05.698 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.84594833300000005, 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001967735, 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780916+0000", 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2790000000000001e-06 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780930+0000", 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4914e-05 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780958+0000", 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7217e-05 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780972+0000", 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4456e-05 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781128+0000", 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015544699999999999 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781166+0000", 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8868999999999997e-05 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782803+0000", 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016366519999999999 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782881+0000", 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7900999999999998e-05 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27713 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'281, mlcod=36'279)", 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.109112+0000", 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.517749397, 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001888942, 2024-09-05T17:31:05.703 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109112+0000", 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109112+0000", 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109115+0000", 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2629999999999999e-06 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109135+0000", 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9607999999999999e-05 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109175+0000", 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0295e-05 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109197+0000", 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2110999999999999e-05 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109347+0000", 2024-09-05T17:31:05.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149949 2024-09-05T17:31:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109388+0000", 2024-09-05T17:31:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0605000000000002e-05 2024-09-05T17:31:05.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.110908+0000", 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001520076 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.111001+0000", 2024-09-05T17:31:05.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3035000000000006e-05 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27722 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'282, mlcod=36'280)", 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.123519+0000", 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.50334268699999996, 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001865198, 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.709 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123519+0000", 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123519+0000", 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123522+0000", 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8930000000000001e-06 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123534+0000", 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2512e-05 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123562+0000", 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7436e-05 2024-09-05T17:31:05.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123575+0000", 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3539e-05 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123721+0000", 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014547 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123753+0000", 2024-09-05T17:31:05.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2058999999999999e-05 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.125312+0000", 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015588959999999999 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.125384+0000", 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2392999999999996e-05 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.713 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27724 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'284, mlcod=36'280)", 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.127560+0000", 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.49930194700000002, 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001852963, 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127560+0000", 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127560+0000", 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127561+0000", 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.353e-06 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127571+0000", 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0076e-05 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127596+0000", 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4584e-05 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127608+0000", 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2515e-05 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127707+0000", 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8492000000000005e-05 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127735+0000", 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8177000000000001e-05 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.129294+0000", 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00155923 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.129413+0000", 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118536 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27750 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'288, mlcod=36'286)", 2024-09-05T17:31:05.718 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.44261051600000001, 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021578209999999999, 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184254+0000", 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184272+0000", 2024-09-05T17:31:05.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8284e-05 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184311+0000", 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184329+0000", 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8077999999999999e-05 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184507+0000", 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000177035 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184573+0000", 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6729000000000004e-05 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186301+0000", 2024-09-05T17:31:05.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017280279999999999 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186409+0000", 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107601 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27759 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'289, mlcod=36'287)", 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:05.723 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.42880205999999998, 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026394679999999998, 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:05.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198063+0000", 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0570000000000001e-06 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198077+0000", 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4270999999999999e-05 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198112+0000", 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4953000000000002e-05 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198127+0000", 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5597999999999999e-05 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198290+0000", 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162631 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198352+0000", 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1796000000000003e-05 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200559+0000", 2024-09-05T17:31:05.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022068579999999999 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200699+0000", 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000140304 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:05.728 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:05.729 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:05.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:05.731 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone6 from 0x7fdcd4e (overlap 0x9b4cd1) to 0x0 2024-09-05T17:31:05.731 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:05.732+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:05.831 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:05.826+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:05.932 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:05.932+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:05.934 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:05.934 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:05.934 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:05.936 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-05T17:31:05.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:05.957 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:05.958 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:05.975 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:05.975 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:05.994 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:05.994 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:06.011 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:06.011 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:06.032 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:06.033 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:06.033 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:06.032+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:06.064 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:06.065 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:06.089 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:06.089 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:06.092 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:06.092 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:06.109 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:06.110 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:06.110 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:06.177 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:06.180+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:06.228 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:06.228 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:06.234 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:06.236+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:06.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:06.336 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:06.334+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:06.387 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:06.387 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:06.387 INFO:teuthology.orchestra.run.smithi050.stdout:1223 punch from 0x14a15a2 to 0x14a1d6d, (0x7cb bytes) 2024-09-05T17:31:06.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:06.395 INFO:teuthology.orchestra.run.smithi050.stdout:1224 write 0x3da543d thru 0x3dafcf0 (0xa8b4 bytes) 2024-09-05T17:31:06.403 INFO:teuthology.orchestra.run.smithi050.stdout:1225 writesame 0x172de82 thru 0x1732e2e data_size 0xd(0x4fad bytes) 2024-09-05T17:31:06.410 INFO:teuthology.orchestra.run.smithi050.stdout:1226 trunc from 0x7fdcd4e to 0x8f03a6c 2024-09-05T17:31:06.419 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:06.419 INFO:teuthology.orchestra.run.smithi050.stdout:1229 writesame 0x5348723 thru 0x5351cb2 data_size 0x8(0x9590 bytes) 2024-09-05T17:31:06.436 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:06.436+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:06.444 INFO:teuthology.orchestra.run.smithi050.stdout:1230 write 0xd427dec thru 0xd4298ba (0x1acf bytes) 2024-09-05T17:31:06.452 INFO:teuthology.orchestra.run.smithi050.stdout:1232 read 0x8cc496e thru 0x8ccebe0 (0xa273 bytes) 2024-09-05T17:31:06.466 INFO:teuthology.orchestra.run.smithi050.stdout:1233 trunc from 0xd4298bb to 0x1af1e80 2024-09-05T17:31:06.512 INFO:teuthology.orchestra.run.smithi050.stdout:1234 read 0xeac89c thru 0xeb924a (0xc9af bytes) 2024-09-05T17:31:06.552 INFO:teuthology.orchestra.run.smithi050.stdout:1237 punch from 0x486a20 to 0x48b224, (0x4804 bytes) 2024-09-05T17:31:06.552 INFO:teuthology.orchestra.run.smithi050.stdout:1238 punch from 0x136229d to 0x136f607, (0xd36a bytes) 2024-09-05T17:31:06.552 INFO:teuthology.orchestra.run.smithi050.stdout:1241 punch from 0x12e646f to 0x12f34ee, (0xd07f bytes) 2024-09-05T17:31:06.553 INFO:teuthology.orchestra.run.smithi050.stdout:1242 read 0x1257e36 thru 0x125bea9 (0x4074 bytes) 2024-09-05T17:31:06.553 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:31:06.554 INFO:teuthology.orchestra.run.smithi050.stdout:1243 writesame 0xde681f5 thru 0xde6fdfb data_size 0x1(0x7c07 bytes) 2024-09-05T17:31:06.554 INFO:teuthology.orchestra.run.smithi050.stdout:1244 write 0x202108b thru 0x20250fc (0x4072 bytes) 2024-09-05T17:31:06.554 INFO:teuthology.orchestra.run.smithi050.stdout:1245 read 0xb4e2a1f thru 0xb4f0221 (0xd803 bytes) 2024-09-05T17:31:06.555 INFO:teuthology.orchestra.run.smithi050.stdout:1248 punch from 0x171fc4b to 0x172d502, (0xd8b7 bytes) 2024-09-05T17:31:06.555 INFO:teuthology.orchestra.run.smithi050.stdout:1251 read 0x266ff50 thru 0x267faf8 (0xfba9 bytes) 2024-09-05T17:31:06.555 INFO:teuthology.orchestra.run.smithi050.stdout:1252 write 0x7c4632a thru 0x7c4d208 (0x6edf bytes) 2024-09-05T17:31:06.555 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:06.556+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:06.560 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:06.560 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:06.571 INFO:teuthology.orchestra.run.smithi050.stdout:1253 trunc from 0xde6fdfc to 0x312aed3 2024-09-05T17:31:06.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:06.595 INFO:teuthology.orchestra.run.smithi050.stdout:1254 trunc from 0x312aed3 to 0xb0ed0a8 2024-09-05T17:31:06.603 INFO:teuthology.orchestra.run.smithi050.stdout:1255 write 0x953c02a thru 0x953e5e7 (0x25be bytes) 2024-09-05T17:31:06.607 INFO:teuthology.orchestra.run.smithi050.stdout:1256 read 0x5067d24 thru 0x506d5f1 (0x58ce bytes) 2024-09-05T17:31:06.607 INFO:teuthology.orchestra.run.smithi050.stdout:1257 read 0xa9d7c66 thru 0xa9dbdf0 (0x418b bytes) 2024-09-05T17:31:06.607 INFO:teuthology.orchestra.run.smithi050.stdout:1258 write 0x786a10 thru 0x7929c9 (0xbfba bytes) 2024-09-05T17:31:06.622 INFO:teuthology.orchestra.run.smithi050.stdout:1260 write 0x1b0ad82 thru 0x1b11eee (0x716d bytes) 2024-09-05T17:31:06.624 INFO:teuthology.orchestra.run.smithi050.stdout:1262 write 0x9414d6c thru 0x941d8c0 (0x8b55 bytes) 2024-09-05T17:31:06.628 INFO:teuthology.orchestra.run.smithi050.stdout:1263 writesame 0x2fa3297 thru 0x2fa5c23 data_size 0x1(0x298d bytes) 2024-09-05T17:31:06.636 INFO:teuthology.orchestra.run.smithi050.stdout:1264 writesame 0x49ee876 thru 0x49ee8b1 data_size 0x6(0x3c bytes) 2024-09-05T17:31:06.639 INFO:teuthology.orchestra.run.smithi050.stdout:1265 writesame 0x71b31f8 thru 0x71c2b1e data_size 0x39(0xf927 bytes) 2024-09-05T17:31:06.647 INFO:teuthology.orchestra.run.smithi050.stdout:1266 writesame 0x2244dad thru 0x224fae4 data_size 0x5c(0xad38 bytes) 2024-09-05T17:31:06.653 INFO:teuthology.orchestra.run.smithi050.stdout:1267 write 0x1ddaa6a thru 0x1de2974 (0x7f0b bytes) 2024-09-05T17:31:06.655 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:06.650+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:06.658 INFO:teuthology.orchestra.run.smithi050.stdout:1268 punch from 0x9f98892 to 0x9fa5e69, (0xd5d7 bytes) 2024-09-05T17:31:06.669 INFO:teuthology.orchestra.run.smithi050.stdout:1270 trunc from 0xb0ed0a8 to 0x20f5876 2024-09-05T17:31:06.688 INFO:teuthology.orchestra.run.smithi050.stdout:1271 punch from 0x14c369c to 0x14c735f, (0x3cc3 bytes) 2024-09-05T17:31:06.704 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:06.704 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:06.710 INFO:teuthology.orchestra.run.smithi050.stdout:1273 write 0xbf96eba thru 0xbf9cb8a (0x5cd1 bytes) 2024-09-05T17:31:06.719 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:06.720 INFO:teuthology.orchestra.run.smithi050.stdout:1274 punch from 0x81bf45f to 0x81c0584, (0x1125 bytes) 2024-09-05T17:31:06.720 INFO:teuthology.orchestra.run.smithi050.stdout:1275 read 0x21092bb thru 0x21186fb (0xf441 bytes) 2024-09-05T17:31:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:1276 punch from 0xf0ca15 to 0xf1b2c5, (0xe8b0 bytes) 2024-09-05T17:31:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:1278 read 0x33ffab5 thru 0x3407131 (0x767d bytes) 2024-09-05T17:31:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:1280 read 0xab50e6e thru 0xab58fa7 (0x813a bytes) 2024-09-05T17:31:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:1281 writesame 0x4d8b6f7 thru 0x4d9996f data_size 0x1(0xe279 bytes) 2024-09-05T17:31:06.756 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:06.756+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:06.757 INFO:teuthology.orchestra.run.smithi050.stdout:1282 writesame 0xaad03b7 thru 0xaad4b91 data_size 0xd(0x47db bytes) 2024-09-05T17:31:06.763 INFO:teuthology.orchestra.run.smithi050.stdout:1283 punch from 0x46b703b to 0x46c5181, (0xe146 bytes) 2024-09-05T17:31:06.766 INFO:teuthology.orchestra.run.smithi050.stdout:1287 trunc from 0xbf9cb8b to 0xe4939dc 2024-09-05T17:31:06.776 INFO:teuthology.orchestra.run.smithi050.stdout:1289 read 0x757c694 thru 0x75800be (0x3a2b bytes) 2024-09-05T17:31:06.777 INFO:teuthology.orchestra.run.smithi050.stdout:1290 write 0xb6d68ca thru 0xb6d9772 (0x2ea9 bytes) 2024-09-05T17:31:06.784 INFO:teuthology.orchestra.run.smithi050.stdout:1291 writesame 0x8bee70a thru 0x8bf90b9 data_size 0x3c(0xa9b0 bytes) 2024-09-05T17:31:06.792 INFO:teuthology.orchestra.run.smithi050.stdout:1292 writesame 0x4ea3d14 thru 0x4ea44a5 data_size 0x22(0x792 bytes) 2024-09-05T17:31:06.814 INFO:teuthology.orchestra.run.smithi050.stdout:1297 trunc from 0xe4939dc to 0x1c2d459 2024-09-05T17:31:06.857 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:06.860+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:06.865 INFO:teuthology.orchestra.run.smithi050.stdout:1298 write 0xe62b3fc thru 0xe63107b (0x5c80 bytes) 2024-09-05T17:31:06.892 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:06.893 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:06.900 INFO:teuthology.orchestra.run.smithi050.stdout:1299 trunc from 0xe63107c to 0x50b51 2024-09-05T17:31:06.910 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:06.958 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:06.960+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:06.996 INFO:teuthology.orchestra.run.smithi050.stdout:1302 write 0x200c7fa thru 0x2018a71 (0xc278 bytes) 2024-09-05T17:31:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:1303 read 0x15a7cc0 thru 0x15ad91e (0x5c5f bytes) 2024-09-05T17:31:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:1305 punch from 0xaec721 to 0xaecff9, (0x8d8 bytes) 2024-09-05T17:31:07.003 INFO:teuthology.orchestra.run.smithi050.stdout:1306 punch from 0xcd24a3 to 0xcd47a1, (0x22fe bytes) 2024-09-05T17:31:07.022 INFO:teuthology.orchestra.run.smithi050.stdout:1307 write 0x72c6be7 thru 0x72d1588 (0xa9a2 bytes) 2024-09-05T17:31:07.028 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:1309 write 0xc725436 thru 0xc72e140 (0x8d0b bytes) 2024-09-05T17:31:07.092 INFO:teuthology.orchestra.run.smithi050.stdout:1310 writesame 0x8c651f thru 0x8d3343 data_size 0x15(0xce25 bytes) 2024-09-05T17:31:07.092 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:07.093 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:07.093 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:07.093 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:07.090+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:07.098 INFO:teuthology.orchestra.run.smithi050.stdout:1311 trunc from 0xc72e141 to 0x1a47d24 2024-09-05T17:31:07.160 INFO:teuthology.orchestra.run.smithi050.stdout:1312 writesame 0xc03de3a thru 0xc04ba6b data_size 0xf(0xdc32 bytes) 2024-09-05T17:31:07.160 INFO:teuthology.orchestra.run.smithi050.stdout:1314 read 0x6630767 thru 0x663fbdb (0xf475 bytes) 2024-09-05T17:31:07.170 INFO:teuthology.orchestra.run.smithi050.stdout:1315 trunc from 0xc04ba6c to 0x861aebd 2024-09-05T17:31:07.192 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:07.190+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:07.203 INFO:teuthology.orchestra.run.smithi050.stdout:1316 writesame 0xbf877e4 thru 0xbf8ea6e data_size 0x7(0x728b bytes) 2024-09-05T17:31:07.221 INFO:teuthology.orchestra.run.smithi050.stdout:1317 write 0xe6aa14a thru 0xe6b8b15 (0xe9cc bytes) 2024-09-05T17:31:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:1319 punch from 0x1c8d7e8 to 0x1c9cb25, (0xf33d bytes) 2024-09-05T17:31:07.232 INFO:teuthology.orchestra.run.smithi050.stdout:1320 write 0x3fcdc8b thru 0x3fdaeb3 (0xd229 bytes) 2024-09-05T17:31:07.264 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:07.264 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:07.278 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:07.281 INFO:teuthology.orchestra.run.smithi050.stdout:1321 trunc from 0xe6b8b16 to 0x6450cf 2024-09-05T17:31:07.320 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:07.318+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:07.326 INFO:teuthology.orchestra.run.smithi050.stdout:1322 writesame 0x43dc029 thru 0x43e04c2 data_size 0x3(0x449a bytes) 2024-09-05T17:31:07.347 INFO:teuthology.orchestra.run.smithi050.stdout:1323 trunc from 0x43e04c3 to 0xbaea827 2024-09-05T17:31:07.381 INFO:teuthology.orchestra.run.smithi050.stdout:1324 trunc from 0xbaea827 to 0x3a04b2a 2024-09-05T17:31:07.394 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:07.396+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:07.398 INFO:teuthology.orchestra.run.smithi050.stdout:1325 trunc from 0x3a04b2a to 0x1fccf4f 2024-09-05T17:31:07.439 INFO:teuthology.orchestra.run.smithi050.stdout:1326 write 0x53c5518 thru 0x53ca0ba (0x4ba3 bytes) 2024-09-05T17:31:07.449 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:07.449 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:07.449 INFO:teuthology.orchestra.run.smithi050.stdout:1327 writesame 0x4d11963 thru 0x4d1eada data_size 0x4(0xd178 bytes) 2024-09-05T17:31:07.463 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:07.466 INFO:teuthology.orchestra.run.smithi050.stdout:1328 writesame 0xadd5fc thru 0xaeabf4 data_size 0x39(0xd5f9 bytes) 2024-09-05T17:31:07.504 INFO:teuthology.orchestra.run.smithi050.stdout:1329 writesame 0xa4580a1 thru 0xa45a308 data_size 0xc(0x2268 bytes) 2024-09-05T17:31:07.504 INFO:teuthology.orchestra.run.smithi050.stdout:1330 write 0x513ff58 thru 0x5148ed6 (0x8f7f bytes) 2024-09-05T17:31:07.508 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:07.506+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:07.513 INFO:teuthology.orchestra.run.smithi050.stdout:1331 writesame 0x75a6b97 thru 0x75b3610 data_size 0x6(0xca7a bytes) 2024-09-05T17:31:07.529 INFO:teuthology.orchestra.run.smithi050.stdout:1332 punch from 0x1ba35b3 to 0x1bb189a, (0xe2e7 bytes) 2024-09-05T17:31:07.529 INFO:teuthology.orchestra.run.smithi050.stdout:1333 write 0x61e50c6 thru 0x61f50c4 (0xffff bytes) 2024-09-05T17:31:07.537 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:07.561 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:07.561 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-09-05T17:31:07.561 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-05T17:31:07.561 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-05T17:31:07.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-09-05T17:31:07.563 INFO:teuthology.orchestra.run.smithi050.stdout:1334 read 0x931fa61 thru 0x932de2f (0xe3cf bytes) 2024-09-05T17:31:07.563 INFO:teuthology.orchestra.run.smithi050.stdout:1336 writesame 0x4c35402 thru 0x4c39671 data_size 0x8(0x4270 bytes) 2024-09-05T17:31:07.563 INFO:teuthology.orchestra.run.smithi050.stdout:1337 write 0xa55d8 thru 0xa82e6 (0x2d0f bytes) 2024-09-05T17:31:07.563 INFO:teuthology.orchestra.run.smithi050.stdout:1338 write 0x8cc594e thru 0x8cc8ba3 (0x3256 bytes) 2024-09-05T17:31:07.568 INFO:teuthology.orchestra.run.smithi050.stdout:1339 punch from 0x35d0b53 to 0x35dbc50, (0xb0fd bytes) 2024-09-05T17:31:07.568 INFO:teuthology.orchestra.run.smithi050.stdout:1340 write 0x1f6cc59 thru 0x1f7cc53 (0xfffb bytes) 2024-09-05T17:31:07.590 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:07.591 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:07.594 INFO:teuthology.orchestra.run.smithi050.stdout:1342 writesame 0xbd6f5ee thru 0xbd7198d data_size 0x4(0x23a0 bytes) 2024-09-05T17:31:07.594 INFO:teuthology.orchestra.run.smithi050.stdout:1344 write 0xba22a03 thru 0xba311d3 (0xe7d1 bytes) 2024-09-05T17:31:07.595 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:07.590+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:07.602 INFO:teuthology.orchestra.run.smithi050.stdout:1346 punch from 0xb10b003 to 0xb10f639, (0x4636 bytes) 2024-09-05T17:31:07.602 INFO:teuthology.orchestra.run.smithi050.stdout:1347 write 0x2cf09f2 thru 0x2cf6faf (0x65be bytes) 2024-09-05T17:31:07.606 INFO:teuthology.orchestra.run.smithi050.stdout:1348 read 0x9077402 thru 0x908070f (0x930e bytes) 2024-09-05T17:31:07.606 INFO:teuthology.orchestra.run.smithi050.stdout:1349 write 0x41b81d1 thru 0x41bb856 (0x3686 bytes) 2024-09-05T17:31:07.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:07.611 INFO:teuthology.orchestra.run.smithi050.stdout:1350 write 0x13d6a22 thru 0x13dea38 (0x8017 bytes) 2024-09-05T17:31:07.617 INFO:teuthology.orchestra.run.smithi050.stdout:1351 read 0xb895776 thru 0xb8a282c (0xd0b7 bytes) 2024-09-05T17:31:07.617 INFO:teuthology.orchestra.run.smithi050.stdout:1352 write 0x72eb804 thru 0x72f449b (0x8c98 bytes) 2024-09-05T17:31:07.623 INFO:teuthology.orchestra.run.smithi050.stdout:1354 writesame 0xc372c8 thru 0xc3dc9e data_size 0x1(0x69d7 bytes) 2024-09-05T17:31:07.640 INFO:teuthology.orchestra.run.smithi050.stdout:1356 read 0x9705f25 thru 0x970fe71 (0x9f4d bytes) 2024-09-05T17:31:07.640 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:07.640 INFO:teuthology.orchestra.run.smithi050.stdout:1358 write 0x6a3604a thru 0x6a3c70f (0x66c6 bytes) 2024-09-05T17:31:07.647 INFO:teuthology.orchestra.run.smithi050.stdout:1359 writesame 0x1ea074d thru 0x1ea4cde data_size 0x1a(0x4592 bytes) 2024-09-05T17:31:07.657 INFO:teuthology.orchestra.run.smithi050.stdout:1360 trunc from 0xbd7198e to 0x6a0040b 2024-09-05T17:31:07.677 INFO:teuthology.orchestra.run.smithi050.stdout:1361 punch from 0x2d45c76 to 0x2d48d27, (0x30b1 bytes) 2024-09-05T17:31:07.686 INFO:teuthology.orchestra.run.smithi050.stdout:1362 writesame 0x6b292d8 thru 0x6b2ad52 data_size 0x1(0x1a7b bytes) 2024-09-05T17:31:07.686 INFO:teuthology.orchestra.run.smithi050.stdout:1364 writesame 0x3e85d7 thru 0x3f7914 data_size 0x1a(0xf33e bytes) 2024-09-05T17:31:07.692 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:07.692 INFO:teuthology.orchestra.run.smithi050.stdout:1366 read 0x562847e thru 0x562be6d (0x39f0 bytes) 2024-09-05T17:31:07.692 INFO:teuthology.orchestra.run.smithi050.stdout:1367 read 0xc887e8 thru 0xc8bd62 (0x357b bytes) 2024-09-05T17:31:07.696 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:07.696+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:07.705 INFO:teuthology.orchestra.run.smithi050.stdout:1368 writesame 0x8955b19 thru 0x8959993 data_size 0x7(0x3e7b bytes) 2024-09-05T17:31:07.712 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:07.712 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-05T17:31:07.713 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:07.713 INFO:teuthology.orchestra.run.smithi050.stdout:1369 trunc from 0x8959994 to 0x2d46a5f 2024-09-05T17:31:07.736 INFO:teuthology.orchestra.run.smithi050.stdout:1370 punch from 0x29441bb to 0x294aae7, (0x692c bytes) 2024-09-05T17:31:07.736 INFO:teuthology.orchestra.run.smithi050.stdout:1371 punch from 0x27e3922 to 0x27ed77c, (0x9e5a bytes) 2024-09-05T17:31:07.736 INFO:teuthology.orchestra.run.smithi050.stdout:1372 punch from 0x5e30c5 to 0x5e77e8, (0x4723 bytes) 2024-09-05T17:31:07.751 INFO:teuthology.orchestra.run.smithi050.stdout:1373 trunc from 0x2d46a5f to 0xcb3dbc6 2024-09-05T17:31:07.760 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:07.760 INFO:teuthology.orchestra.run.smithi050.stdout:1376 write 0xca1731a thru 0xca1c4d5 (0x51bc bytes) 2024-09-05T17:31:07.766 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:07.766 INFO:teuthology.orchestra.run.smithi050.stdout:1379 read 0x596bb16 thru 0x5979a90 (0xdf7b bytes) 2024-09-05T17:31:07.766 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:07.769 INFO:teuthology.orchestra.run.smithi050.stdout:1383 trunc from 0xcb3dbc6 to 0xacfaa81 2024-09-05T17:31:07.784 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:07.785 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:07.786 INFO:teuthology.orchestra.run.smithi050.stdout:1384 punch from 0x2e946ff to 0x2ea11c2, (0xcac3 bytes) 2024-09-05T17:31:07.787 INFO:teuthology.orchestra.run.smithi050.stdout:1387 punch from 0x899307 to 0x8a2d98, (0x9a91 bytes) 2024-09-05T17:31:07.787 INFO:teuthology.orchestra.run.smithi050.stdout:1388 read 0x84c2caa thru 0x84c3ac0 (0xe17 bytes) 2024-09-05T17:31:07.787 INFO:teuthology.orchestra.run.smithi050.stdout:1389 read 0x6081466 thru 0x6083767 (0x2302 bytes) 2024-09-05T17:31:07.787 INFO:teuthology.orchestra.run.smithi050.stdout:1390 read 0x69e97dd thru 0x69f21be (0x89e2 bytes) 2024-09-05T17:31:07.787 INFO:teuthology.orchestra.run.smithi050.stdout:1392 writesame 0x18f5ed5 thru 0x18fcb7c data_size 0x39(0x6ca8 bytes) 2024-09-05T17:31:07.797 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:07.796+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:07.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:07.800 INFO:teuthology.orchestra.run.smithi050.stdout:1394 trunc from 0xacfaa81 to 0x7d05c65 2024-09-05T17:31:07.809 INFO:teuthology.orchestra.run.smithi050.stdout:1397 read 0x3ea0e08 thru 0x3ea28e2 (0x1adb bytes) 2024-09-05T17:31:07.823 INFO:teuthology.orchestra.run.smithi050.stdout:1398 write 0x935140f thru 0x93575e0 (0x61d2 bytes) 2024-09-05T17:31:07.829 INFO:teuthology.orchestra.run.smithi050.stdout:1399 read 0x8f63e71 thru 0x8f6583c (0x19cc bytes) 2024-09-05T17:31:07.829 INFO:teuthology.orchestra.run.smithi050.stdout:1400 write 0x4136f5e thru 0x413e18c (0x722f bytes) 2024-09-05T17:31:07.837 INFO:teuthology.orchestra.run.smithi050.stdout:1402 read 0x90260f3 thru 0x90272e8 (0x11f6 bytes) 2024-09-05T17:31:07.853 INFO:teuthology.orchestra.run.smithi050.stdout:1403 write 0xad18186 thru 0xad234c3 (0xb33e bytes) 2024-09-05T17:31:07.892 INFO:teuthology.orchestra.run.smithi050.stdout:1404 trunc from 0xad234c4 to 0x7987e9 2024-09-05T17:31:07.898 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:07.900+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:07.926 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:07.926 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:07.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:07.944 INFO:teuthology.orchestra.run.smithi050.stdout:1405 write 0x40eb021 thru 0x40f89b4 (0xd994 bytes) 2024-09-05T17:31:07.956 INFO:teuthology.orchestra.run.smithi050.stdout:1406 read 0x3db0495 thru 0x3db5431 (0x4f9d bytes) 2024-09-05T17:31:07.990 INFO:teuthology.orchestra.run.smithi050.stdout:1407 writesame 0xc0c4d4c thru 0xc0cfc89 data_size 0x3(0xaf3e bytes) 2024-09-05T17:31:07.990 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:07.990 INFO:teuthology.orchestra.run.smithi050.stdout:1409 write 0xa8bef25 thru 0xa8cd795 (0xe871 bytes) 2024-09-05T17:31:07.999 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:08.000+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:08.002 INFO:teuthology.orchestra.run.smithi050.stdout:1411 read 0x3d4775e thru 0x3d483c0 (0xc63 bytes) 2024-09-05T17:31:08.002 INFO:teuthology.orchestra.run.smithi050.stdout:1412 read 0x43d0a9a thru 0x43dfe72 (0xf3d9 bytes) 2024-09-05T17:31:08.008 INFO:teuthology.orchestra.run.smithi050.stdout:1413 trunc from 0xc0cfc8a to 0xe05c2ec 2024-09-05T17:31:08.023 INFO:teuthology.orchestra.run.smithi050.stdout:1414 read 0x776aa06 thru 0x7774e34 (0xa42f bytes) 2024-09-05T17:31:08.023 INFO:teuthology.orchestra.run.smithi050.stdout:1415 punch from 0x7e8d5b0 to 0x7e9b30f, (0xdd5f bytes) 2024-09-05T17:31:08.023 INFO:teuthology.orchestra.run.smithi050.stdout:1417 read 0x7dd0269 thru 0x7dd5404 (0x519c bytes) 2024-09-05T17:31:08.035 INFO:teuthology.orchestra.run.smithi050.stdout:1418 trunc from 0xe05c2ec to 0x96b12df 2024-09-05T17:31:08.062 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:08.082 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:08.083 INFO:teuthology.orchestra.run.smithi050.stdout:1419 trunc from 0x96b12df to 0x427d08b 2024-09-05T17:31:08.083 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:08.098 INFO:teuthology.orchestra.run.smithi050.stdout:1420 trunc from 0x427d08b to 0xf48d7a 2024-09-05T17:31:08.099 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:08.100+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:08.121 INFO:teuthology.orchestra.run.smithi050.stdout:1421 read 0x8c34a7 thru 0x8d0cfc (0xd856 bytes) 2024-09-05T17:31:08.131 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:08.160 INFO:teuthology.orchestra.run.smithi050.stdout:1422 write 0xaf53172 thru 0xaf5fea3 (0xcd32 bytes) 2024-09-05T17:31:08.178 INFO:teuthology.orchestra.run.smithi050.stdout:1423 write 0xb13bfc3 thru 0xb1472d1 (0xb30f bytes) 2024-09-05T17:31:08.200 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:08.200+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:08.202 INFO:teuthology.orchestra.run.smithi050.stdout:1424 trunc from 0xb1472d2 to 0x42cd13b 2024-09-05T17:31:08.208 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:08.208 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:08.221 INFO:teuthology.orchestra.run.smithi050.stdout:1425 punch from 0x10bc01c to 0x10bdcf5, (0x1cd9 bytes) 2024-09-05T17:31:08.221 INFO:teuthology.orchestra.run.smithi050.stdout:1426 read 0x10bd4ea thru 0x10c19bb (0x44d2 bytes) 2024-09-05T17:31:08.221 INFO:teuthology.orchestra.run.smithi050.stdout:1428 punch from 0x15c6ba8 to 0x15d4955, (0xddad bytes) 2024-09-05T17:31:08.223 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:08.238 INFO:teuthology.orchestra.run.smithi050.stdout:1430 writesame 0x731ee43 thru 0x7329cdc data_size 0x1(0xae9a bytes) 2024-09-05T17:31:08.240 INFO:teuthology.orchestra.run.smithi050.stdout:1431 trunc from 0x7329cdd to 0x586369b 2024-09-05T17:31:08.256 INFO:teuthology.orchestra.run.smithi050.stdout:1432 write 0x66c9ccf thru 0x66d4444 (0xa776 bytes) 2024-09-05T17:31:08.262 INFO:teuthology.orchestra.run.smithi050.stdout:1433 trunc from 0x66d4445 to 0x69e1a22 2024-09-05T17:31:08.269 INFO:teuthology.orchestra.run.smithi050.stdout:1435 read 0x1fbc2c9 thru 0x1fbf3e5 (0x311d bytes) 2024-09-05T17:31:08.284 INFO:teuthology.orchestra.run.smithi050.stdout:1436 write 0xa86dd64 thru 0xa8782b3 (0xa550 bytes) 2024-09-05T17:31:08.290 INFO:teuthology.orchestra.run.smithi050.stdout:1438 read 0x2892fc3 thru 0x28995c8 (0x6606 bytes) 2024-09-05T17:31:08.290 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:08.290 INFO:teuthology.orchestra.run.smithi050.stdout:1440 read 0x2c17d4b thru 0x2c26a01 (0xecb7 bytes) 2024-09-05T17:31:08.301 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:08.298+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:08.303 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:08.304 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:08.307 INFO:teuthology.orchestra.run.smithi050.stdout:1441 writesame 0xedf09a9 thru 0xedf419d data_size 0x19(0x37f5 bytes) 2024-09-05T17:31:08.307 INFO:teuthology.orchestra.run.smithi050.stdout:1442 read 0xe9ddce3 thru 0xe9e2a10 (0x4d2e bytes) 2024-09-05T17:31:08.322 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:08.322 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:08.325 INFO:teuthology.orchestra.run.smithi050.stdout:1443 trunc from 0xedf419e to 0x26b451d 2024-09-05T17:31:08.342 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:08.342 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:08.342 INFO:teuthology.orchestra.run.smithi050.stdout:1444 read 0x23edbb6 thru 0x23fbfb8 (0xe403 bytes) 2024-09-05T17:31:08.349 INFO:teuthology.orchestra.run.smithi050.stdout:1445 trunc from 0x26b451d to 0x7ac7cd9 2024-09-05T17:31:08.360 INFO:teuthology.orchestra.run.smithi050.stdout:1447 write 0x2272e14 thru 0x2276240 (0x342d bytes) 2024-09-05T17:31:08.360 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:08.361 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:08.371 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:08.371 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:08.372 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:08.372 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:08.375 INFO:teuthology.orchestra.run.smithi050.stdout:1448 write 0x87adc47 thru 0x87afc1a (0x1fd4 bytes) 2024-09-05T17:31:08.380 INFO:teuthology.orchestra.run.smithi050.stdout:1450 read 0x8574759 thru 0x857de24 (0x96cc bytes) 2024-09-05T17:31:08.383 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:08.383 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:08.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:08.399 INFO:teuthology.orchestra.run.smithi050.stdout:1451 write 0xe8056b0 thru 0xe812d57 (0xd6a8 bytes) 2024-09-05T17:31:08.407 INFO:teuthology.orchestra.run.smithi050.stdout:1452 write 0xeb18ff thru 0xec01db (0xe8dd bytes) 2024-09-05T17:31:08.407 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:08.408+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:08.408 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:08.409 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:08.413 INFO:teuthology.orchestra.run.smithi050.stdout:1454 punch from 0x843227e to 0x84386b3, (0x6435 bytes) 2024-09-05T17:31:08.413 INFO:teuthology.orchestra.run.smithi050.stdout:1455 writesame 0x2dd6ff3 thru 0x2dd7cf3 data_size 0x1(0xd01 bytes) 2024-09-05T17:31:08.420 INFO:teuthology.orchestra.run.smithi050.stdout:1456 read 0x7f5e5db thru 0x7f64b80 (0x65a6 bytes) 2024-09-05T17:31:08.420 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:08.420 INFO:teuthology.orchestra.run.smithi050.stdout:1459 writesame 0x671d62a thru 0x6720ed8 data_size 0x7(0x38af bytes) 2024-09-05T17:31:08.426 INFO:teuthology.orchestra.run.smithi050.stdout:1460 write 0x2ab83f8 thru 0x2ac6dc4 (0xe9cd bytes) 2024-09-05T17:31:08.433 INFO:teuthology.orchestra.run.smithi050.stdout:1461 read 0x56a7f8d thru 0x56ac2a0 (0x4314 bytes) 2024-09-05T17:31:08.433 INFO:teuthology.orchestra.run.smithi050.stdout:1462 write 0x200ac77 thru 0x2019752 (0xeadc bytes) 2024-09-05T17:31:08.434 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:08.434 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:08.450 INFO:teuthology.orchestra.run.smithi050.stdout:1464 trunc from 0xe812d58 to 0x7b0970f 2024-09-05T17:31:08.466 INFO:teuthology.orchestra.run.smithi050.stdout:1466 write 0x37d40af thru 0x37d74a7 (0x33f9 bytes) 2024-09-05T17:31:08.471 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:08.471 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:08.471 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:08.472 INFO:teuthology.orchestra.run.smithi050.stdout:1469 clone 8 order 21 su 524288 sc 7 2024-09-05T17:31:08.503 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:08.498+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:08.541 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:08.549 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:08.550 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:08.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:31:08.557 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:08.606 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:08.608+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:08.663 INFO:teuthology.orchestra.run.smithi050.stdout:flattening image image_client.0-clone7 2024-09-05T17:31:08.705 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:08.708+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:08.740 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:08.740 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6597214410000003, 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:08.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6596930249999993, 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:31:08.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:31:08.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6596710990000005, 2024-09-05T17:31:08.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:08.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:31:08.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:31:08.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6596496520000006, 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.755 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:08.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.759 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6596113619999997, 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:08.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:08.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:08.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:31:08.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:31:08.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:31:08.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:31:08.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:31:08.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:31:08.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:31:08.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:31:08.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:31:08.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:31:08.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:31:08.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:31:08.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:31:08.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.768 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6595965459999995, 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.773 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6595853470000002, 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:31:08.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.778 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6595745080000004, 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.783 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6595640310000004, 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:08.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6595532090000003, 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:31:08.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6595428089999995, 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:31:08.793 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:31:08.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:31:08.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:31:08.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6595244569999998, 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:31:08.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.802 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6593408329999999, 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:31:08.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16657 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7360512~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091766+0000", 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6507184850000005, 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053082995000000001, 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16657 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091766+0000", 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091766+0000", 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091766+0000", 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4600000000000005e-07 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091770+0000", 2024-09-05T17:31:08.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1669999999999999e-06 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091778+0000", 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.242e-06 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091784+0000", 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0469999999999999e-06 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144745+0000", 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052960636999999998 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144790+0000", 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5587000000000002e-05 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144849+0000", 2024-09-05T17:31:08.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8768999999999999e-05 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6506815390000007, 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:31:08.812 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:31:08.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6506409980000001, 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:31:08.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.822 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.823 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:08.823 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6506011689999998, 2024-09-05T17:31:08.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:31:08.823 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:31:08.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:31:08.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:31:08.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6505736940000002, 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:31:08.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6505351850000007, 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.833 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:31:08.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.837 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6504924449999994, 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:08.838 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:31:08.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:31:08.842 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.843 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:08.843 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:08.843 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:08.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:1470 punch from 0x5e1bc24 to 0x5e2689a, (0xac76 bytes) 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:1472 read 0xbda502 thru 0xbdaf0b (0xa0a bytes) 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:1475 read 0x321a53e thru 0x3223253 (0x8d16 bytes) 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:1476 read 0x4a8f2e5 thru 0x4a94ced (0x5a09 bytes) 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:1478 write 0x347ec6d thru 0x348bae1 (0xce75 bytes) 2024-09-05T17:31:08.846 INFO:teuthology.orchestra.run.smithi050.stdout:1479 read 0x4580dbb thru 0x4588dc9 (0x800f bytes) 2024-09-05T17:31:08.846 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:08.842+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:08.858 INFO:teuthology.orchestra.run.smithi050.stdout:1480 writesame 0xb4ec736 thru 0xb4f17db data_size 0x25(0x50a6 bytes) 2024-09-05T17:31:08.858 INFO:teuthology.orchestra.run.smithi050.stdout:1481 punch from 0x2747f68 to 0x274c7f7, (0x488f bytes) 2024-09-05T17:31:08.858 INFO:teuthology.orchestra.run.smithi050.stdout:1482 write 0x1bcdcf7 thru 0x1bd3514 (0x581e bytes) 2024-09-05T17:31:08.881 INFO:teuthology.orchestra.run.smithi050.stdout:1483 trunc from 0xb4f17dc to 0x28bf69a 2024-09-05T17:31:08.909 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:08.921 INFO:teuthology.orchestra.run.smithi050.stdout:1486 write 0x430db67 thru 0x4310866 (0x2d00 bytes) 2024-09-05T17:31:08.926 INFO:teuthology.orchestra.run.smithi050.stdout:1487 read 0x10f9444 thru 0x10fff79 (0x6b36 bytes) 2024-09-05T17:31:08.927 INFO:teuthology.orchestra.run.smithi050.stdout:1489 writesame 0x424b4fa thru 0x424b820 data_size 0x1(0x327 bytes) 2024-09-05T17:31:08.937 INFO:teuthology.orchestra.run.smithi050.stdout:1490 trunc from 0x4310867 to 0x6e118fc 2024-09-05T17:31:08.945 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:08.942+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:08.947 INFO:teuthology.orchestra.run.smithi050.stdout:1491 read 0x16af6cb thru 0x16b2a64 (0x339a bytes) 2024-09-05T17:31:08.969 INFO:teuthology.orchestra.run.smithi050.stdout:1492 write 0xda018d8 thru 0xda09cb3 (0x83dc bytes) 2024-09-05T17:31:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:1497 read 0x5dee469 thru 0x5df14cd (0x3065 bytes) 2024-09-05T17:31:08.976 INFO:teuthology.orchestra.run.smithi050.stdout:1498 read 0x9a31fe thru 0x9aca25 (0x9828 bytes) 2024-09-05T17:31:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:1499 read 0x992aafc thru 0x9937c0e (0xd113 bytes) 2024-09-05T17:31:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:1500 punch from 0xb9b1ce3 to 0xb9bbaf7, (0x9e14 bytes) 2024-09-05T17:31:08.993 INFO:teuthology.orchestra.run.smithi050.stdout:1501 trunc from 0xda09cb4 to 0x54394a4 2024-09-05T17:31:08.997 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:08.997 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:08.997 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:08.997 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:09.013 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:09.034 INFO:teuthology.orchestra.run.smithi050.stdout:1502 write 0x8e2df1c thru 0x8e3a656 (0xc73b bytes) 2024-09-05T17:31:09.046 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:09.042+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:09.054 INFO:teuthology.orchestra.run.smithi050.stdout:1503 write 0x9e33645 thru 0x9e3fa3c (0xc3f8 bytes) 2024-09-05T17:31:09.061 INFO:teuthology.orchestra.run.smithi050.stdout:1505 write 0x8a2f55e thru 0x8a3d7b4 (0xe257 bytes) 2024-09-05T17:31:09.069 INFO:teuthology.orchestra.run.smithi050.stdout:1506 write 0x4946e37 thru 0x49566dc (0xf8a6 bytes) 2024-09-05T17:31:09.075 INFO:teuthology.orchestra.run.smithi050.stdout:1507 read 0x267aacf thru 0x267b139 (0x66b bytes) 2024-09-05T17:31:09.076 INFO:teuthology.orchestra.run.smithi050.stdout:1509 trunc from 0x9e3fa3d to 0x9a16bd2 2024-09-05T17:31:09.097 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.097 INFO:teuthology.orchestra.run.smithi050.stdout:1511 punch from 0x4877d3 to 0x490ceb, (0x9518 bytes) 2024-09-05T17:31:09.097 INFO:teuthology.orchestra.run.smithi050.stdout:1512 writesame 0x87992e thru 0x88158f data_size 0x57(0x7c62 bytes) 2024-09-05T17:31:09.105 INFO:teuthology.orchestra.run.smithi050.stdout:1513 punch from 0x8bd8641 to 0x8be584a, (0xd209 bytes) 2024-09-05T17:31:09.105 INFO:teuthology.orchestra.run.smithi050.stdout:1514 write 0x40505fc thru 0x4059751 (0x9156 bytes) 2024-09-05T17:31:09.118 INFO:teuthology.orchestra.run.smithi050.stdout:1515 trunc from 0x9a16bd2 to 0xeced125 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:1516 write 0x986d8b9 thru 0x987289b (0x4fe3 bytes) 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:1518 read 0x20b1a6d thru 0x20b67ed (0x4d81 bytes) 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:1520 write 0x4fc8971 thru 0x4fd51b3 (0xc843 bytes) 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:1521 read 0x5ebf939 thru 0x5ec0984 (0x104c bytes) 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:1522 write 0xe88b81d thru 0xe893f61 (0x8745 bytes) 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:1524 punch from 0x3366a0f to 0x336701c, (0x60d bytes) 2024-09-05T17:31:09.153 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.154 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:09.150+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:09.160 INFO:teuthology.orchestra.run.smithi050.stdout:1526 trunc from 0xeced125 to 0x83b8229 2024-09-05T17:31:09.171 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:09.171 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:09.171 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:09.172 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:09.172 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:09.188 INFO:teuthology.orchestra.run.smithi050.stdout:1527 punch from 0x652ad43 to 0x6539ad6, (0xed93 bytes) 2024-09-05T17:31:09.188 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.188 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:09.209 INFO:teuthology.orchestra.run.smithi050.stdout:1530 write 0xce72ce6 thru 0xce7356b (0x886 bytes) 2024-09-05T17:31:09.217 INFO:teuthology.orchestra.run.smithi050.stdout:1531 punch from 0x607c8b8 to 0x60826c6, (0x5e0e bytes) 2024-09-05T17:31:09.217 INFO:teuthology.orchestra.run.smithi050.stdout:1533 punch from 0xca5b783 to 0xca608d9, (0x5156 bytes) 2024-09-05T17:31:09.217 INFO:teuthology.orchestra.run.smithi050.stdout:1534 write 0x40c03d0 thru 0x40c7075 (0x6ca6 bytes) 2024-09-05T17:31:09.223 INFO:teuthology.orchestra.run.smithi050.stdout:1535 read 0x4c0c4f6 thru 0x4c12d00 (0x680b bytes) 2024-09-05T17:31:09.223 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.223 INFO:teuthology.orchestra.run.smithi050.stdout:1537 write 0xb7364be thru 0xb737d31 (0x1874 bytes) 2024-09-05T17:31:09.228 INFO:teuthology.orchestra.run.smithi050.stdout:1539 write 0x25fef72 thru 0x260655c (0x75eb bytes) 2024-09-05T17:31:09.232 INFO:teuthology.orchestra.run.smithi050.stdout:1540 read 0xab410a6 thru 0xab45dd4 (0x4d2f bytes) 2024-09-05T17:31:09.241 INFO:teuthology.orchestra.run.smithi050.stdout:1541 write 0xd3c574a thru 0xd3d2df3 (0xd6aa bytes) 2024-09-05T17:31:09.246 INFO:teuthology.orchestra.run.smithi050.stdout:1542 write 0x58044bb thru 0x580892b (0x4471 bytes) 2024-09-05T17:31:09.252 INFO:teuthology.orchestra.run.smithi050.stdout:1543 write 0xf02e01 thru 0xf11651 (0xe851 bytes) 2024-09-05T17:31:09.253 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:09.251+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:09.262 INFO:teuthology.orchestra.run.smithi050.stdout:1546 trunc from 0xd3d2df4 to 0xb36b16d 2024-09-05T17:31:09.279 INFO:teuthology.orchestra.run.smithi050.stdout:1548 writesame 0xa91afbb thru 0xa91f3a1 data_size 0x1(0x43e7 bytes) 2024-09-05T17:31:09.306 INFO:teuthology.orchestra.run.smithi050.stdout:1549 write 0x2193fde thru 0x219fd1e (0xbd41 bytes) 2024-09-05T17:31:09.310 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.310 INFO:teuthology.orchestra.run.smithi050.stdout:1551 write 0x7696524 thru 0x769fae8 (0x95c5 bytes) 2024-09-05T17:31:09.317 INFO:teuthology.orchestra.run.smithi050.stdout:1552 write 0x29eb9f5 thru 0x29f17a6 (0x5db2 bytes) 2024-09-05T17:31:09.322 INFO:teuthology.orchestra.run.smithi050.stdout:1553 write 0x97ede87 thru 0x97ee8a2 (0xa1c bytes) 2024-09-05T17:31:09.329 INFO:teuthology.orchestra.run.smithi050.stdout:1554 punch from 0x5e52120 to 0x5e56f0c, (0x4dec bytes) 2024-09-05T17:31:09.329 INFO:teuthology.orchestra.run.smithi050.stdout:1555 read 0x1c0dbb7 thru 0x1c16ff9 (0x9443 bytes) 2024-09-05T17:31:09.344 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:09.344 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:09.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:09.344 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15042 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8564736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5818175710000002, 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054711072999999999, 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15042 2024-09-05T17:31:09.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763434+0000", 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3910000000000001e-06 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763441+0000", 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1130000000000003e-06 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763449+0000", 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4059999999999999e-06 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.817943+0000", 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054494611999999998 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818037+0000", 2024-09-05T17:31:09.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3430999999999994e-05 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818143+0000", 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010574 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15043 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8581120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5817928160000001, 2024-09-05T17:31:09.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054839756000000003, 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15043 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763457+0000", 2024-09-05T17:31:09.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9700000000000002e-07 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763459+0000", 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2079999999999999e-06 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763466+0000", 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4869999999999996e-06 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763472+0000", 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4099999999999999e-06 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818179+0000", 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054706751999999997 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818235+0000", 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6433e-05 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818296+0000", 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1068999999999994e-05 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15044 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8597504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5817694640000006, 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055068822000000003, 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15044 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763482+0000", 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3120000000000001e-06 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763489+0000", 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8020000000000003e-06 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763494+0000", 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.276e-06 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818342+0000", 2024-09-05T17:31:09.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054847104000000001 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818431+0000", 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9835999999999998e-05 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818548+0000", 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011708499999999999 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15045 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8613888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5817472109999997, 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055286647000000001, 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15045 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.359 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763505+0000", 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763511+0000", 2024-09-05T17:31:09.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.533e-06 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763517+0000", 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3979999999999998e-06 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818594+0000", 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055077706999999997 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818679+0000", 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4797999999999997e-05 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818789+0000", 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109369 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15046 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8630272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.363 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5817103499999998, 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055492107999999998, 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15046 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5699999999999998e-07 2024-09-05T17:31:09.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763542+0000", 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6860000000000002e-06 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763550+0000", 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9859999999999994e-06 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763556+0000", 2024-09-05T17:31:09.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0610000000000001e-06 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818833+0000", 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055276618 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818932+0000", 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9474000000000003e-05 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819031+0000", 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8826000000000006e-05 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15047 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8646656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5816840729999999, 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055685474999999998, 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.368 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15047 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763566+0000", 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763568+0000", 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7049999999999999e-06 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763576+0000", 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6340000000000001e-06 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763581+0000", 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.519e-06 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819078+0000", 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055496668999999998 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819175+0000", 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6883000000000001e-05 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819250+0000", 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5462000000000004e-05 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15048 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8663040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5816591560000006, 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055952927999999999, 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15048 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.373 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:09.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3599999999999999e-07 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763593+0000", 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6589999999999999e-06 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763600+0000", 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0879999999999997e-06 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763607+0000", 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6649999999999997e-06 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819308+0000", 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055701181000000002 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819418+0000", 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109755 2024-09-05T17:31:09.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819543+0000", 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012514399999999999 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15049 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8679424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5816341400000002, 2024-09-05T17:31:09.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056101897999999997, 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15049 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:09.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.63e-07 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763618+0000", 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5959999999999998e-06 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763625+0000", 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9879999999999998e-06 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763631+0000", 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6069999999999998e-06 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819610+0000", 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055979244999999997 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819655+0000", 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5488999999999998e-05 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819717+0000", 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1509999999999999e-05 2024-09-05T17:31:09.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15050 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8695808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5816058290000008, 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056583593000000001, 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.382 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15050 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763644+0000", 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2600000000000002e-07 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763647+0000", 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763654+0000", 2024-09-05T17:31:09.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0119999999999999e-06 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763659+0000", 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639999999999997e-06 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819747+0000", 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056088302 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820111+0000", 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036350299999999999 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820227+0000", 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011605 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15051 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8712192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:09.386 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5815819439999999, 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056866834999999998, 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15051 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:09.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763668+0000", 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7899999999999999e-07 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763670+0000", 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3580000000000001e-06 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763677+0000", 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9809999999999997e-06 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763682+0000", 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3499999999999996e-06 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820263+0000", 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056581285000000002 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820427+0000", 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016371100000000001 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820534+0000", 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106771 2024-09-05T17:31:09.390 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15052 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8728576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.581559403, 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057071953000000002, 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.391 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15052 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:09.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9099999999999999e-07 2024-09-05T17:31:09.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763692+0000", 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.092e-06 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763699+0000", 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5470000000000002e-06 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763704+0000", 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1039999999999998e-06 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820568+0000", 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056863805000000003 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820665+0000", 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7090999999999996e-05 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820762+0000", 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6922999999999993e-05 2024-09-05T17:31:09.395 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15053 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8744960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5815374099999993, 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057269911999999999, 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.396 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15053 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763714+0000", 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3489999999999999e-06 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763721+0000", 2024-09-05T17:31:09.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3119999999999999e-06 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763725+0000", 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.741e-06 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820794+0000", 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057069021999999997 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820883+0000", 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8739999999999994e-05 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820982+0000", 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8368000000000004e-05 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15054 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8761344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:09.400 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5815145509999997, 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057438612999999999, 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15054 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:09.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2e-07 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763737+0000", 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4140000000000001e-06 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763744+0000", 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8279999999999997e-06 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763755+0000", 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1126e-05 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821013+0000", 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057257844000000002 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821087+0000", 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3651000000000003e-05 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821173+0000", 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6329999999999995e-05 2024-09-05T17:31:09.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15055 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8777728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5814869520000006, 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.05769469, 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.405 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15055 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763763+0000", 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0600000000000001e-07 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763765+0000", 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.12e-06 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763770+0000", 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8209999999999998e-06 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763777+0000", 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999999e-06 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821205+0000", 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057428078 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821292+0000", 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6842000000000006e-05 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821457+0000", 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016531299999999999 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.409 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15056 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8794112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5814651019999992, 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057974700999999997, 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15056 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.410 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763786+0000", 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1229999999999998e-06 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763794+0000", 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1590000000000004e-06 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763799+0000", 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9309999999999999e-06 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821490+0000", 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057691872999999998 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821616+0000", 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125327 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821759+0000", 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014289500000000001 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15057 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8810496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5814434990000006, 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058215998999999997, 2024-09-05T17:31:09.414 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15057 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4300000000000003e-07 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763808+0000", 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0379999999999998e-06 2024-09-05T17:31:09.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763816+0000", 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763821+0000", 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0429999999999998e-06 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821799+0000", 2024-09-05T17:31:09.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057977385999999999 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821909+0000", 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110801 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822022+0000", 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000112185 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15058 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8826880~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5814052220000008, 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058413768999999997, 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15058 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770678+0000", 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068342020000000002 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770685+0000", 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.063e-06 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770696+0000", 2024-09-05T17:31:09.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1225e-05 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770704+0000", 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3880000000000002e-06 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822073+0000", 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.051369608999999997 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822153+0000", 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9225000000000001e-05 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822258+0000", 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010505699999999999 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15079 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9170944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.423 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5742682410000004, 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054753171000000003, 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15079 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7500000000000001e-07 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770982+0000", 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770986+0000", 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.225e-06 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770989+0000", 2024-09-05T17:31:09.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825631+0000", 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054642257999999999 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825680+0000", 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9026000000000001e-05 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825734+0000", 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4218000000000002e-05 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15080 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9187328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5742393919999991, 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054872632999999997, 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15080 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8599999999999999e-07 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771012+0000", 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.57e-06 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771016+0000", 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1919999999999998e-06 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771019+0000", 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0790000000000001e-06 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825770+0000", 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054750974000000001 2024-09-05T17:31:09.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825820+0000", 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9873999999999997e-05 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825882+0000", 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2558000000000007e-05 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.432 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15081 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9203712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5742162020000006, 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054991252999999997, 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15081 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778817+0000", 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077838489999999998 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778822+0000", 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9910000000000002e-06 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778831+0000", 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2089999999999994e-06 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778837+0000", 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8289999999999996e-06 2024-09-05T17:31:09.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825928+0000", 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047091230999999997 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825972+0000", 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3964000000000001e-05 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.826024+0000", 2024-09-05T17:31:09.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2179999999999998e-05 2024-09-05T17:31:09.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.437 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.437 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.437 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:09.438 INFO:teuthology.orchestra.run.smithi050.stdout:1557 write 0xe7bf120 thru 0xe7c6a3b (0x791c bytes) 2024-09-05T17:31:09.438 INFO:teuthology.orchestra.run.smithi050.stdout:1559 writesame 0x6999625 thru 0x699c19e data_size 0xa(0x2b7a bytes) 2024-09-05T17:31:09.439 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:09.441 INFO:teuthology.orchestra.run.smithi050.stdout:1561 punch from 0x21c13eb to 0x21c5748, (0x435d bytes) 2024-09-05T17:31:09.441 INFO:teuthology.orchestra.run.smithi050.stdout:1562 punch from 0x70f6040 to 0x70feeb5, (0x8e75 bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1563 read 0x5ca0cf6 thru 0x5ca5ac6 (0x4dd1 bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1566 read 0x15f0ee9 thru 0x1600057 (0xf16f bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1568 read 0xc30099c thru 0xc30f3ef (0xea54 bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1572 write 0x3a5a7d6 thru 0x3a63aa3 (0x92ce bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1573 read 0x2c5311b thru 0x2c609ae (0xd894 bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1576 punch from 0xb38555d to 0xb386372, (0xe15 bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1577 write 0xc41ea51 thru 0xc4243e1 (0x5991 bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1578 read 0xbf760b thru 0xbf835e (0xd54 bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1582 read 0x404647f thru 0x4048da7 (0x2929 bytes) 2024-09-05T17:31:09.442 INFO:teuthology.orchestra.run.smithi050.stdout:1583 write 0x31df12e thru 0x31e6fae (0x7e81 bytes) 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1585 write 0x371130e thru 0x37153e3 (0x40d6 bytes) 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1586 trunc from 0xe7c6a3c to 0xea63f32 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1587 write 0xcaa96f9 thru 0xcab08e1 (0x71e9 bytes) 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1588 read 0x1e2f294 thru 0x1e3970a (0xa477 bytes) 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1589 read 0x4a832ab thru 0x4a9183a (0xe590 bytes) 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1590 punch from 0xe59bb3e to 0xe59d006, (0x14c8 bytes) 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1594 punch from 0xb7d368a to 0xb7e320a, (0xfb80 bytes) 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1595 read 0x5f779b9 thru 0x5f87108 (0xf750 bytes) 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1596 trunc from 0xea63f32 to 0xd423038 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.443 INFO:teuthology.orchestra.run.smithi050.stdout:1598 trunc from 0xd423038 to 0xbc20cdf 2024-09-05T17:31:09.444 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:09.434+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:09.478 INFO:teuthology.orchestra.run.smithi050.stdout:1601 write 0xce59598 thru 0xce5ae4c (0x18b5 bytes) 2024-09-05T17:31:09.483 INFO:teuthology.orchestra.run.smithi050.stdout:1602 write 0x492a37a thru 0x4934744 (0xa3cb bytes) 2024-09-05T17:31:09.488 INFO:teuthology.orchestra.run.smithi050.stdout:1603 trunc from 0xce5ae4d to 0xc6b5949 2024-09-05T17:31:09.507 INFO:teuthology.orchestra.run.smithi050.stdout:1604 write 0xa60a6eb thru 0xa6131b8 (0x8ace bytes) 2024-09-05T17:31:09.514 INFO:teuthology.orchestra.run.smithi050.stdout:1605 punch from 0x5d5e94b to 0x5d60e6e, (0x2523 bytes) 2024-09-05T17:31:09.514 INFO:teuthology.orchestra.run.smithi050.stdout:1606 read 0x9e7f53e thru 0x9e8d917 (0xe3da bytes) 2024-09-05T17:31:09.514 INFO:teuthology.orchestra.run.smithi050.stdout:1609 writesame 0xc3de345 thru 0xc3eb593 data_size 0x1(0xd24f bytes) 2024-09-05T17:31:09.539 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:09.534+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:09.546 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:31:09.574 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:09.594 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:09.594 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:09.594 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:09.595 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.595 INFO:teuthology.orchestra.run.smithi050.stdout:1612 writesame 0x834e70 thru 0x83c868 data_size 0x5(0x79f9 bytes) 2024-09-05T17:31:09.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:09.596 INFO:teuthology.orchestra.run.smithi050.stdout:1614 punch from 0x38c1570 to 0x38c6fd7, (0x5a67 bytes) 2024-09-05T17:31:09.598 INFO:teuthology.orchestra.run.smithi050.stdout:1615 trunc from 0xc6b5949 to 0x83144d3 2024-09-05T17:31:09.638 INFO:teuthology.orchestra.run.smithi050.stdout:1616 writesame 0xcba444f thru 0xcba4c13 data_size 0x27(0x7c5 bytes) 2024-09-05T17:31:09.640 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:09.638+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:09.649 INFO:teuthology.orchestra.run.smithi050.stdout:1618 trunc from 0xcba4c14 to 0x5bac744 2024-09-05T17:31:09.669 INFO:teuthology.orchestra.run.smithi050.stdout:1619 punch from 0x532732a to 0x53304ec, (0x91c2 bytes) 2024-09-05T17:31:09.681 INFO:teuthology.orchestra.run.smithi050.stdout:1620 trunc from 0x5bac744 to 0xd66dfad 2024-09-05T17:31:09.691 INFO:teuthology.orchestra.run.smithi050.stdout:1621 read 0x24933 thru 0x28454 (0x3b22 bytes) 2024-09-05T17:31:09.692 INFO:teuthology.orchestra.run.smithi050.stdout:1623 read 0x8f64fb5 thru 0x8f6f6e2 (0xa72e bytes) 2024-09-05T17:31:09.693 INFO:teuthology.orchestra.run.smithi050.stdout:1624 writesame 0x91be1f7 thru 0x91c995d data_size 0x1(0xb767 bytes) 2024-09-05T17:31:09.738 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:09.738 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:09.738 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:09.738 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:09.738 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:09.740 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:09.738+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:09.744 INFO:teuthology.orchestra.run.smithi050.stdout:1625 write 0x4213352 thru 0x421f839 (0xc4e8 bytes) 2024-09-05T17:31:09.753 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:09.768 INFO:teuthology.orchestra.run.smithi050.stdout:1626 trunc from 0xd66dfad to 0x14e403e 2024-09-05T17:31:09.815 INFO:teuthology.orchestra.run.smithi050.stdout:1627 writesame 0x2d3b972 thru 0x2d46282 data_size 0x3f(0xa911 bytes) 2024-09-05T17:31:09.825 INFO:teuthology.orchestra.run.smithi050.stdout:1628 write 0x2ef038f thru 0x2ef9b80 (0x97f2 bytes) 2024-09-05T17:31:09.831 INFO:teuthology.orchestra.run.smithi050.stdout:1631 read 0x4cbf4c thru 0x4ce1d8 (0x228d bytes) 2024-09-05T17:31:09.837 INFO:teuthology.orchestra.run.smithi050.stdout:1633 trunc from 0x2ef9b81 to 0x5ee9c6e 2024-09-05T17:31:09.841 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:09.839+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:09.864 INFO:teuthology.orchestra.run.smithi050.stdout:1634 writesame 0x9fe9b14 thru 0x9ff2352 data_size 0x1(0x883f bytes) 2024-09-05T17:31:09.864 INFO:teuthology.orchestra.run.smithi050.stdout:1635 punch from 0x40bb3b to 0x41a693, (0xeb58 bytes) 2024-09-05T17:31:09.864 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.876 INFO:teuthology.orchestra.run.smithi050.stdout:1637 write 0xacf5324 thru 0xacff311 (0x9fee bytes) 2024-09-05T17:31:09.883 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.883 INFO:teuthology.orchestra.run.smithi050.stdout:1640 punch from 0x7ac18b8 to 0x7ac35cb, (0x1d13 bytes) 2024-09-05T17:31:09.883 INFO:teuthology.orchestra.run.smithi050.stdout:1641 punch from 0x1a4c47e to 0x1a4e516, (0x2098 bytes) 2024-09-05T17:31:09.883 INFO:teuthology.orchestra.run.smithi050.stdout:1643 read 0x1485334 thru 0x14905e9 (0xb2b6 bytes) 2024-09-05T17:31:09.884 INFO:teuthology.orchestra.run.smithi050.stdout:1644 write 0x7d193e thru 0x7d3cf9 (0x23bc bytes) 2024-09-05T17:31:09.892 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:09.892 INFO:teuthology.orchestra.run.smithi050.stdout:1646 read 0x579a834 thru 0x57a86a2 (0xde6f bytes) 2024-09-05T17:31:09.893 INFO:teuthology.orchestra.run.smithi050.stdout:1647 write 0x16aab41 thru 0x16ba272 (0xf732 bytes) 2024-09-05T17:31:09.896 INFO:teuthology.orchestra.run.smithi050.stdout:1648 read 0xa23f4be thru 0xa2479ac (0x84ef bytes) 2024-09-05T17:31:09.896 INFO:teuthology.orchestra.run.smithi050.stdout:1649 read 0x296064a thru 0x2966fa2 (0x6959 bytes) 2024-09-05T17:31:09.896 INFO:teuthology.orchestra.run.smithi050.stdout:1650 writesame 0x7e3760c thru 0x7e45f2b data_size 0x50(0xe920 bytes) 2024-09-05T17:31:09.903 INFO:teuthology.orchestra.run.smithi050.stdout:1653 writesame 0xa973201 thru 0xa97b110 data_size 0x6b(0x7f10 bytes) 2024-09-05T17:31:09.906 INFO:teuthology.orchestra.run.smithi050.stdout:1654 trunc from 0xacff312 to 0xae3e345 2024-09-05T17:31:09.908 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4257.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-05T17:31:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:09.908 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 37.861338076999999, 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002468479, 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049864+0000", 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0800000000000004e-07 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049878+0000", 2024-09-05T17:31:09.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4165000000000001e-05 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049896+0000", 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8436000000000001e-05 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049914+0000", 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7229999999999999e-05 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050094+0000", 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180564 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050134+0000", 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9595000000000003e-05 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052268+0000", 2024-09-05T17:31:09.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021347580000000001 2024-09-05T17:31:09.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052332+0000", 2024-09-05T17:31:09.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3022999999999996e-05 2024-09-05T17:31:09.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.913 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3446 3.9 e28/24 3:91eb5b84:::rbd_data.114070605229.00000000000000ab:head v 28'5, mlcod=28'3)", 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.667714994000001, 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019348169999999999, 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.914 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243489+0000", 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8059999999999999e-06 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243530+0000", 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1083e-05 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243568+0000", 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7987000000000001e-05 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243583+0000", 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5492999999999999e-05 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243709+0000", 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012500799999999999 2024-09-05T17:31:09.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243759+0000", 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0838999999999999e-05 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.245343+0000", 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001584006 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.245421+0000", 2024-09-05T17:31:09.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7595000000000005e-05 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.664887647, 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:31:09.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3604 3.4 e28/24 3:27555207:::rbd_data.114070605229.00000000000000e7:head v 28'21, mlcod=28'19)", 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.462897928, 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028585849999999999, 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:09.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448306+0000", 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448357+0000", 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0719e-05 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448402+0000", 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5166000000000001e-05 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448426+0000", 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3813999999999999e-05 2024-09-05T17:31:09.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448574+0000", 2024-09-05T17:31:09.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014806500000000001 2024-09-05T17:31:09.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448613+0000", 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8353999999999999e-05 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451052+0000", 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024396909999999999 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451162+0000", 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109533 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:7801 3.0 e30/24 3:00d91651:::rbd_data.1140d4ae3aec.0000000000000025:head v 30'105, mlcod=30'102)", 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.574212948, 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022194089999999999, 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336989+0000", 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.316e-06 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337179+0000", 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018963199999999999 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337195+0000", 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5880999999999999e-05 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337202+0000", 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3189999999999997e-06 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337272+0000", 2024-09-05T17:31:09.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9333999999999997e-05 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337289+0000", 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7445999999999999e-05 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339156+0000", 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001866988 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339208+0000", 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1493000000000003e-05 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:12781 3.4 e33/24 3:2593df46:::rbd_data.11403aa71fdc.00000000000002f3:head v 33'79, mlcod=30'76)", 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.886931527, 2024-09-05T17:31:09.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019698900000000002, 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024272+0000", 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3889999999999999e-06 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024292+0000", 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0434000000000001e-05 2024-09-05T17:31:09.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024324+0000", 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1615000000000001e-05 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024338+0000", 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024491+0000", 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015269900000000001 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024555+0000", 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3398000000000005e-05 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026149+0000", 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00159431 2024-09-05T17:31:09.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026239+0000", 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0637000000000007e-05 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27055 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'125, mlcod=36'123)", 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:03.867050+0000", 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.044151544, 2024-09-05T17:31:09.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018541479999999999, 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867050+0000", 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867050+0000", 2024-09-05T17:31:09.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867051+0000", 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7039999999999999e-06 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867061+0000", 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9329999999999996e-06 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867088+0000", 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6766000000000001e-05 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867101+0000", 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2831e-05 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867245+0000", 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014468099999999999 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.867281+0000", 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5706e-05 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.868838+0000", 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015569589999999999 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.868904+0000", 2024-09-05T17:31:09.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5568000000000006e-05 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27061 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'128, mlcod=36'126)", 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.0229454459999996, 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019078750000000001, 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.944 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888257+0000", 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.173e-06 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888263+0000", 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1149999999999999e-06 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888283+0000", 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9684e-05 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888289+0000", 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4649999999999999e-06 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888406+0000", 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011736299999999999 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888473+0000", 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6657999999999998e-05 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.890104+0000", 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016305410000000001 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.890164+0000", 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9876000000000001e-05 2024-09-05T17:31:09.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27251 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'174, mlcod=36'172)", 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.6922578999999995, 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025164060000000001, 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:09.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218944+0000", 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.057e-06 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218953+0000", 2024-09-05T17:31:09.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5369999999999997e-06 2024-09-05T17:31:09.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218974+0000", 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0772e-05 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218986+0000", 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219118+0000", 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132638 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219177+0000", 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8270000000000003e-05 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221306+0000", 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002128956 2024-09-05T17:31:09.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221460+0000", 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000153991 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27272 3.9 e36/24 3:961ac59e:::rbd_data.1140f3505917.000000000000023a:head v 36'186, mlcod=36'184)", 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:09.957 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.6420059660000002, 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026438630000000002, 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:09.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269196+0000", 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2610000000000001e-06 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270692+0000", 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495365 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270721+0000", 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9036000000000001e-05 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270736+0000", 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4979e-05 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270814+0000", 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8010999999999996e-05 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270836+0000", 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2651999999999999e-05 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271799+0000", 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096227200000000002 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271839+0000", 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0287000000000002e-05 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27439 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'228, mlcod=36'226)", 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.3340852559999998, 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031113629999999998, 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577119+0000", 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7549999999999999e-06 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577132+0000", 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3699e-05 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577165+0000", 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2645999999999999e-05 2024-09-05T17:31:09.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577181+0000", 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5764999999999999e-05 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577311+0000", 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013032399999999999 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577375+0000", 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3532000000000001e-05 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580116+0000", 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027411520000000002 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580227+0000", 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011149 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27440 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'229, mlcod=36'226)", 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.3323948980000004, 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022421120000000001, 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578808+0000", 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0499999999999999e-06 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578823+0000", 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4290999999999999e-05 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578855+0000", 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2682999999999999e-05 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578875+0000", 2024-09-05T17:31:09.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9881000000000002e-05 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579029+0000", 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015355499999999999 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579173+0000", 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014394599999999999 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580954+0000", 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001781134 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.581048+0000", 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4572000000000002e-05 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27514 3.0 e36/24 3:07a8b63a:::rbd_data.1140f3505917.0000000000000367:head v 36'132, mlcod=36'130)", 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.748279+0000", 2024-09-05T17:31:09.971 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.1629225380000001, 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018615159999999999, 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748279+0000", 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748279+0000", 2024-09-05T17:31:09.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748280+0000", 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1179999999999999e-06 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748305+0000", 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5605e-05 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748322+0000", 2024-09-05T17:31:09.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6762999999999999e-05 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748331+0000", 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7020000000000007e-06 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748459+0000", 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012819599999999999 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.748519+0000", 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9731999999999997e-05 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.750087+0000", 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015678599999999999 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.750140+0000", 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3539999999999999e-05 2024-09-05T17:31:09.975 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27516 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'242, mlcod=36'240)", 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.130287891, 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001967735, 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780916+0000", 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2790000000000001e-06 2024-09-05T17:31:09.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780930+0000", 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4914e-05 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780958+0000", 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7217e-05 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780972+0000", 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4456e-05 2024-09-05T17:31:09.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781128+0000", 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015544699999999999 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781166+0000", 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8868999999999997e-05 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782803+0000", 2024-09-05T17:31:09.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016366519999999999 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782881+0000", 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7900999999999998e-05 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27713 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'281, mlcod=36'279)", 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.109112+0000", 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.8020889550000003, 2024-09-05T17:31:09.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001888942, 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109112+0000", 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109112+0000", 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109115+0000", 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2629999999999999e-06 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109135+0000", 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9607999999999999e-05 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109175+0000", 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0295e-05 2024-09-05T17:31:09.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109197+0000", 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2110999999999999e-05 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109347+0000", 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149949 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.109388+0000", 2024-09-05T17:31:09.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0605000000000002e-05 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.110908+0000", 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001520076 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.111001+0000", 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3035000000000006e-05 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27722 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'282, mlcod=36'280)", 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.123519+0000", 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.7876822450000001, 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001865198, 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123519+0000", 2024-09-05T17:31:09.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123519+0000", 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123522+0000", 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8930000000000001e-06 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123534+0000", 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2512e-05 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123562+0000", 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7436e-05 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123575+0000", 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3539e-05 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123721+0000", 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014547 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.123753+0000", 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2058999999999999e-05 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.125312+0000", 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015588959999999999 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.125384+0000", 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2392999999999996e-05 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27724 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'284, mlcod=36'280)", 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.127560+0000", 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.7836415050000003, 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001852963, 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.989 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127560+0000", 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127560+0000", 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127561+0000", 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.353e-06 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127571+0000", 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0076e-05 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127596+0000", 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4584e-05 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127608+0000", 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2515e-05 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127707+0000", 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8492000000000005e-05 2024-09-05T17:31:09.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.127735+0000", 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8177000000000001e-05 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.129294+0000", 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00155923 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.129413+0000", 2024-09-05T17:31:09.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000118536 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27750 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'288, mlcod=36'286)", 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.7269500740000003, 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021578209999999999, 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184254+0000", 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-05T17:31:09.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184272+0000", 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8284e-05 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184311+0000", 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184329+0000", 2024-09-05T17:31:09.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8077999999999999e-05 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184507+0000", 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000177035 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184573+0000", 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6729000000000004e-05 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:09.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186301+0000", 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017280279999999999 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186409+0000", 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107601 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27759 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'289, mlcod=36'287)", 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:09.998 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.7131416179999999, 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026394679999999998, 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:09.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198063+0000", 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0570000000000001e-06 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198077+0000", 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4270999999999999e-05 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198112+0000", 2024-09-05T17:31:10.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4953000000000002e-05 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198127+0000", 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5597999999999999e-05 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198290+0000", 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162631 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198352+0000", 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1796000000000003e-05 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200559+0000", 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022068579999999999 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200699+0000", 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000140304 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:30784 3.9 e37/24 3:9275f381:::rbd_data.1140f3505917.00000000000001d4:head v 37'308, mlcod=37'305)", 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.025924592, 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023488469999999998, 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1399999999999995e-07 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885285+0000", 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7810000000000005e-06 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885300+0000", 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4833e-05 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885308+0000", 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5769999999999996e-06 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885748+0000", 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044075899999999999 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885769+0000", 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0922999999999999e-05 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.887576+0000", 2024-09-05T17:31:10.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018066359999999999 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.887625+0000", 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9424e-05 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.007 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:10.009 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:10.010 INFO:teuthology.orchestra.run.smithi050.stdout:1655 write 0xd5c7c1c thru 0xd5d50c0 (0xd4a5 bytes) 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:1657 write 0xce5567d thru 0xce57dae (0x2732 bytes) 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:1660 write 0x396f687 thru 0x3972490 (0x2e0a bytes) 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:1661 read 0xc4c9a1f thru 0xc4cf0e8 (0x56ca bytes) 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:1662 read 0x7013c64 thru 0x7013f01 (0x29e bytes) 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:1664 trunc from 0xd5d50c1 to 0xe7c0e32 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:1665 write 0x6c3a33d thru 0x6c41e83 (0x7b47 bytes) 2024-09-05T17:31:10.011 INFO:teuthology.orchestra.run.smithi050.stdout:1667 trunc from 0xe7c0e32 to 0x4ee468c 2024-09-05T17:31:10.011 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:10.007+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:10.012 INFO:teuthology.orchestra.run.smithi050.stdout:1668 read 0x12c0a68 thru 0x12cf82a (0xedc3 bytes) 2024-09-05T17:31:10.012 INFO:teuthology.orchestra.run.smithi050.stdout:1669 read 0x420f6fe thru 0x420fad4 (0x3d7 bytes) 2024-09-05T17:31:10.018 INFO:teuthology.orchestra.run.smithi050.stdout:1673 trunc from 0x4ee468c to 0x2b14e6b 2024-09-05T17:31:10.038 INFO:teuthology.orchestra.run.smithi050.stdout:1674 read 0xede189 thru 0xeeb781 (0xd5f9 bytes) 2024-09-05T17:31:10.039 INFO:teuthology.orchestra.run.smithi050.stdout:1675 read 0x1bca752 thru 0x1bcc83a (0x20e9 bytes) 2024-09-05T17:31:10.039 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.061 INFO:teuthology.orchestra.run.smithi050.stdout:1678 write 0x94ce741 thru 0x94dd17b (0xea3b bytes) 2024-09-05T17:31:10.068 INFO:teuthology.orchestra.run.smithi050.stdout:1679 punch from 0x6255ba to 0x627205, (0x1c4b bytes) 2024-09-05T17:31:10.068 INFO:teuthology.orchestra.run.smithi050.stdout:1681 writesame 0x4244a4 thru 0x433cce data_size 0x75(0xf82b bytes) 2024-09-05T17:31:10.071 INFO:teuthology.orchestra.run.smithi050.stdout:1685 write 0x9048b1b thru 0x9050d62 (0x8248 bytes) 2024-09-05T17:31:10.076 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.076 INFO:teuthology.orchestra.run.smithi050.stdout:1687 punch from 0x6d59448 to 0x6d68584, (0xf13c bytes) 2024-09-05T17:31:10.089 INFO:teuthology.orchestra.run.smithi050.stdout:1691 trunc from 0x94dd17c to 0xb39aa1 2024-09-05T17:31:10.110 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:10.106+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:10.120 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.136 INFO:teuthology.orchestra.run.smithi050.stdout:1694 writesame 0x55e8bac thru 0x55eeec2 data_size 0x1(0x6317 bytes) 2024-09-05T17:31:10.146 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:10.146 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:10.147 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:10.147 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:10.153 INFO:teuthology.orchestra.run.smithi050.stdout:1695 write 0xa6d48ea thru 0xa6d5c99 (0x13b0 bytes) 2024-09-05T17:31:10.158 INFO:teuthology.orchestra.run.smithi050.stdout:1696 read 0xa378d4a thru 0xa384cb1 (0xbf68 bytes) 2024-09-05T17:31:10.159 INFO:teuthology.orchestra.run.smithi050.stdout:1697 writesame 0xe77145 thru 0xe7efdc data_size 0x4(0x7e98 bytes) 2024-09-05T17:31:10.162 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:10.179 INFO:teuthology.orchestra.run.smithi050.stdout:1698 writesame 0xc0cbc3b thru 0xc0cd916 data_size 0x2(0x1cdc bytes) 2024-09-05T17:31:10.179 INFO:teuthology.orchestra.run.smithi050.stdout:1699 write 0xee7315 thru 0xef469f (0xd38b bytes) 2024-09-05T17:31:10.185 INFO:teuthology.orchestra.run.smithi050.stdout:1700 writesame 0x191c410 thru 0x19265f7 data_size 0x58(0xa1e8 bytes) 2024-09-05T17:31:10.187 INFO:teuthology.orchestra.run.smithi050.stdout:1701 write 0x78f6d1a thru 0x78fcb28 (0x5e0f bytes) 2024-09-05T17:31:10.193 INFO:teuthology.orchestra.run.smithi050.stdout:1702 read 0x2a70826 thru 0x2a763e8 (0x5bc3 bytes) 2024-09-05T17:31:10.193 INFO:teuthology.orchestra.run.smithi050.stdout:1703 read 0xb68887d thru 0xb695e07 (0xd58b bytes) 2024-09-05T17:31:10.193 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.193 INFO:teuthology.orchestra.run.smithi050.stdout:1705 punch from 0x3d4a3d4 to 0x3d5847e, (0xe0aa bytes) 2024-09-05T17:31:10.194 INFO:teuthology.orchestra.run.smithi050.stdout:1706 punch from 0x8b5fbac to 0x8b66d32, (0x7186 bytes) 2024-09-05T17:31:10.194 INFO:teuthology.orchestra.run.smithi050.stdout:1707 punch from 0x330394 to 0x33afee, (0xac5a bytes) 2024-09-05T17:31:10.194 INFO:teuthology.orchestra.run.smithi050.stdout:1708 writesame 0xbcd8a07 thru 0xbcd9435 data_size 0xb(0xa2f bytes) 2024-09-05T17:31:10.199 INFO:teuthology.orchestra.run.smithi050.stdout:1709 punch from 0xa2603f7 to 0xa265e74, (0x5a7d bytes) 2024-09-05T17:31:10.199 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.199 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.199 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.199 INFO:teuthology.orchestra.run.smithi050.stdout:1716 writesame 0xaa0ae48 thru 0xaa0e916 data_size 0x1(0x3acf bytes) 2024-09-05T17:31:10.210 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.210 INFO:teuthology.orchestra.run.smithi050.stdout:1722 write 0x298711e thru 0x2989096 (0x1f79 bytes) 2024-09-05T17:31:10.211 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:10.211+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:10.216 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.216 INFO:teuthology.orchestra.run.smithi050.stdout:1724 read 0x8731405 thru 0x873609a (0x4c96 bytes) 2024-09-05T17:31:10.216 INFO:teuthology.orchestra.run.smithi050.stdout:1725 writesame 0xae6964 thru 0xaef820 data_size 0x1(0x8ebd bytes) 2024-09-05T17:31:10.272 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.272 INFO:teuthology.orchestra.run.smithi050.stdout:1728 read 0x45ade73 thru 0x45b9895 (0xba23 bytes) 2024-09-05T17:31:10.272 INFO:teuthology.orchestra.run.smithi050.stdout:1729 read 0x33a0021 thru 0x33ac17c (0xc15c bytes) 2024-09-05T17:31:10.272 INFO:teuthology.orchestra.run.smithi050.stdout:1731 read 0x7fb78e0 thru 0x7fc0e35 (0x9556 bytes) 2024-09-05T17:31:10.272 INFO:teuthology.orchestra.run.smithi050.stdout:1732 read 0x92cdc7d thru 0x92d8870 (0xabf4 bytes) 2024-09-05T17:31:10.272 INFO:teuthology.orchestra.run.smithi050.stdout:1734 punch from 0x2c5bf7c to 0x2c6afa3, (0xf027 bytes) 2024-09-05T17:31:10.273 INFO:teuthology.orchestra.run.smithi050.stdout:1735 write 0x5eeb309 thru 0x5eef1d2 (0x3eca bytes) 2024-09-05T17:31:10.279 INFO:teuthology.orchestra.run.smithi050.stdout:1736 writesame 0x1e2c356 thru 0x1e2f02c data_size 0x1(0x2cd7 bytes) 2024-09-05T17:31:10.297 INFO:teuthology.orchestra.run.smithi050.stdout:1737 read 0xcf7875 thru 0xd056ea (0xde76 bytes) 2024-09-05T17:31:10.297 INFO:teuthology.orchestra.run.smithi050.stdout:1738 write 0x187c7f3 thru 0x187f9a9 (0x31b7 bytes) 2024-09-05T17:31:10.308 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:10.308 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:10.308 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:10.309 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:10.309 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:10.311 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:10.311+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:10.324 INFO:teuthology.orchestra.run.smithi050.stdout:1744 trunc from 0xc0cd917 to 0x388495f 2024-09-05T17:31:10.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:10.346 INFO:teuthology.orchestra.run.smithi050.stdout:1745 punch from 0xd3bd0 to 0xde7c2, (0xabf2 bytes) 2024-09-05T17:31:10.363 INFO:teuthology.orchestra.run.smithi050.stdout:1746 writesame 0x62ef584 thru 0x62f2702 data_size 0x1(0x317f bytes) 2024-09-05T17:31:10.363 INFO:teuthology.orchestra.run.smithi050.stdout:1747 read 0x11d5af2 thru 0x11e4d87 (0xf296 bytes) 2024-09-05T17:31:10.363 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.363 INFO:teuthology.orchestra.run.smithi050.stdout:1749 read 0x4821dec thru 0x48250c6 (0x32db bytes) 2024-09-05T17:31:10.371 INFO:teuthology.orchestra.run.smithi050.stdout:1750 trunc from 0x62f2703 to 0xa1c6df9 2024-09-05T17:31:10.380 INFO:teuthology.orchestra.run.smithi050.stdout:1751 write 0x5b812f5 thru 0x5b90fb8 (0xfcc4 bytes) 2024-09-05T17:31:10.386 INFO:teuthology.orchestra.run.smithi050.stdout:1752 writesame 0x5977281 thru 0x5981f34 data_size 0xe(0xacb4 bytes) 2024-09-05T17:31:10.396 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.396 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.396 INFO:teuthology.orchestra.run.smithi050.stdout:1755 read 0x4d7587e thru 0x4d8289d (0xd020 bytes) 2024-09-05T17:31:10.396 INFO:teuthology.orchestra.run.smithi050.stdout:1756 punch from 0x4d24fa0 to 0x4d34c77, (0xfcd7 bytes) 2024-09-05T17:31:10.396 INFO:teuthology.orchestra.run.smithi050.stdout:1757 read 0x22517e8 thru 0x2256dcf (0x55e8 bytes) 2024-09-05T17:31:10.413 INFO:teuthology.orchestra.run.smithi050.stdout:1758 writesame 0xdb0968f thru 0xdb09809 data_size 0x1(0x17b bytes) 2024-09-05T17:31:10.413 INFO:teuthology.orchestra.run.smithi050.stdout:1759 read 0xd87c2d2 thru 0xd87cd6e (0xa9d bytes) 2024-09-05T17:31:10.413 INFO:teuthology.orchestra.run.smithi050.stdout:1760 write 0xa6bdb1e thru 0xa6c2f7a (0x545d bytes) 2024-09-05T17:31:10.418 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:10.419+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:10.419 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.419 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.419 INFO:teuthology.orchestra.run.smithi050.stdout:1763 read 0x3eb3ba4 thru 0x3eb7577 (0x39d4 bytes) 2024-09-05T17:31:10.419 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.419 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.419 INFO:teuthology.orchestra.run.smithi050.stdout:1766 read 0x33998d5 thru 0x33a2704 (0x8e30 bytes) 2024-09-05T17:31:10.419 INFO:teuthology.orchestra.run.smithi050.stdout:1768 write 0x386082e thru 0x386dad4 (0xd2a7 bytes) 2024-09-05T17:31:10.425 INFO:teuthology.orchestra.run.smithi050.stdout:1770 read 0xc16c6f9 thru 0xc16c963 (0x26b bytes) 2024-09-05T17:31:10.425 INFO:teuthology.orchestra.run.smithi050.stdout:1771 writesame 0x8769877 thru 0x876d6ca data_size 0x1(0x3e54 bytes) 2024-09-05T17:31:10.450 INFO:teuthology.orchestra.run.smithi050.stdout:1772 punch from 0x6662004 to 0x6667479, (0x5475 bytes) 2024-09-05T17:31:10.450 INFO:teuthology.orchestra.run.smithi050.stdout:1773 write 0x3bbd498 thru 0x3bbfdfe (0x2967 bytes) 2024-09-05T17:31:10.452 INFO:teuthology.orchestra.run.smithi050.stdout:1774 write 0xc9a28c4 thru 0xc9b0dde (0xe51b bytes) 2024-09-05T17:31:10.461 INFO:teuthology.orchestra.run.smithi050.stdout:1775 read 0xcf23bdc thru 0xcf2c5ac (0x89d1 bytes) 2024-09-05T17:31:10.461 INFO:teuthology.orchestra.run.smithi050.stdout:1777 punch from 0xa936175 to 0xa93d47c, (0x7307 bytes) 2024-09-05T17:31:10.461 INFO:teuthology.orchestra.run.smithi050.stdout:1780 read 0x75ab28b thru 0x75b6554 (0xb2ca bytes) 2024-09-05T17:31:10.478 INFO:teuthology.orchestra.run.smithi050.stdout:1781 writesame 0xea2984a thru 0xea315db data_size 0x1(0x7d92 bytes) 2024-09-05T17:31:10.478 INFO:teuthology.orchestra.run.smithi050.stdout:1782 write 0xab08764 thru 0xab09dc5 (0x1662 bytes) 2024-09-05T17:31:10.484 INFO:teuthology.orchestra.run.smithi050.stdout:1783 punch from 0x8f4acdf to 0x8f513c4, (0x66e5 bytes) 2024-09-05T17:31:10.484 INFO:teuthology.orchestra.run.smithi050.stdout:1784 read 0x53fd8ee thru 0x54087c1 (0xaed4 bytes) 2024-09-05T17:31:10.485 INFO:teuthology.orchestra.run.smithi050.stdout:1785 write 0x4e8994d thru 0x4e91ea9 (0x855d bytes) 2024-09-05T17:31:10.487 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:10.487 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.279172723, 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:31:10.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.278151396, 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:31:10.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:31:10.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.497 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.277062898000001, 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:31:10.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.276042387, 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.502 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:31:10.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.275015438000001, 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:31:10.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.27267284, 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:31:10.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.267720667000001, 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.517 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:31:10.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13418 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6023168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.267124767, 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14037719400000001, 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13418 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221572+0000", 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034026199999999998 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221584+0000", 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1321999999999999e-05 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221603+0000", 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9344e-05 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221615+0000", 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1565e-05 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361125+0000", 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139510734 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361358+0000", 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023231599999999999 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361609+0000", 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025165099999999998 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.266720683999999, 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.527 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:10.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:31:10.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:31:10.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.266115285, 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.532 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.265056157, 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.537 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:31:10.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:31:10.541 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.264414874, 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.542 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:10.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:31:10.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.263819979999999, 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.547 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:31:10.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:31:10.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.551 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.262754786, 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.262114095999999, 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:31:10.556 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:31:10.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.560 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.261663395999999, 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:31:10.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.261017653, 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.566 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.260645634999999, 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.571 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:31:10.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:10.575 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.260004581, 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:10.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.579 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.259406051999999, 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.580 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:31:10.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:10.584 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:10.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:10.586 INFO:teuthology.orchestra.run.smithi050.stdout:1786 punch from 0x17cf165 to 0x17df10a, (0xffa5 bytes) 2024-09-05T17:31:10.586 INFO:teuthology.orchestra.run.smithi050.stdout:1787 writesame 0xa7d5dfe thru 0xa7dac36 data_size 0x3(0x4e39 bytes) 2024-09-05T17:31:10.586 INFO:teuthology.orchestra.run.smithi050.stdout:1788 punch from 0x5c9134 to 0x5cfe6f, (0x6d3b bytes) 2024-09-05T17:31:10.586 INFO:teuthology.orchestra.run.smithi050.stdout:1789 read 0xad448f3 thru 0xad517de (0xceec bytes) 2024-09-05T17:31:10.586 INFO:teuthology.orchestra.run.smithi050.stdout:1792 write 0x61cf29a thru 0x61d2b61 (0x38c8 bytes) 2024-09-05T17:31:10.587 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:10.589 INFO:teuthology.orchestra.run.smithi050.stdout:1793 write 0x7454b80 thru 0x745b9ba (0x6e3b bytes) 2024-09-05T17:31:10.589 INFO:teuthology.orchestra.run.smithi050.stdout:1794 trunc from 0xea315dc to 0xe966597 2024-09-05T17:31:10.589 INFO:teuthology.orchestra.run.smithi050.stdout:1795 writesame 0xa15d949 thru 0xa1676ee data_size 0x11(0x9da6 bytes) 2024-09-05T17:31:10.589 INFO:teuthology.orchestra.run.smithi050.stdout:1796 punch from 0xdd9ccc to 0xde7f28, (0xe25c bytes) 2024-09-05T17:31:10.589 INFO:teuthology.orchestra.run.smithi050.stdout:1797 write 0xb8750c6 thru 0xb884a86 (0xf9c1 bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1798 punch from 0xe34e071 to 0xe357f4f, (0x9ede bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1800 write 0xbe2bbd2 thru 0xbe2e780 (0x2baf bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1801 punch from 0x35a5f85 to 0x35ac9a4, (0x6a1f bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1803 read 0x6969154 thru 0x6974731 (0xb5de bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1804 write 0x289425d thru 0x289e6c1 (0xa465 bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1805 write 0x9f53934 thru 0x9f5e9a8 (0xb075 bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1808 write 0xb50172c thru 0xb507c9a (0x656f bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1809 punch from 0xd795e10 to 0xd7a3080, (0xd270 bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1811 read 0x7c4d341 thru 0x7c5d0ee (0xfdae bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1812 punch from 0x9c352c8 to 0x9c36a0c, (0x1744 bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1813 punch from 0x20cde77 to 0x20dbcda, (0xde63 bytes) 2024-09-05T17:31:10.590 INFO:teuthology.orchestra.run.smithi050.stdout:1814 read 0xb7cd903 thru 0xb7d3c7f (0x637d bytes) 2024-09-05T17:31:10.591 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:10.587+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:10.593 INFO:teuthology.orchestra.run.smithi050.stdout:1815 trunc from 0xe966597 to 0x3b11b31 2024-09-05T17:31:10.621 INFO:teuthology.orchestra.run.smithi050.stdout:1817 punch from 0x2f2b5d7 to 0x2f365e0, (0xb009 bytes) 2024-09-05T17:31:10.621 INFO:teuthology.orchestra.run.smithi050.stdout:1818 punch from 0x1f48663 to 0x1f4a37d, (0x1d1a bytes) 2024-09-05T17:31:10.621 INFO:teuthology.orchestra.run.smithi050.stdout:1819 read 0x1e2c7ea thru 0x1e39cc0 (0xd4d7 bytes) 2024-09-05T17:31:10.622 INFO:teuthology.orchestra.run.smithi050.stdout:1820 punch from 0x2ab413c to 0x2ab65bd, (0x2481 bytes) 2024-09-05T17:31:10.644 INFO:teuthology.orchestra.run.smithi050.stdout:1821 writesame 0x8293b9b thru 0x829ab05 data_size 0x1(0x6f6b bytes) 2024-09-05T17:31:10.658 INFO:teuthology.orchestra.run.smithi050.stdout:1823 write 0xa5506d3 thru 0xa55acb5 (0xa5e3 bytes) 2024-09-05T17:31:10.674 INFO:teuthology.orchestra.run.smithi050.stdout:1824 write 0xb07c93a thru 0xb07d074 (0x73b bytes) 2024-09-05T17:31:10.682 INFO:teuthology.orchestra.run.smithi050.stdout:1825 trunc from 0xb07d075 to 0xc2eaaeb 2024-09-05T17:31:10.687 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:10.687+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:10.691 INFO:teuthology.orchestra.run.smithi050.stdout:1826 read 0xac1fa05 thru 0xac254d3 (0x5acf bytes) 2024-09-05T17:31:10.691 INFO:teuthology.orchestra.run.smithi050.stdout:1827 write 0x185f7c0 thru 0x1867f78 (0x87b9 bytes) 2024-09-05T17:31:10.695 INFO:teuthology.orchestra.run.smithi050.stdout:1828 read 0x2c249c8 thru 0x2c28327 (0x3960 bytes) 2024-09-05T17:31:10.695 INFO:teuthology.orchestra.run.smithi050.stdout:1829 read 0x45206dc thru 0x45242e7 (0x3c0c bytes) 2024-09-05T17:31:10.695 INFO:teuthology.orchestra.run.smithi050.stdout:1830 read 0xb6be74d thru 0xb6c954c (0xae00 bytes) 2024-09-05T17:31:10.710 INFO:teuthology.orchestra.run.smithi050.stdout:1831 write 0xe482756 thru 0xe48b3d4 (0x8c7f bytes) 2024-09-05T17:31:10.717 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.717 INFO:teuthology.orchestra.run.smithi050.stdout:1834 punch from 0xca4471a to 0xca4934e, (0x4c34 bytes) 2024-09-05T17:31:10.717 INFO:teuthology.orchestra.run.smithi050.stdout:1835 write 0xb0850bd thru 0xb089fa5 (0x4ee9 bytes) 2024-09-05T17:31:10.723 INFO:teuthology.orchestra.run.smithi050.stdout:1836 read 0xd194d9 thru 0xd24e2d (0xb955 bytes) 2024-09-05T17:31:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:10.724 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:10.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:10.724 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:34982 3.9 3.651b6e29 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-05T17:31:10.724 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:10.726189+0000", 2024-09-05T17:31:10.724 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.1273999999999996e-05, 2024-09-05T17:31:10.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100023, 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 34982 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:10.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:10.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:10.726189+0000", 2024-09-05T17:31:10.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:10.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:10.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:10.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:10.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:10.726189+0000", 2024-09-05T17:31:10.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:10.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:10.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:10.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:10.726191+0000", 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4269999999999998e-06 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:10.726201+0000", 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0152999999999999e-05 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:10.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:10.726231+0000", 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9552000000000001e-05 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:10.726253+0000", 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1959000000000001e-05 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-05T17:31:10.729 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-05T17:31:10.730 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:10.730 INFO:teuthology.orchestra.run.smithi050.stdout:1837 read 0xe00863d thru 0xe011f89 (0x994d bytes) 2024-09-05T17:31:10.730 INFO:teuthology.orchestra.run.smithi050.stdout:1838 write 0x63fe6b3 thru 0x6409d42 (0xb690 bytes) 2024-09-05T17:31:10.733 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:10.733 INFO:teuthology.orchestra.run.smithi050.stdout:1842 punch from 0x6445539 to 0x644fff0, (0xaab7 bytes) 2024-09-05T17:31:10.733 INFO:teuthology.orchestra.run.smithi050.stdout:1843 read 0xce80764 thru 0xce868ca (0x6167 bytes) 2024-09-05T17:31:10.733 INFO:teuthology.orchestra.run.smithi050.stdout:1844 writesame 0x43fc18c thru 0x440870a data_size 0x13(0xc57f bytes) 2024-09-05T17:31:10.739 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:10.747 INFO:teuthology.orchestra.run.smithi050.stdout:1845 trunc from 0xe48b3d5 to 0x8c2e26c 2024-09-05T17:31:10.760 INFO:teuthology.orchestra.run.smithi050.stdout:1846 read 0x2d30340 thru 0x2d3a6b5 (0xa376 bytes) 2024-09-05T17:31:10.769 INFO:teuthology.orchestra.run.smithi050.stdout:1847 write 0xa53cb6f thru 0xa53d57c (0xa0e bytes) 2024-09-05T17:31:10.771 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:10.772 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:10.783 INFO:teuthology.orchestra.run.smithi050.stdout:1848 write 0xd883711 thru 0xd88ea51 (0xb341 bytes) 2024-09-05T17:31:10.786 INFO:teuthology.orchestra.run.smithi050.stdout:1849 read 0x9179490 thru 0x9183667 (0xa1d8 bytes) 2024-09-05T17:31:10.786 INFO:teuthology.orchestra.run.smithi050.stdout:1850 write 0x205ce27 thru 0x206315b (0x6335 bytes) 2024-09-05T17:31:10.787 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:10.782+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:10.790 INFO:teuthology.orchestra.run.smithi050.stdout:1851 punch from 0x5408a66 to 0x541506c, (0xc606 bytes) 2024-09-05T17:31:10.791 INFO:teuthology.orchestra.run.smithi050.stdout:1852 writesame 0xd53d6ba thru 0xd542f91 data_size 0x4(0x58d8 bytes) 2024-09-05T17:31:10.791 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:10.791 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:10.795 INFO:teuthology.orchestra.run.smithi050.stdout:1853 read 0xd098bd3 thru 0xd0a4bd5 (0xc003 bytes) 2024-09-05T17:31:10.795 INFO:teuthology.orchestra.run.smithi050.stdout:1854 punch from 0xc778f43 to 0xc7820a9, (0x9166 bytes) 2024-09-05T17:31:10.795 INFO:teuthology.orchestra.run.smithi050.stdout:1855 punch from 0x6fad5fa to 0x6fb3c5b, (0x6661 bytes) 2024-09-05T17:31:10.795 INFO:teuthology.orchestra.run.smithi050.stdout:1856 write 0xa7c7559 thru 0xa7d5b6a (0xe612 bytes) 2024-09-05T17:31:10.798 INFO:teuthology.orchestra.run.smithi050.stdout:1857 read 0x6b71878 thru 0x6b74b69 (0x32f2 bytes) 2024-09-05T17:31:10.799 INFO:teuthology.orchestra.run.smithi050.stdout:1858 punch from 0xb7c4d40 to 0xb7c7112, (0x23d2 bytes) 2024-09-05T17:31:10.799 INFO:teuthology.orchestra.run.smithi050.stdout:1859 writesame 0x5c61bc5 thru 0x5c6a7fd data_size 0x1(0x8c39 bytes) 2024-09-05T17:31:10.809 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:10.809 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:10.826 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:10.827 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:10.840 INFO:teuthology.orchestra.run.smithi050.stdout:1860 trunc from 0xd88ea52 to 0x29cec06 2024-09-05T17:31:10.848 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:10.848 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:10.856 INFO:teuthology.orchestra.run.smithi050.stdout:1861 read 0x1b8b0af thru 0x1b954a3 (0xa3f5 bytes) 2024-09-05T17:31:10.868 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:10.868 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:10.868 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:10.869 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:10.869 INFO:teuthology.orchestra.run.smithi050.stdout:1862 write 0x55d6d90 thru 0x55dd56b (0x67dc bytes) 2024-09-05T17:31:10.884 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:10.888 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:10.887+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:10.889 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:10.889 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:10.895 INFO:teuthology.orchestra.run.smithi050.stdout:1864 write 0xe4dbc56 thru 0xe4e4020 (0x83cb bytes) 2024-09-05T17:31:10.900 INFO:teuthology.orchestra.run.smithi050.stdout:1866 clone 9 order 18 su 2048 sc 7 2024-09-05T17:31:10.911 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:10.911 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:10.990 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:10.991+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:11.054 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:11.054 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:11.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:11.091 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:11.095+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:11.192 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:11.190+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:11.193 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:11.193 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:11.207 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:11.293 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:11.290+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:11.370 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:11.370 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:11.385 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:11.428 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:11.430+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:11.495 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:11.495+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:11.550 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:11.550 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:11.566 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:11.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:31:11.614 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:11.615+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:11.670 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone8 from 0xe4e4021 (overlap 0xb39aa1) to 0x35e196 2024-09-05T17:31:11.697 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:11.695+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:11.701 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:11.702 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:11.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:11.759 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-05T17:31:11.798 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:11.794+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:11.851 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:11.851 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:11.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:11.908 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:11.910+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:11.999 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:11.999+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:12.032 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:12.032 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:12.036 INFO:teuthology.orchestra.run.smithi050.stdout:1867 punch from 0x775f08f to 0x7764726, (0x5697 bytes) 2024-09-05T17:31:12.043 INFO:teuthology.orchestra.run.smithi050.stdout:1870 write 0x297da91 thru 0x2984140 (0x66b0 bytes) 2024-09-05T17:31:12.048 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:12.100 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:12.099+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:12.106 INFO:teuthology.orchestra.run.smithi050.stdout:1871 write 0xda45b78 thru 0xda4cab1 (0x6f3a bytes) 2024-09-05T17:31:12.118 INFO:teuthology.orchestra.run.smithi050.stdout:1873 write 0x71e59b3 thru 0x71f1f6c (0xc5ba bytes) 2024-09-05T17:31:12.132 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:12.152 INFO:teuthology.orchestra.run.smithi050.stdout:1875 trunc from 0xe4e4021 to 0x4cd7be1 2024-09-05T17:31:12.182 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:12.182 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:12.197 INFO:teuthology.orchestra.run.smithi050.stdout:1876 trunc from 0x4cd7be1 to 0x58a528b 2024-09-05T17:31:12.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:12.205 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:12.198+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:12.238 INFO:teuthology.orchestra.run.smithi050.stdout:1877 write 0xe6abc26 thru 0xe6b7342 (0xb71d bytes) 2024-09-05T17:31:12.250 INFO:teuthology.orchestra.run.smithi050.stdout:1879 read 0x6344eea thru 0x634fbf3 (0xad0a bytes) 2024-09-05T17:31:12.250 INFO:teuthology.orchestra.run.smithi050.stdout:1881 write 0x61dedbd thru 0x61def05 (0x149 bytes) 2024-09-05T17:31:12.256 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:12.257 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:12.257 INFO:teuthology.orchestra.run.smithi050.stdout:1885 writesame 0xb317904 thru 0xb31c556 data_size 0x27(0x4c53 bytes) 2024-09-05T17:31:12.271 INFO:teuthology.orchestra.run.smithi050.stdout:1886 read 0x74d69ef thru 0x74d94f6 (0x2b08 bytes) 2024-09-05T17:31:12.271 INFO:teuthology.orchestra.run.smithi050.stdout:1888 write 0x653591f thru 0x6540abb (0xb19d bytes) 2024-09-05T17:31:12.286 INFO:teuthology.orchestra.run.smithi050.stdout:1890 writesame 0xa8d8f05 thru 0xa8d9bfa data_size 0xe(0xcf6 bytes) 2024-09-05T17:31:12.295 INFO:teuthology.orchestra.run.smithi050.stdout:1892 write 0x4a5be3e thru 0x4a6aecf (0xf092 bytes) 2024-09-05T17:31:12.302 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:12.303+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:12.310 INFO:teuthology.orchestra.run.smithi050.stdout:1894 write 0x2a6ba62 thru 0x2a72048 (0x65e7 bytes) 2024-09-05T17:31:12.325 INFO:teuthology.orchestra.run.smithi050.stdout:1896 read 0x75e100c thru 0x75e8190 (0x7185 bytes) 2024-09-05T17:31:12.325 INFO:teuthology.orchestra.run.smithi050.stdout:1897 read 0x5d5cb61 thru 0x5d6b6fa (0xeb9a bytes) 2024-09-05T17:31:12.326 INFO:teuthology.orchestra.run.smithi050.stdout:1898 read 0x167f6bc thru 0x16817ba (0x20ff bytes) 2024-09-05T17:31:12.326 INFO:teuthology.orchestra.run.smithi050.stdout:1899 write 0x782fc29 thru 0x783a889 (0xac61 bytes) 2024-09-05T17:31:12.339 INFO:teuthology.orchestra.run.smithi050.stdout:1902 write 0x1e8501f thru 0x1e90d47 (0xbd29 bytes) 2024-09-05T17:31:12.339 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:12.339 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:12.355 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:12.403 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:12.403+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:12.484 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:12.484 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:12.488 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:12.488 INFO:teuthology.orchestra.run.smithi050.stdout:1906 read 0xd22727d thru 0xd22ca8e (0x5812 bytes) 2024-09-05T17:31:12.488 INFO:teuthology.orchestra.run.smithi050.stdout:1907 read 0x4768371 thru 0x476a634 (0x22c4 bytes) 2024-09-05T17:31:12.488 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:12.488 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:12.489 INFO:teuthology.orchestra.run.smithi050.stdout:1910 read 0x8aacfad thru 0x8ab6542 (0x9596 bytes) 2024-09-05T17:31:12.499 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:12.521 INFO:teuthology.orchestra.run.smithi050.stdout:1911 trunc from 0xe6b7343 to 0x1b48824 2024-09-05T17:31:12.521 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:12.523+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:12.571 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:31:12.622 INFO:teuthology.orchestra.run.smithi050.stdout:1913 read 0x54481e thru 0x549164 (0x4947 bytes) 2024-09-05T17:31:12.622 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:12.623+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:12.646 INFO:teuthology.orchestra.run.smithi050.stdout:1914 writesame 0x6f7fb86 thru 0x6f81188 data_size 0x7(0x1603 bytes) 2024-09-05T17:31:12.646 INFO:teuthology.orchestra.run.smithi050.stdout:1915 writesame 0x52ca8fb thru 0x52d050e data_size 0x53(0x5c14 bytes) 2024-09-05T17:31:12.652 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:12.653 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:12.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:12.685 INFO:teuthology.orchestra.run.smithi050.stdout:1916 writesame 0x90d6848 thru 0x90e628d data_size 0x56(0xfa46 bytes) 2024-09-05T17:31:12.690 INFO:teuthology.orchestra.run.smithi050.stdout:1918 trunc from 0x90e628e to 0xb3615c3 2024-09-05T17:31:12.702 INFO:teuthology.orchestra.run.smithi050.stdout:1919 trunc from 0xb3615c3 to 0xa1a7729 2024-09-05T17:31:12.705 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:12.707+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:12.713 INFO:teuthology.orchestra.run.smithi050.stdout:1922 read 0x95ccef6 thru 0x95d4734 (0x783f bytes) 2024-09-05T17:31:12.713 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:12.713 INFO:teuthology.orchestra.run.smithi050.stdout:1925 read 0x62e1535 thru 0x62ee8d4 (0xd3a0 bytes) 2024-09-05T17:31:12.713 INFO:teuthology.orchestra.run.smithi050.stdout:1926 punch from 0x2292269 to 0x2295cf0, (0x3a87 bytes) 2024-09-05T17:31:12.728 INFO:teuthology.orchestra.run.smithi050.stdout:1928 trunc from 0xa1a7729 to 0x14a9196 2024-09-05T17:31:12.733 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:12.733 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:12.733 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-05T17:31:12.733 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-05T17:31:12.807 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:12.802+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:12.817 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:12.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:12.879 INFO:teuthology.orchestra.run.smithi050.stdout:1929 punch from 0xf7598 to 0x103368, (0xbdd0 bytes) 2024-09-05T17:31:12.891 INFO:teuthology.orchestra.run.smithi050.stdout:1932 trunc from 0x14a9196 to 0x9aad1e1 2024-09-05T17:31:12.903 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:12.903 INFO:teuthology.orchestra.run.smithi050.stdout:1934 writesame 0x81a116b thru 0x81addb0 data_size 0xb(0xcc46 bytes) 2024-09-05T17:31:12.907 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:12.902+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:12.921 INFO:teuthology.orchestra.run.smithi050.stdout:1935 read 0x564bdb1 thru 0x56523c7 (0x6617 bytes) 2024-09-05T17:31:12.925 INFO:teuthology.orchestra.run.smithi050.stdout:1936 trunc from 0x9aad1e1 to 0xbf46f78 2024-09-05T17:31:12.929 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:12.937 INFO:teuthology.orchestra.run.smithi050.stdout:1939 punch from 0x4d857d to 0x4dc1c3, (0x3c46 bytes) 2024-09-05T17:31:12.937 INFO:teuthology.orchestra.run.smithi050.stdout:1940 write 0xebe940 thru 0xec07f8 (0x1eb9 bytes) 2024-09-05T17:31:12.986 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:12.986 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:12.997 INFO:teuthology.orchestra.run.smithi050.stdout:1943 read 0xaea0712 thru 0xaea110c (0x9fb bytes) 2024-09-05T17:31:12.997 INFO:teuthology.orchestra.run.smithi050.stdout:1946 clone 10 order 21 su 524288 sc 12 2024-09-05T17:31:13.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:13.046 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:13.047+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:13.096 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:31:13.096 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:13.096 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 42, 2024-09-05T17:31:13.096 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "229efc05-fdc4-4e1f-8246-413b49f3eeda", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2024-09-05T17:30:12.762369+0000", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2024-09-05T17:31:12.563383+0000", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2024-09-05T17:30:23.981355+0000", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2024-09-05T17:30:15.006059+0000", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5804032, 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "nodeep-scrub", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2024-09-05T17:31:13.097 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 5, 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.94999998807907104, 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 3, 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "luminous", 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "squid", 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2024-09-05T17:31:13.098 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:25.818485+0000", 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:13.099 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:13.100 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "18", 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2024-09-05T17:31:13.101 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:13.102 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:13.103 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:13.104 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2024-09-05T17:31:13.105 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:30.943478+0000", 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:13.106 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.107 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "22", 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 2, 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 22, 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:13.108 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:13.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:13.110 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "pool_client.0", 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:42.082168+0000", 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:13.112 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:13.113 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "41", 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 11, 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 41, 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:13.114 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:13.115 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:13.116 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.5, 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.5, 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2024-09-05T17:31:13.117 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.5, 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.5, 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 1, 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 1, 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 1 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "38dd1565-a37f-4055-acb3-aa82457cf9e7", 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:13.118 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.119 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.120 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6825/1446480840", 2024-09-05T17:31:13.123 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6827/1446480840", 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/1446480840", 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6829/1446480840", 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f5ef5f03-d714-4329-b14b-1881ad1e7358", 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:13.124 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.125 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/3885625462", 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/3885625462", 2024-09-05T17:31:13.129 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/3885625462", 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/3885625462", 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "7b87b0cc-2484-4a66-be1b-232a7e36dc11", 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:13.130 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 19, 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.132 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:13.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/3027840955", 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/3027840955", 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/3027840955", 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/3027840955", 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:13.135 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f6d63b1e-2673-4542-a2e2-fbb0c4577864", 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:13.136 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.137 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.138 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/2889879466", 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6819/2889879466", 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6823/2889879466", 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6821/2889879466", 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:13.141 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "273ec4c6-0c2a-41d5-90c1-68b317365484", 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:13.142 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6808", 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6809", 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.143 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6810", 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6811", 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:13.144 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6814", 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6815", 2024-09-05T17:31:13.145 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6812", 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6813", 2024-09-05T17:31:13.146 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6809/1774319792", 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6811/1774319792", 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6815/1774319792", 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6813/1774319792", 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.147 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "5f6cf36b-2dd0-47de-97c4-42e98f849734", 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:13.148 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6816", 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6817", 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:13.149 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6818", 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6819", 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:13.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6822", 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6823", 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.151 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6820", 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6821", 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.152 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6817/1348894681", 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6819/1348894681", 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6823/1348894681", 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6821/1348894681", 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "2d6ed4a6-3d83-4c9d-9e96-2dbab049448a", 2024-09-05T17:31:13.153 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6824", 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6825", 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6826", 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6827", 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6830", 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6831", 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6828", 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6829", 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6825/792585226", 2024-09-05T17:31:13.158 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6827/792585226", 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6831/792585226", 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6829/792585226", 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "dbe1901b-5f78-419f-864a-89946452f4a6", 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:13.159 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 35, 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6800", 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6801", 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6802", 2024-09-05T17:31:13.161 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6803", 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.162 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6806", 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6807", 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:13.163 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6804", 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6805", 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6801/2161010500", 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6803/2161010500", 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2161010500", 2024-09-05T17:31:13.164 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2161010500", 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:13.165 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:22.246726+0000", 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.638940+0000", 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:13.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.694544+0000", 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:13.167 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.653253+0000", 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:13.168 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.467561+0000", 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.797765+0000", 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.649372+0000", 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:13.170 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.242988+0000", 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [], 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [ 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "pgid": "2.0", 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "mappings": [ 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.171 INFO:teuthology.orchestra.run.smithi050.stdout: "from": 1, 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "to": 4 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2024-09-05T17:31:13.172 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2024-09-05T17:31:13.173 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2024-09-05T17:31:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2024-09-05T17:31:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2024-09-05T17:31:13.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.174 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:13.175 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:13.175 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:13.176 INFO:tasks.thrashosds.thrasher:j is {'epoch': 42, 'fsid': '229efc05-fdc4-4e1f-8246-413b49f3eeda', 'created': '2024-09-05T17:30:12.762369+0000', 'modified': '2024-09-05T17:31:12.563383+0000', 'last_up_change': '2024-09-05T17:30:23.981355+0000', 'last_in_change': '2024-09-05T17:30:15.006059+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T17:30:25.818485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-05T17:30:30.943478+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-05T17:30:42.082168+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 11, 'snap_epoch': 41, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '38dd1565-a37f-4055-acb3-aa82457cf9e7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6824', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6825', 'nonce': 1446480840}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6826', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6827', 'nonce': 1446480840}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6830', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6831', 'nonce': 1446480840}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6828', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6829', 'nonce': 1446480840}]}, 'public_addr': '172.21.15.50:6825/1446480840', 'cluster_addr': '172.21.15.50:6827/1446480840', 'heartbeat_back_addr': '172.21.15.50:6831/1446480840', 'heartbeat_front_addr': '172.21.15.50:6829/1446480840', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f5ef5f03-d714-4329-b14b-1881ad1e7358', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6808', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6809', 'nonce': 3885625462}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6810', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6811', 'nonce': 3885625462}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6814', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6815', 'nonce': 3885625462}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6812', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6813', 'nonce': 3885625462}]}, 'public_addr': '172.21.15.50:6809/3885625462', 'cluster_addr': '172.21.15.50:6811/3885625462', 'heartbeat_back_addr': '172.21.15.50:6815/3885625462', 'heartbeat_front_addr': '172.21.15.50:6813/3885625462', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '7b87b0cc-2484-4a66-be1b-232a7e36dc11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6800', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6801', 'nonce': 3027840955}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6802', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6803', 'nonce': 3027840955}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6806', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6807', 'nonce': 3027840955}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6804', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6805', 'nonce': 3027840955}]}, 'public_addr': '172.21.15.50:6801/3027840955', 'cluster_addr': '172.21.15.50:6803/3027840955', 'heartbeat_back_addr': '172.21.15.50:6807/3027840955', 'heartbeat_front_addr': '172.21.15.50:6805/3027840955', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'f6d63b1e-2673-4542-a2e2-fbb0c4577864', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6816', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6817', 'nonce': 2889879466}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6818', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 2889879466}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6822', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6823', 'nonce': 2889879466}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6820', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6821', 'nonce': 2889879466}]}, 'public_addr': '172.21.15.50:6817/2889879466', 'cluster_addr': '172.21.15.50:6819/2889879466', 'heartbeat_back_addr': '172.21.15.50:6823/2889879466', 'heartbeat_front_addr': '172.21.15.50:6821/2889879466', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '273ec4c6-0c2a-41d5-90c1-68b317365484', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 1774319792}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 1774319792}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 1774319792}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 1774319792}]}, 'public_addr': '172.21.15.110:6809/1774319792', 'cluster_addr': '172.21.15.110:6811/1774319792', 'heartbeat_back_addr': '172.21.15.110:6815/1774319792', 'heartbeat_front_addr': '172.21.15.110:6813/1774319792', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5f6cf36b-2dd0-47de-97c4-42e98f849734', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 1348894681}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 1348894681}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 1348894681}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 1348894681}]}, 'public_addr': '172.21.15.110:6817/1348894681', 'cluster_addr': '172.21.15.110:6819/1348894681', 'heartbeat_back_addr': '172.21.15.110:6823/1348894681', 'heartbeat_front_addr': '172.21.15.110:6821/1348894681', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2d6ed4a6-3d83-4c9d-9e96-2dbab049448a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 792585226}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 792585226}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 792585226}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 792585226}]}, 'public_addr': '172.21.15.110:6825/792585226', 'cluster_addr': '172.21.15.110:6827/792585226', 'heartbeat_back_addr': '172.21.15.110:6831/792585226', 'heartbeat_front_addr': '172.21.15.110:6829/792585226', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dbe1901b-5f78-419f-864a-89946452f4a6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 35, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2161010500}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2161010500}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2161010500}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2161010500}]}, 'public_addr': '172.21.15.110:6801/2161010500', 'cluster_addr': '172.21.15.110:6803/2161010500', 'heartbeat_back_addr': '172.21.15.110:6807/2161010500', 'heartbeat_front_addr': '172.21.15.110:6805/2161010500', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:22.246726+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.638940+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.694544+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.653253+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.467561+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.797765+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.649372+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.242988+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 1, 'to': 4}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-05T17:31:13.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:31:13.177 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:13.177 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:13.178 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:13.178 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:13.178 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:13.179 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:13.179 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:13.179 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:13.179 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:13.179 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:13.180 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:13.180 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:13.174+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:13.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:13.192 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:13.192 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:13.213 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:13.214 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:13.235 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:13.236 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:13.276 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:13.278+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:13.316 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:13.316 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:13.316 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:13.316 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:13.316 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:13.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:13.378 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:13.379+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:13.449 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:13.449 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:13.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:13.449 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:13.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.449 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15042 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8564736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.687013153000001, 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054711072999999999, 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15042 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:13.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763434+0000", 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3910000000000001e-06 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763441+0000", 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1130000000000003e-06 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763449+0000", 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4059999999999999e-06 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.817943+0000", 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054494611999999998 2024-09-05T17:31:13.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818037+0000", 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3430999999999994e-05 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818143+0000", 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010574 2024-09-05T17:31:13.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15043 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8581120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686988398, 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054839756000000003, 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15043 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:13.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763457+0000", 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9700000000000002e-07 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763459+0000", 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2079999999999999e-06 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763466+0000", 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4869999999999996e-06 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763472+0000", 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4099999999999999e-06 2024-09-05T17:31:13.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818179+0000", 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054706751999999997 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818235+0000", 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6433e-05 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818296+0000", 2024-09-05T17:31:13.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1068999999999994e-05 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15044 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8597504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686965045999999, 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055068822000000003, 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.460 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15044 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763482+0000", 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3120000000000001e-06 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763489+0000", 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8020000000000003e-06 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763494+0000", 2024-09-05T17:31:13.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.276e-06 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818342+0000", 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054847104000000001 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818431+0000", 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9835999999999998e-05 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818548+0000", 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011708499999999999 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15045 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8613888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686942793, 2024-09-05T17:31:13.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055286647000000001, 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15045 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:31:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763505+0000", 2024-09-05T17:31:13.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:31:13.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763511+0000", 2024-09-05T17:31:13.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.533e-06 2024-09-05T17:31:13.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763517+0000", 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3979999999999998e-06 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818594+0000", 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055077706999999997 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818679+0000", 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4797999999999997e-05 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818789+0000", 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109369 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15046 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8630272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686905932, 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055492107999999998, 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15046 2024-09-05T17:31:13.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5699999999999998e-07 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763542+0000", 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6860000000000002e-06 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763550+0000", 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9859999999999994e-06 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763556+0000", 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0610000000000001e-06 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818833+0000", 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055276618 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818932+0000", 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9474000000000003e-05 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819031+0000", 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8826000000000006e-05 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.476 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15047 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8646656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686879655, 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055685474999999998, 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15047 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763566+0000", 2024-09-05T17:31:13.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763568+0000", 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7049999999999999e-06 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763576+0000", 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6340000000000001e-06 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763581+0000", 2024-09-05T17:31:13.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.519e-06 2024-09-05T17:31:13.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819078+0000", 2024-09-05T17:31:13.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055496668999999998 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819175+0000", 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6883000000000001e-05 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819250+0000", 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5462000000000004e-05 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15048 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8663040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686854737999999, 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055952927999999999, 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15048 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3599999999999999e-07 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763593+0000", 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6589999999999999e-06 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763600+0000", 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0879999999999997e-06 2024-09-05T17:31:13.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763607+0000", 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6649999999999997e-06 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819308+0000", 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055701181000000002 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819418+0000", 2024-09-05T17:31:13.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109755 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819543+0000", 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012514399999999999 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15049 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8679424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686829722000001, 2024-09-05T17:31:13.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056101897999999997, 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15049 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.63e-07 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763618+0000", 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5959999999999998e-06 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763625+0000", 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9879999999999998e-06 2024-09-05T17:31:13.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763631+0000", 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6069999999999998e-06 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819610+0000", 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055979244999999997 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819655+0000", 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5488999999999998e-05 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819717+0000", 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1509999999999999e-05 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15050 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8695808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686801410999999, 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056583593000000001, 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15050 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.492 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763644+0000", 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2600000000000002e-07 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763647+0000", 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763654+0000", 2024-09-05T17:31:13.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0119999999999999e-06 2024-09-05T17:31:13.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763659+0000", 2024-09-05T17:31:13.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639999999999997e-06 2024-09-05T17:31:13.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819747+0000", 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056088302 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820111+0000", 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036350299999999999 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820227+0000", 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011605 2024-09-05T17:31:13.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15051 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8712192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686777526, 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056866834999999998, 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.497 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15051 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763668+0000", 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7899999999999999e-07 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763670+0000", 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3580000000000001e-06 2024-09-05T17:31:13.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763677+0000", 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9809999999999997e-06 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763682+0000", 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3499999999999996e-06 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820263+0000", 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056581285000000002 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820427+0000", 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016371100000000001 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820534+0000", 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106771 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15052 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8728576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686754985, 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057071953000000002, 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.502 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15052 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9099999999999999e-07 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763692+0000", 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.092e-06 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763699+0000", 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5470000000000002e-06 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763704+0000", 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1039999999999998e-06 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820568+0000", 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056863805000000003 2024-09-05T17:31:13.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820665+0000", 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7090999999999996e-05 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820762+0000", 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6922999999999993e-05 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.506 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15053 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8744960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686732992, 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057269911999999999, 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15053 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:13.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763714+0000", 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3489999999999999e-06 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763721+0000", 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3119999999999999e-06 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763725+0000", 2024-09-05T17:31:13.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.741e-06 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820794+0000", 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057069021999999997 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820883+0000", 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8739999999999994e-05 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820982+0000", 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8368000000000004e-05 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15054 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8761344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686710133, 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057438612999999999, 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.511 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15054 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2e-07 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763737+0000", 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4140000000000001e-06 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763744+0000", 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8279999999999997e-06 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763755+0000", 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1126e-05 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821013+0000", 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057257844000000002 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821087+0000", 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3651000000000003e-05 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821173+0000", 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6329999999999995e-05 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15055 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8777728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686682533999999, 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.05769469, 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15055 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.516 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763763+0000", 2024-09-05T17:31:13.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0600000000000001e-07 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763765+0000", 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.12e-06 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763770+0000", 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8209999999999998e-06 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763777+0000", 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999999e-06 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821205+0000", 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057428078 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821292+0000", 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6842000000000006e-05 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821457+0000", 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016531299999999999 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15056 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8794112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686660684, 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057974700999999997, 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15056 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763786+0000", 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1229999999999998e-06 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763794+0000", 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1590000000000004e-06 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763799+0000", 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9309999999999999e-06 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821490+0000", 2024-09-05T17:31:13.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057691872999999998 2024-09-05T17:31:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821616+0000", 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125327 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821759+0000", 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014289500000000001 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.525 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15057 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8810496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686639080999999, 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058215998999999997, 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15057 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4300000000000003e-07 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763808+0000", 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0379999999999998e-06 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763816+0000", 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763821+0000", 2024-09-05T17:31:13.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0429999999999998e-06 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821799+0000", 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057977385999999999 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821909+0000", 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110801 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822022+0000", 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000112185 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15058 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8826880~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.686600803999999, 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058413768999999997, 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15058 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:13.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770678+0000", 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068342020000000002 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770685+0000", 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.063e-06 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770696+0000", 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1225e-05 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770704+0000", 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3880000000000002e-06 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822073+0000", 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.051369608999999997 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822153+0000", 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9225000000000001e-05 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822258+0000", 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010505699999999999 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15079 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9170944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.534 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.679463823000001, 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054753171000000003, 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15079 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:13.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7500000000000001e-07 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770982+0000", 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770986+0000", 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.225e-06 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770989+0000", 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825631+0000", 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054642257999999999 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825680+0000", 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9026000000000001e-05 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825734+0000", 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4218000000000002e-05 2024-09-05T17:31:13.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15080 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9187328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.679434973999999, 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054872632999999997, 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.539 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15080 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8599999999999999e-07 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771012+0000", 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.57e-06 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771016+0000", 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1919999999999998e-06 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771019+0000", 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0790000000000001e-06 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825770+0000", 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054750974000000001 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825820+0000", 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9873999999999997e-05 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825882+0000", 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2558000000000007e-05 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.543 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15081 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9203712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.679411783999999, 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054991252999999997, 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15081 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.544 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778817+0000", 2024-09-05T17:31:13.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077838489999999998 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778822+0000", 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9910000000000002e-06 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778831+0000", 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2089999999999994e-06 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:13.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778837+0000", 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8289999999999996e-06 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825928+0000", 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047091230999999997 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825972+0000", 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3964000000000001e-05 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:13.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:13.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.826024+0000", 2024-09-05T17:31:13.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2179999999999998e-05 2024-09-05T17:31:13.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.548 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:13.548 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:13.548 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:13.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:13.551 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:31:13.551 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:31:13.552 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-05T17:31:12.568013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":200567048,"num_objects":486,"num_object_clones":175,"num_object_copies":972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":486,"num_whiteouts":165,"num_read":45674,"num_read_kb":89609,"num_write":8329,"num_write_kb":40780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6509,"ondisk_log_size":6509,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314520,"kb_used_data":9408,"kb_used_omap":12,"kb_used_meta":304819,"kb_avail":754660200,"statfs":{"total":773094113280,"available":772772044800,"internally_reserved":0,"allocated":9633792,"data_stored":35960613,"data_compressed":1516846,"data_compressed_allocated":3244032,"data_compressed_original":32563200,"omap_allocated":12751,"internal_metadata":312135217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18753902,"num_objects":133,"num_object_clones":37,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":61,"num_read":8752,"num_read_kb":17837,"num_write":1391,"num_write_kb":7372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.787602"},"pg_stats":[{"pgid":"3.1f","version":"38'101","reported_seq":364,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.605520+0000","last_change":"2024-09-05T17:30:45.596387+0000","last_active":"2024-09-05T17:31:09.605520+0000","last_peered":"2024-09-05T17:31:09.605520+0000","last_clean":"2024-09-05T17:31:09.605520+0000","last_became_active":"2024-09-05T17:30:43.600165+0000","last_became_peered":"2024-09-05T17:30:43.600165+0000","last_unstale":"2024-09-05T17:31:09.605520+0000","last_undegraded":"2024-09-05T17:31:09.605520+0000","last_fullsized":"2024-09-05T17:31:09.605520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:39:40.618134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023314770000000002,"stat_sum":{"num_bytes":2779536,"num_objects":16,"num_object_clones":6,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":233,"num_read_kb":1886,"num_write":131,"num_write_kb":2579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'138","reported_seq":403,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.828378+0000","last_change":"2024-09-05T17:30:45.601580+0000","last_active":"2024-09-05T17:31:09.828378+0000","last_peered":"2024-09-05T17:31:09.828378+0000","last_clean":"2024-09-05T17:31:09.828378+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:31:09.828378+0000","last_undegraded":"2024-09-05T17:31:09.828378+0000","last_fullsized":"2024-09-05T17:31:09.828378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:34:02.730883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012442379999999999,"stat_sum":{"num_bytes":1339283,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":3,"num_read":557,"num_read_kb":963,"num_write":146,"num_write_kb":1703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"38'90","reported_seq":433,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.607015+0000","last_change":"2024-09-05T17:30:45.585378+0000","last_active":"2024-09-05T17:31:09.607015+0000","last_peered":"2024-09-05T17:31:09.607015+0000","last_clean":"2024-09-05T17:31:09.607015+0000","last_became_active":"2024-09-05T17:30:43.597087+0000","last_became_peered":"2024-09-05T17:30:43.597087+0000","last_unstale":"2024-09-05T17:31:09.607015+0000","last_undegraded":"2024-09-05T17:31:09.607015+0000","last_fullsized":"2024-09-05T17:31:09.607015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:43:11.712082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064572499999999999,"stat_sum":{"num_bytes":1260561,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":897,"num_write":85,"num_write_kb":755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"40'115","reported_seq":430,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.616613+0000","last_change":"2024-09-05T17:30:45.586287+0000","last_active":"2024-09-05T17:31:09.616613+0000","last_peered":"2024-09-05T17:31:09.616613+0000","last_clean":"2024-09-05T17:31:09.616613+0000","last_became_active":"2024-09-05T17:30:43.604511+0000","last_became_peered":"2024-09-05T17:30:43.604511+0000","last_unstale":"2024-09-05T17:31:09.616613+0000","last_undegraded":"2024-09-05T17:31:09.616613+0000","last_fullsized":"2024-09-05T17:31:09.616613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:36:01.341066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015056150000000001,"stat_sum":{"num_bytes":1414497,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":3,"num_read":295,"num_read_kb":693,"num_write":116,"num_write_kb":1087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"38'135","reported_seq":418,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.605538+0000","last_change":"2024-09-05T17:30:45.595496+0000","last_active":"2024-09-05T17:31:09.605538+0000","last_peered":"2024-09-05T17:31:09.605538+0000","last_clean":"2024-09-05T17:31:09.605538+0000","last_became_active":"2024-09-05T17:30:43.603009+0000","last_became_peered":"2024-09-05T17:30:43.603009+0000","last_unstale":"2024-09-05T17:31:09.605538+0000","last_undegraded":"2024-09-05T17:31:09.605538+0000","last_fullsized":"2024-09-05T17:31:09.605538+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:29:04.087884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001548448,"stat_sum":{"num_bytes":4444925,"num_objects":12,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":260,"num_read_kb":1218,"num_write":130,"num_write_kb":734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"40'211","reported_seq":1640,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.817183+0000","last_change":"2024-09-05T17:30:45.576728+0000","last_active":"2024-09-05T17:31:09.817183+0000","last_peered":"2024-09-05T17:31:09.817183+0000","last_clean":"2024-09-05T17:31:09.817183+0000","last_became_active":"2024-09-05T17:30:43.587931+0000","last_became_peered":"2024-09-05T17:30:43.587931+0000","last_unstale":"2024-09-05T17:31:09.817183+0000","last_undegraded":"2024-09-05T17:31:09.817183+0000","last_fullsized":"2024-09-05T17:31:09.817183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:46:49.267391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058024300000000003,"stat_sum":{"num_bytes":2131193,"num_objects":13,"num_object_clones":3,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":3,"num_read":2534,"num_read_kb":3413,"num_write":204,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"40'153","reported_seq":3884,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.780693+0000","last_change":"2024-09-05T17:30:45.579337+0000","last_active":"2024-09-05T17:31:09.780693+0000","last_peered":"2024-09-05T17:31:09.780693+0000","last_clean":"2024-09-05T17:31:09.780693+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:31:09.780693+0000","last_undegraded":"2024-09-05T17:31:09.780693+0000","last_fullsized":"2024-09-05T17:31:09.780693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:34:07.144770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096919599999999997,"stat_sum":{"num_bytes":9620349,"num_objects":7,"num_object_clones":2,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":3,"num_read":3784,"num_read_kb":5099,"num_write":168,"num_write_kb":1192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"40'102","reported_seq":645,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.612155+0000","last_change":"2024-09-05T17:30:45.601823+0000","last_active":"2024-09-05T17:31:09.612155+0000","last_peered":"2024-09-05T17:31:09.612155+0000","last_clean":"2024-09-05T17:31:09.612155+0000","last_became_active":"2024-09-05T17:30:43.591663+0000","last_became_peered":"2024-09-05T17:30:43.591663+0000","last_unstale":"2024-09-05T17:31:09.612155+0000","last_undegraded":"2024-09-05T17:31:09.612155+0000","last_fullsized":"2024-09-05T17:31:09.612155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:01:53.087235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371232,"stat_sum":{"num_bytes":4557406,"num_objects":15,"num_object_clones":7,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":5,"num_read":504,"num_read_kb":2962,"num_write":104,"num_write_kb":1528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"40'218","reported_seq":464,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.832858+0000","last_change":"2024-09-05T17:30:45.596866+0000","last_active":"2024-09-05T17:31:09.832858+0000","last_peered":"2024-09-05T17:31:09.832858+0000","last_clean":"2024-09-05T17:31:09.832858+0000","last_became_active":"2024-09-05T17:30:43.597194+0000","last_became_peered":"2024-09-05T17:30:43.597194+0000","last_unstale":"2024-09-05T17:31:09.832858+0000","last_undegraded":"2024-09-05T17:31:09.832858+0000","last_fullsized":"2024-09-05T17:31:09.832858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:51:41.488548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024520119999999999,"stat_sum":{"num_bytes":636942,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":3,"num_read":704,"num_read_kb":785,"num_write":286,"num_write_kb":1110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"40'402","reported_seq":679,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.610833+0000","last_change":"2024-09-05T17:30:45.586718+0000","last_active":"2024-09-05T17:31:09.610833+0000","last_peered":"2024-09-05T17:31:09.610833+0000","last_clean":"2024-09-05T17:31:09.610833+0000","last_became_active":"2024-09-05T17:30:43.604988+0000","last_became_peered":"2024-09-05T17:30:43.604988+0000","last_unstale":"2024-09-05T17:31:09.610833+0000","last_undegraded":"2024-09-05T17:31:09.610833+0000","last_fullsized":"2024-09-05T17:31:09.610833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:34:03.673143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017597120000000001,"stat_sum":{"num_bytes":2564366,"num_objects":19,"num_object_clones":7,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":6,"num_read":1664,"num_read_kb":2285,"num_write":617,"num_write_kb":919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"38'98","reported_seq":400,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.547699+0000","last_change":"2024-09-05T17:30:46.331830+0000","last_active":"2024-09-05T17:31:09.547699+0000","last_peered":"2024-09-05T17:31:09.547699+0000","last_clean":"2024-09-05T17:31:09.547699+0000","last_became_active":"2024-09-05T17:30:43.598646+0000","last_became_peered":"2024-09-05T17:30:43.598646+0000","last_unstale":"2024-09-05T17:31:09.547699+0000","last_undegraded":"2024-09-05T17:31:09.547699+0000","last_fullsized":"2024-09-05T17:31:09.547699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:39:25.342402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010679610000000001,"stat_sum":{"num_bytes":2267136,"num_objects":17,"num_object_clones":7,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":6,"num_read":265,"num_read_kb":1434,"num_write":91,"num_write_kb":1055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"38'119","reported_seq":227,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.590707+0000","last_change":"2024-09-05T17:30:45.577307+0000","last_active":"2024-09-05T17:31:09.590707+0000","last_peered":"2024-09-05T17:31:09.590707+0000","last_clean":"2024-09-05T17:31:09.590707+0000","last_became_active":"2024-09-05T17:30:43.599990+0000","last_became_peered":"2024-09-05T17:30:43.599990+0000","last_unstale":"2024-09-05T17:31:09.590707+0000","last_undegraded":"2024-09-05T17:31:09.590707+0000","last_fullsized":"2024-09-05T17:31:09.590707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:57:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010724350000000001,"stat_sum":{"num_bytes":2880010,"num_objects":16,"num_object_clones":7,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":7,"num_read":95,"num_read_kb":1481,"num_write":123,"num_write_kb":1358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.546808+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:31:09.546808+0000","last_peered":"2024-09-05T17:31:09.546808+0000","last_clean":"2024-09-05T17:31:09.546808+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:31:09.546808+0000","last_undegraded":"2024-09-05T17:31:09.546808+0000","last_fullsized":"2024-09-05T17:31:09.546808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"39'245","reported_seq":1187,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.605444+0000","last_change":"2024-09-05T17:30:45.596565+0000","last_active":"2024-09-05T17:31:09.605444+0000","last_peered":"2024-09-05T17:31:09.605444+0000","last_clean":"2024-09-05T17:31:09.605444+0000","last_became_active":"2024-09-05T17:30:43.596844+0000","last_became_peered":"2024-09-05T17:30:43.596844+0000","last_unstale":"2024-09-05T17:31:09.605444+0000","last_undegraded":"2024-09-05T17:31:09.605444+0000","last_fullsized":"2024-09-05T17:31:09.605444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":245,"log_dups_size":0,"ondisk_log_size":245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:45:51.961417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024656499999999998,"stat_sum":{"num_bytes":3618301,"num_objects":17,"num_object_clones":6,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":6,"num_read":2482,"num_read_kb":2326,"num_write":234,"num_write_kb":611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.612049+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:31:09.612049+0000","last_peered":"2024-09-05T17:31:09.612049+0000","last_clean":"2024-09-05T17:31:09.612049+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:31:09.612049+0000","last_undegraded":"2024-09-05T17:31:09.612049+0000","last_fullsized":"2024-09-05T17:31:09.612049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"40'127","reported_seq":189,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.612598+0000","last_change":"2024-09-05T17:30:45.600856+0000","last_active":"2024-09-05T17:31:09.612598+0000","last_peered":"2024-09-05T17:31:09.612598+0000","last_clean":"2024-09-05T17:31:09.612598+0000","last_became_active":"2024-09-05T17:30:43.590576+0000","last_became_peered":"2024-09-05T17:30:43.590576+0000","last_unstale":"2024-09-05T17:31:09.612598+0000","last_undegraded":"2024-09-05T17:31:09.612598+0000","last_fullsized":"2024-09-05T17:31:09.612598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:16:19.506848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062572599999999995,"stat_sum":{"num_bytes":840041,"num_objects":8,"num_object_clones":3,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":4,"num_read":22,"num_read_kb":26,"num_write":122,"num_write_kb":548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.548445+0000","last_change":"2024-09-05T17:30:34.286740+0000","last_active":"2024-09-05T17:31:09.548445+0000","last_peered":"2024-09-05T17:31:09.548445+0000","last_clean":"2024-09-05T17:31:09.548445+0000","last_became_active":"2024-09-05T17:30:32.046860+0000","last_became_peered":"2024-09-05T17:30:32.046860+0000","last_unstale":"2024-09-05T17:31:09.548445+0000","last_undegraded":"2024-09-05T17:31:09.548445+0000","last_fullsized":"2024-09-05T17:31:09.548445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:00:40.512628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"39'107","reported_seq":233,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.788950+0000","last_change":"2024-09-05T17:30:45.579183+0000","last_active":"2024-09-05T17:31:09.788950+0000","last_peered":"2024-09-05T17:31:09.788950+0000","last_clean":"2024-09-05T17:31:09.788950+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:31:09.788950+0000","last_undegraded":"2024-09-05T17:31:09.788950+0000","last_fullsized":"2024-09-05T17:31:09.788950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:44:46.100052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075116199999999999,"stat_sum":{"num_bytes":1778947,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":109,"num_read_kb":463,"num_write":107,"num_write_kb":568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.611967+0000","last_change":"2024-09-05T17:30:34.074244+0000","last_active":"2024-09-05T17:31:09.611967+0000","last_peered":"2024-09-05T17:31:09.611967+0000","last_clean":"2024-09-05T17:31:09.611967+0000","last_became_active":"2024-09-05T17:30:32.050582+0000","last_became_peered":"2024-09-05T17:30:32.050582+0000","last_unstale":"2024-09-05T17:31:09.611967+0000","last_undegraded":"2024-09-05T17:31:09.611967+0000","last_fullsized":"2024-09-05T17:31:09.611967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:33:10.698117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"40'141","reported_seq":481,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.746258+0000","last_change":"2024-09-05T17:30:45.585838+0000","last_active":"2024-09-05T17:31:09.746258+0000","last_peered":"2024-09-05T17:31:09.746258+0000","last_clean":"2024-09-05T17:31:09.746258+0000","last_became_active":"2024-09-05T17:30:43.586429+0000","last_became_peered":"2024-09-05T17:30:43.586429+0000","last_unstale":"2024-09-05T17:31:09.746258+0000","last_undegraded":"2024-09-05T17:31:09.746258+0000","last_fullsized":"2024-09-05T17:31:09.746258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:29:28.356427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010231579999999999,"stat_sum":{"num_bytes":3501519,"num_objects":16,"num_object_clones":6,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":6,"num_read":792,"num_read_kb":1835,"num_write":131,"num_write_kb":517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"40'199","reported_seq":1321,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.590951+0000","last_change":"2024-09-05T17:30:45.577008+0000","last_active":"2024-09-05T17:31:09.590951+0000","last_peered":"2024-09-05T17:31:09.590951+0000","last_clean":"2024-09-05T17:31:09.590951+0000","last_became_active":"2024-09-05T17:30:43.594808+0000","last_became_peered":"2024-09-05T17:30:43.594808+0000","last_unstale":"2024-09-05T17:31:09.590951+0000","last_undegraded":"2024-09-05T17:31:09.590951+0000","last_fullsized":"2024-09-05T17:31:09.590951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:06:37.021866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077238000000000003,"stat_sum":{"num_bytes":2565152,"num_objects":18,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":4,"num_read":1714,"num_read_kb":3728,"num_write":191,"num_write_kb":1730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.606865+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:31:09.606865+0000","last_peered":"2024-09-05T17:31:09.606865+0000","last_clean":"2024-09-05T17:31:09.606865+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:31:09.606865+0000","last_undegraded":"2024-09-05T17:31:09.606865+0000","last_fullsized":"2024-09-05T17:31:09.606865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"40'153","reported_seq":310,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.611756+0000","last_change":"2024-09-05T17:30:45.580126+0000","last_active":"2024-09-05T17:31:09.611756+0000","last_peered":"2024-09-05T17:31:09.611756+0000","last_clean":"2024-09-05T17:31:09.611756+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:31:09.611756+0000","last_undegraded":"2024-09-05T17:31:09.611756+0000","last_fullsized":"2024-09-05T17:31:09.611756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:25:38.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093389999999999999,"stat_sum":{"num_bytes":3700381,"num_objects":26,"num_object_clones":11,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":12,"num_read":141,"num_read_kb":732,"num_write":154,"num_write_kb":1502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.548749+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:31:09.548749+0000","last_peered":"2024-09-05T17:31:09.548749+0000","last_clean":"2024-09-05T17:31:09.548749+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:31:09.548749+0000","last_undegraded":"2024-09-05T17:31:09.548749+0000","last_fullsized":"2024-09-05T17:31:09.548749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"40'144","reported_seq":5893,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.798359+0000","last_change":"2024-09-05T17:30:45.595155+0000","last_active":"2024-09-05T17:31:09.798359+0000","last_peered":"2024-09-05T17:31:09.798359+0000","last_clean":"2024-09-05T17:31:09.798359+0000","last_became_active":"2024-09-05T17:30:43.603052+0000","last_became_peered":"2024-09-05T17:30:43.603052+0000","last_unstale":"2024-09-05T17:31:09.798359+0000","last_undegraded":"2024-09-05T17:31:09.798359+0000","last_fullsized":"2024-09-05T17:31:09.798359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:04:55.333810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001490367,"stat_sum":{"num_bytes":22557180,"num_objects":20,"num_object_clones":6,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":6116,"num_read_kb":12876,"num_write":151,"num_write_kb":1942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.547574+0000","last_change":"2024-09-05T17:31:03.554542+0000","last_active":"2024-09-05T17:31:09.547574+0000","last_peered":"2024-09-05T17:31:09.547574+0000","last_clean":"2024-09-05T17:31:09.547574+0000","last_became_active":"2024-09-05T17:31:03.554149+0000","last_became_peered":"2024-09-05T17:31:03.554149+0000","last_unstale":"2024-09-05T17:31:09.547574+0000","last_undegraded":"2024-09-05T17:31:09.547574+0000","last_fullsized":"2024-09-05T17:31:09.547574+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:00:28.398696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"40'1407","reported_seq":3734,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.781753+0000","last_change":"2024-09-05T17:30:45.600843+0000","last_active":"2024-09-05T17:31:09.781753+0000","last_peered":"2024-09-05T17:31:09.781753+0000","last_clean":"2024-09-05T17:31:09.781753+0000","last_became_active":"2024-09-05T17:30:43.587691+0000","last_became_peered":"2024-09-05T17:30:43.587691+0000","last_unstale":"2024-09-05T17:31:09.781753+0000","last_undegraded":"2024-09-05T17:31:09.781753+0000","last_fullsized":"2024-09-05T17:31:09.781753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:21:45.083321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069190400000000002,"stat_sum":{"num_bytes":20441233,"num_objects":18,"num_object_clones":6,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":9574,"num_read_kb":10925,"num_write":2548,"num_write_kb":2920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.606904+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:31:09.606904+0000","last_peered":"2024-09-05T17:31:09.606904+0000","last_clean":"2024-09-05T17:31:09.606904+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:31:09.606904+0000","last_undegraded":"2024-09-05T17:31:09.606904+0000","last_fullsized":"2024-09-05T17:31:09.606904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.547590+0000","last_change":"2024-09-05T17:30:27.328259+0000","last_active":"2024-09-05T17:31:09.547590+0000","last_peered":"2024-09-05T17:31:09.547590+0000","last_clean":"2024-09-05T17:31:09.547590+0000","last_became_active":"2024-09-05T17:30:27.326202+0000","last_became_peered":"2024-09-05T17:30:27.326202+0000","last_unstale":"2024-09-05T17:31:09.547590+0000","last_undegraded":"2024-09-05T17:31:09.547590+0000","last_fullsized":"2024-09-05T17:31:09.547590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:40.749016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"40'147","reported_seq":1346,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.612289+0000","last_change":"2024-09-05T17:30:45.601218+0000","last_active":"2024-09-05T17:31:09.612289+0000","last_peered":"2024-09-05T17:31:09.612289+0000","last_clean":"2024-09-05T17:31:09.612289+0000","last_became_active":"2024-09-05T17:30:43.584933+0000","last_became_peered":"2024-09-05T17:30:43.584933+0000","last_unstale":"2024-09-05T17:31:09.612289+0000","last_undegraded":"2024-09-05T17:31:09.612289+0000","last_fullsized":"2024-09-05T17:31:09.612289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:19:43.870455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097333599999999999,"stat_sum":{"num_bytes":5805015,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":8,"num_read":1248,"num_read_kb":4015,"num_write":153,"num_write_kb":1363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"38'320","reported_seq":1638,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.787442+0000","last_change":"2024-09-05T17:30:45.577452+0000","last_active":"2024-09-05T17:31:09.787442+0000","last_peered":"2024-09-05T17:31:09.787442+0000","last_clean":"2024-09-05T17:31:09.787442+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:31:09.787442+0000","last_undegraded":"2024-09-05T17:31:09.787442+0000","last_fullsized":"2024-09-05T17:31:09.787442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:47:39.389682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00119338,"stat_sum":{"num_bytes":7696506,"num_objects":18,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":6,"num_read":2539,"num_read_kb":6123,"num_write":503,"num_write_kb":1451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"40'168","reported_seq":433,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.546947+0000","last_change":"2024-09-05T17:30:45.806921+0000","last_active":"2024-09-05T17:31:09.546947+0000","last_peered":"2024-09-05T17:31:09.546947+0000","last_clean":"2024-09-05T17:31:09.546947+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:31:09.546947+0000","last_undegraded":"2024-09-05T17:31:09.546947+0000","last_fullsized":"2024-09-05T17:31:09.546947+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:18:04.484223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092165900000000002,"stat_sum":{"num_bytes":1939854,"num_objects":16,"num_object_clones":5,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":371,"num_read_kb":1175,"num_write":181,"num_write_kb":1537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"40'353","reported_seq":2534,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.785033+0000","last_change":"2024-09-05T17:30:45.601316+0000","last_active":"2024-09-05T17:31:09.785033+0000","last_peered":"2024-09-05T17:31:09.785033+0000","last_clean":"2024-09-05T17:31:09.785033+0000","last_became_active":"2024-09-05T17:30:43.595055+0000","last_became_peered":"2024-09-05T17:30:43.595055+0000","last_unstale":"2024-09-05T17:31:09.785033+0000","last_undegraded":"2024-09-05T17:31:09.785033+0000","last_fullsized":"2024-09-05T17:31:09.785033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:14:19.553772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053415,"stat_sum":{"num_bytes":22781985,"num_objects":17,"num_object_clones":5,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":4,"num_read":3520,"num_read_kb":6072,"num_write":546,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"40'140","reported_seq":263,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.607323+0000","last_change":"2024-09-05T17:30:45.586557+0000","last_active":"2024-09-05T17:31:09.607323+0000","last_peered":"2024-09-05T17:31:09.607323+0000","last_clean":"2024-09-05T17:31:09.607323+0000","last_became_active":"2024-09-05T17:30:43.586452+0000","last_became_peered":"2024-09-05T17:30:43.586452+0000","last_unstale":"2024-09-05T17:31:09.607323+0000","last_undegraded":"2024-09-05T17:31:09.607323+0000","last_fullsized":"2024-09-05T17:31:09.607323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:34:57.059389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012305,"stat_sum":{"num_bytes":3267243,"num_objects":16,"num_object_clones":7,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":8,"num_read":95,"num_read_kb":1293,"num_write":132,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"38'146","reported_seq":287,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.547954+0000","last_change":"2024-09-05T17:30:46.333102+0000","last_active":"2024-09-05T17:31:09.547954+0000","last_peered":"2024-09-05T17:31:09.547954+0000","last_clean":"2024-09-05T17:31:09.547954+0000","last_became_active":"2024-09-05T17:30:43.600919+0000","last_became_peered":"2024-09-05T17:30:43.600919+0000","last_unstale":"2024-09-05T17:31:09.547954+0000","last_undegraded":"2024-09-05T17:31:09.547954+0000","last_fullsized":"2024-09-05T17:31:09.547954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:26:35.432888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002229342,"stat_sum":{"num_bytes":4492377,"num_objects":14,"num_object_clones":6,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":5,"num_read":123,"num_read_kb":1682,"num_write":142,"num_write_kb":963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"38'67","reported_seq":341,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.548084+0000","last_change":"2024-09-05T17:30:46.333307+0000","last_active":"2024-09-05T17:31:09.548084+0000","last_peered":"2024-09-05T17:31:09.548084+0000","last_clean":"2024-09-05T17:31:09.548084+0000","last_became_active":"2024-09-05T17:30:43.600952+0000","last_became_peered":"2024-09-05T17:30:43.600952+0000","last_unstale":"2024-09-05T17:31:09.548084+0000","last_undegraded":"2024-09-05T17:31:09.548084+0000","last_fullsized":"2024-09-05T17:31:09.548084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:21:29.278042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019952949999999998,"stat_sum":{"num_bytes":1615301,"num_objects":13,"num_object_clones":4,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":4,"num_read":236,"num_read_kb":986,"num_write":61,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"40'135","reported_seq":1474,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.594216+0000","last_change":"2024-09-05T17:30:46.332586+0000","last_active":"2024-09-05T17:31:09.594216+0000","last_peered":"2024-09-05T17:31:09.594216+0000","last_clean":"2024-09-05T17:31:09.594216+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:31:09.594216+0000","last_undegraded":"2024-09-05T17:31:09.594216+0000","last_fullsized":"2024-09-05T17:31:09.594216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:22:26.244573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001698326,"stat_sum":{"num_bytes":9546487,"num_objects":19,"num_object_clones":7,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":6,"num_read":1313,"num_read_kb":1379,"num_write":130,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"38'173","reported_seq":2630,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.787243+0000","last_change":"2024-09-05T17:30:45.806898+0000","last_active":"2024-09-05T17:31:09.787243+0000","last_peered":"2024-09-05T17:31:09.787243+0000","last_clean":"2024-09-05T17:31:09.787243+0000","last_became_active":"2024-09-05T17:30:43.588731+0000","last_became_peered":"2024-09-05T17:30:43.588731+0000","last_unstale":"2024-09-05T17:31:09.787243+0000","last_undegraded":"2024-09-05T17:31:09.787243+0000","last_fullsized":"2024-09-05T17:31:09.787243+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:14:53.192024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000919516,"stat_sum":{"num_bytes":22451027,"num_objects":16,"num_object_clones":7,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":6,"num_read":2441,"num_read_kb":5718,"num_write":169,"num_write_kb":1519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"40'113","reported_seq":360,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.547729+0000","last_change":"2024-09-05T17:30:46.332397+0000","last_active":"2024-09-05T17:31:09.547729+0000","last_peered":"2024-09-05T17:31:09.547729+0000","last_clean":"2024-09-05T17:31:09.547729+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:31:09.547729+0000","last_undegraded":"2024-09-05T17:31:09.547729+0000","last_fullsized":"2024-09-05T17:31:09.547729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:51:09.508527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015389449999999999,"stat_sum":{"num_bytes":1536134,"num_objects":10,"num_object_clones":3,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":3,"num_read":223,"num_read_kb":877,"num_write":110,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"39'153","reported_seq":503,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.605359+0000","last_change":"2024-09-05T17:30:45.594968+0000","last_active":"2024-09-05T17:31:09.605359+0000","last_peered":"2024-09-05T17:31:09.605359+0000","last_clean":"2024-09-05T17:31:09.605359+0000","last_became_active":"2024-09-05T17:30:43.602339+0000","last_became_peered":"2024-09-05T17:30:43.602339+0000","last_unstale":"2024-09-05T17:31:09.605359+0000","last_undegraded":"2024-09-05T17:31:09.605359+0000","last_fullsized":"2024-09-05T17:31:09.605359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:01:38.501008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164483,"stat_sum":{"num_bytes":21538772,"num_objects":26,"num_object_clones":12,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":11,"num_read":327,"num_read_kb":2536,"num_write":150,"num_write_kb":2581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"40'114","reported_seq":467,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-05T17:31:09.547763+0000","last_change":"2024-09-05T17:30:46.331733+0000","last_active":"2024-09-05T17:31:09.547763+0000","last_peered":"2024-09-05T17:31:09.547763+0000","last_clean":"2024-09-05T17:31:09.547763+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:31:09.547763+0000","last_undegraded":"2024-09-05T17:31:09.547763+0000","last_fullsized":"2024-09-05T17:31:09.547763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:17.429148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099853899999999989,"stat_sum":{"num_bytes":2407002,"num_objects":8,"num_object_clones":2,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":2,"num_read":821,"num_read_kb":1671,"num_write":110,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":199976661,"num_objects":482,"num_object_clones":175,"num_object_copies":964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":482,"num_whiteouts":165,"num_read":45608,"num_read_kb":89554,"num_write":8226,"num_write_kb":39150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5554176,"data_stored":32726062,"data_compressed":1274558,"data_compressed_allocated":2899968,"data_compressed_original":30892032,"omap_allocated":0,"internal_metadata":0},"log_size":6434,"ondisk_log_size":6434,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11188,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36656,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335184,"statfs":{"total":96636764160,"available":96599228416,"internally_reserved":0,"allocated":1335296,"data_stored":5745589,"data_compressed":182975,"data_compressed_allocated":462848,"data_compressed_original":5238784,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":737280,"data_stored":1767626,"data_compressed":98421,"data_compressed_allocated":163840,"data_compressed_original":1499136,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62664,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94309176,"statfs":{"total":96636764160,"available":96572596224,"internally_reserved":0,"allocated":974848,"data_stored":1891396,"data_compressed":95082,"data_compressed_allocated":188416,"data_compressed_original":1458176,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41044,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330796,"statfs":{"total":96636764160,"available":96594735104,"internally_reserved":0,"allocated":1576960,"data_stored":9371177,"data_compressed":217465,"data_compressed_allocated":630784,"data_compressed_original":8859648,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542157,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28536,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343304,"statfs":{"total":96636764160,"available":96607543296,"internally_reserved":0,"allocated":1548288,"data_stored":4097154,"data_compressed":361635,"data_compressed_allocated":593920,"data_compressed_original":3596288,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36076,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335764,"statfs":{"total":96636764160,"available":96599822336,"internally_reserved":0,"allocated":667648,"data_stored":942806,"data_compressed":64700,"data_compressed_allocated":94208,"data_compressed_original":663552,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1007616,"data_stored":1666399,"data_compressed":167674,"data_compressed_allocated":253952,"data_compressed_original":1294336,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41304,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330536,"statfs":{"total":96636764160,"available":96594468864,"internally_reserved":0,"allocated":1785856,"data_stored":10478466,"data_compressed":328894,"data_compressed_allocated":856064,"data_compressed_original":9953280,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1335296,"data_stored":9774004,"data_compressed":360195,"data_compressed_allocated":860160,"data_compressed_original":9445376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":1276903,"data_compressed":116320,"data_compressed_allocated":184320,"data_compressed_original":1105920,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":828498,"data_compressed":100468,"data_compressed_allocated":131072,"data_compressed_original":720896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":856064,"data_stored":3538713,"data_compressed":214193,"data_compressed_allocated":425984,"data_compressed_original":3260416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1019904,"data_stored":9076098,"data_compressed":148325,"data_compressed_allocated":552960,"data_compressed_original":8761344,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":1706277,"data_compressed":95082,"data_compressed_allocated":188416,"data_compressed_original":1458176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":1516553,"data_compressed":62559,"data_compressed_allocated":126976,"data_compressed_original":1441792,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":843776,"data_stored":5009016,"data_compressed":177416,"data_compressed_allocated":430080,"data_compressed_original":4698112,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:31:13.554 INFO:tasks.thrashosds.thrasher:Setting 3.7 to [6, 7] 2024-09-05T17:31:13.554 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.7', '6', '7'] 2024-09-05T17:31:13.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.7 6 7 2024-09-05T17:31:13.555 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:13.547+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:13.650 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:13.650+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:13.727 INFO:teuthology.orchestra.run.smithi050.stdout:flattening image image_client.0-clone9 2024-09-05T17:31:13.742 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:13.742 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:13.742 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:13.742 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:13.752 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:13.751+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:13.765 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:13.853 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:13.854+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:13.954 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:13.955+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:13.977 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:13.977 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:13.977 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:13.977 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:13.977 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:14.000 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:14.055 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:14.054+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:14.155 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:14.155+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:14.220 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:14.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4257.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.173040776000001, 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002468479, 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049864+0000", 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0800000000000004e-07 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049878+0000", 2024-09-05T17:31:14.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4165000000000001e-05 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049896+0000", 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8436000000000001e-05 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049914+0000", 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7229999999999999e-05 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050094+0000", 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180564 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050134+0000", 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9595000000000003e-05 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052268+0000", 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021347580000000001 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052332+0000", 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3022999999999996e-05 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.225 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3446 3.9 e28/24 3:91eb5b84:::rbd_data.114070605229.00000000000000ab:head v 28'5, mlcod=28'3)", 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.979417692999998, 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019348169999999999, 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243489+0000", 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8059999999999999e-06 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243530+0000", 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1083e-05 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243568+0000", 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7987000000000001e-05 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243583+0000", 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5492999999999999e-05 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243709+0000", 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012500799999999999 2024-09-05T17:31:14.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243759+0000", 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0838999999999999e-05 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.245343+0000", 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001584006 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.245421+0000", 2024-09-05T17:31:14.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7595000000000005e-05 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.976590346000002, 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:31:14.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:31:14.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3604 3.4 e28/24 3:27555207:::rbd_data.114070605229.00000000000000e7:head v 28'21, mlcod=28'19)", 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.774600627000002, 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028585849999999999, 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448306+0000", 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448357+0000", 2024-09-05T17:31:14.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0719e-05 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448402+0000", 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5166000000000001e-05 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448426+0000", 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3813999999999999e-05 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448574+0000", 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014806500000000001 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448613+0000", 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8353999999999999e-05 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451052+0000", 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024396909999999999 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451162+0000", 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109533 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:7801 3.0 e30/24 3:00d91651:::rbd_data.1140d4ae3aec.0000000000000025:head v 30'105, mlcod=30'102)", 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.885915647000001, 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022194089999999999, 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.239 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336989+0000", 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.316e-06 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337179+0000", 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018963199999999999 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337195+0000", 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5880999999999999e-05 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337202+0000", 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3189999999999997e-06 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337272+0000", 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9333999999999997e-05 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337289+0000", 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7445999999999999e-05 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339156+0000", 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001866988 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339208+0000", 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1493000000000003e-05 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.243 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:12781 3.4 e33/24 3:2593df46:::rbd_data.11403aa71fdc.00000000000002f3:head v 33'79, mlcod=30'76)", 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.198634225999999, 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019698900000000002, 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024272+0000", 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3889999999999999e-06 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024292+0000", 2024-09-05T17:31:14.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0434000000000001e-05 2024-09-05T17:31:14.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024324+0000", 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1615000000000001e-05 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024338+0000", 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024491+0000", 2024-09-05T17:31:14.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015269900000000001 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024555+0000", 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3398000000000005e-05 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026149+0000", 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00159431 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026239+0000", 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0637000000000007e-05 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27061 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'128, mlcod=36'126)", 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.334648144999999, 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019078750000000001, 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.251 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888257+0000", 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.173e-06 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888263+0000", 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1149999999999999e-06 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888283+0000", 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9684e-05 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888289+0000", 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4649999999999999e-06 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888406+0000", 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011736299999999999 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888473+0000", 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6657999999999998e-05 2024-09-05T17:31:14.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.890104+0000", 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016305410000000001 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.890164+0000", 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9876000000000001e-05 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27251 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'174, mlcod=36'172)", 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.003960598999999, 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025164060000000001, 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218944+0000", 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.057e-06 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218953+0000", 2024-09-05T17:31:14.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5369999999999997e-06 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218974+0000", 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0772e-05 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218986+0000", 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219118+0000", 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132638 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219177+0000", 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8270000000000003e-05 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221306+0000", 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002128956 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221460+0000", 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000153991 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27272 3.9 e36/24 3:961ac59e:::rbd_data.1140f3505917.000000000000023a:head v 36'186, mlcod=36'184)", 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9537086650000006, 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026438630000000002, 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.260 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269196+0000", 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2610000000000001e-06 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270692+0000", 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495365 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270721+0000", 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9036000000000001e-05 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270736+0000", 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4979e-05 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270814+0000", 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8010999999999996e-05 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270836+0000", 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2651999999999999e-05 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271799+0000", 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096227200000000002 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271839+0000", 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0287000000000002e-05 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27439 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'228, mlcod=36'226)", 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.6457879549999994, 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031113629999999998, 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577119+0000", 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7549999999999999e-06 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577132+0000", 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3699e-05 2024-09-05T17:31:14.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577165+0000", 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2645999999999999e-05 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577181+0000", 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5764999999999999e-05 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577311+0000", 2024-09-05T17:31:14.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013032399999999999 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577375+0000", 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3532000000000001e-05 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580116+0000", 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027411520000000002 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580227+0000", 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011149 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27440 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'229, mlcod=36'226)", 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.644097597, 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022421120000000001, 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.269 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578808+0000", 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0499999999999999e-06 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578823+0000", 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4290999999999999e-05 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578855+0000", 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2682999999999999e-05 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578875+0000", 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9881000000000002e-05 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579029+0000", 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015355499999999999 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579173+0000", 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014394599999999999 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580954+0000", 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001781134 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.581048+0000", 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4572000000000002e-05 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.273 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27516 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'242, mlcod=36'240)", 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.4419905899999996, 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001967735, 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780916+0000", 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2790000000000001e-06 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780930+0000", 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4914e-05 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780958+0000", 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7217e-05 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780972+0000", 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4456e-05 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781128+0000", 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015544699999999999 2024-09-05T17:31:14.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781166+0000", 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8868999999999997e-05 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782803+0000", 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016366519999999999 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782881+0000", 2024-09-05T17:31:14.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7900999999999998e-05 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27750 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'288, mlcod=36'286)", 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.0386527730000008, 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021578209999999999, 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184254+0000", 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184272+0000", 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8284e-05 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184311+0000", 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184329+0000", 2024-09-05T17:31:14.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8077999999999999e-05 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184507+0000", 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000177035 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184573+0000", 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6729000000000004e-05 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186301+0000", 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017280279999999999 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186409+0000", 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107601 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27759 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'289, mlcod=36'287)", 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:14.282 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.0248443169999994, 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026394679999999998, 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198063+0000", 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0570000000000001e-06 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198077+0000", 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4270999999999999e-05 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198112+0000", 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4953000000000002e-05 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198127+0000", 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5597999999999999e-05 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198290+0000", 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162631 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198352+0000", 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1796000000000003e-05 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200559+0000", 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022068579999999999 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200699+0000", 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000140304 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.286 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:30784 3.9 e37/24 3:9275f381:::rbd_data.1140f3505917.00000000000001d4:head v 37'308, mlcod=37'305)", 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.3376272910000004, 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023488469999999998, 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1399999999999995e-07 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885285+0000", 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7810000000000005e-06 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885300+0000", 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4833e-05 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885308+0000", 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5769999999999996e-06 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885748+0000", 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044075899999999999 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885769+0000", 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0922999999999999e-05 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.887576+0000", 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018066359999999999 2024-09-05T17:31:14.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.887625+0000", 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9424e-05 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34616 3.0 e40/24 3:026e24ed:::rbd_data.11404462ede9.0000000000000037:head v 40'154, mlcod=39'152)", 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.2507191439999996, 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019695590000000001, 2024-09-05T17:31:14.291 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972187+0000", 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4849999999999999e-06 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972224+0000", 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6563999999999998e-05 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972254+0000", 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0772000000000003e-05 2024-09-05T17:31:14.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972267+0000", 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2728000000000001e-05 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972388+0000", 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120797 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972430+0000", 2024-09-05T17:31:14.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2023000000000001e-05 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.974032+0000", 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016015840000000001 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.974154+0000", 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012260600000000001 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34666 3.0 e40/24 3:002dc5db:::rbd_data.11404462ede9.0000000000000009:head v 40'156, mlcod=40'154)", 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.1244437359999999, 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022195069999999999, 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098462+0000", 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0490000000000002e-06 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098473+0000", 2024-09-05T17:31:14.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1297999999999999e-05 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098503+0000", 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9904999999999999e-05 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098516+0000", 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2435e-05 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.099032+0000", 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051637500000000002 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.099068+0000", 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5559999999999998e-05 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.100613+0000", 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015457159999999999 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.100680+0000", 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6168999999999996e-05 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34899 3.4 e40/24 3:21eb45c5:::rbd_data.11404462ede9.0000000000000026:head v 40'111, mlcod=40'109)", 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.619486502, 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003148802, 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.300 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603420+0000", 2024-09-05T17:31:14.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603437+0000", 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6891000000000001e-05 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603479+0000", 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2222999999999999e-05 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603501+0000", 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1297999999999998e-05 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603838+0000", 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033740899999999999 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603900+0000", 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2150000000000006e-05 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.606418+0000", 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025176560000000001 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.606566+0000", 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148355 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34903 3.4 e40/24 3:23501bd1:::rbd_data.11404462ede9.0000000000000030:head v 40'112, mlcod=40'109)", 2024-09-05T17:31:14.304 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.61802527, 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023817030000000002, 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604880+0000", 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.141e-06 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604893+0000", 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.33e-05 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604914+0000", 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1438e-05 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604925+0000", 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0730000000000001e-05 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.605156+0000", 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023070499999999999 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.605186+0000", 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0306000000000001e-05 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.607152+0000", 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019654210000000002 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.607260+0000", 2024-09-05T17:31:14.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108662 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34979 3.0 e40/24 3:058d46e1:::rbd_data.11404462ede9.0000000000000072:head v 40'158, mlcod=40'156)", 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.5035484540000001, 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002034831, 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:14.309 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719358+0000", 2024-09-05T17:31:14.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0429999999999999e-06 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719401+0000", 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2642999999999998e-05 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719441+0000", 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0031999999999999e-05 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719513+0000", 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1829000000000006e-05 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719722+0000", 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020864899999999999 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719779+0000", 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7377999999999999e-05 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.721306+0000", 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015273419999999999 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.721390+0000", 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3914999999999999e-05 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.313 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:14.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:14.315 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:14.314+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:14.361 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-05T17:31:14.370 INFO:teuthology.orchestra.run.smithi050.stdout:1947 read 0x3414084 thru 0x34171f5 (0x3172 bytes) 2024-09-05T17:31:14.371 INFO:teuthology.orchestra.run.smithi050.stdout:1948 write 0x1503271 thru 0x1504ac4 (0x1854 bytes) 2024-09-05T17:31:14.384 INFO:teuthology.orchestra.run.smithi050.stdout:1950 read 0x4b1de23 thru 0x4b2754d (0x972b bytes) 2024-09-05T17:31:14.384 INFO:teuthology.orchestra.run.smithi050.stdout:1952 read 0x5603ba3 thru 0x560a664 (0x6ac2 bytes) 2024-09-05T17:31:14.384 INFO:teuthology.orchestra.run.smithi050.stdout:1953 punch from 0x2cb9116 to 0x2cc5583, (0xc46d bytes) 2024-09-05T17:31:14.384 INFO:teuthology.orchestra.run.smithi050.stdout:1955 read 0x375fe7d thru 0x376bcf3 (0xbe77 bytes) 2024-09-05T17:31:14.384 INFO:teuthology.orchestra.run.smithi050.stdout:1956 write 0x970b3cf thru 0x970b663 (0x295 bytes) 2024-09-05T17:31:14.389 INFO:teuthology.orchestra.run.smithi050.stdout:1957 read 0x40b610f thru 0x40be55c (0x844e bytes) 2024-09-05T17:31:14.389 INFO:teuthology.orchestra.run.smithi050.stdout:1961 writesame 0x5c35997 thru 0x5c38ce6 data_size 0x8(0x3350 bytes) 2024-09-05T17:31:14.396 INFO:teuthology.orchestra.run.smithi050.stdout:1962 trunc from 0xbf46f78 to 0xa3d642b 2024-09-05T17:31:14.416 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:14.418+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:14.433 INFO:teuthology.orchestra.run.smithi050.stdout:1963 read 0x941bbe3 thru 0x941ee85 (0x32a3 bytes) 2024-09-05T17:31:14.433 INFO:teuthology.orchestra.run.smithi050.stdout:1964 read 0x641a2a1 thru 0x641b519 (0x1279 bytes) 2024-09-05T17:31:14.433 INFO:teuthology.orchestra.run.smithi050.stdout:1965 read 0x88c0a3a thru 0x88c5710 (0x4cd7 bytes) 2024-09-05T17:31:14.434 INFO:teuthology.orchestra.run.smithi050.stdout:1966 read 0x1f46be5 thru 0x1f50f5f (0xa37b bytes) 2024-09-05T17:31:14.434 INFO:teuthology.orchestra.run.smithi050.stdout:1967 writesame 0x35332e0 thru 0x353c595 data_size 0x2(0x92b6 bytes) 2024-09-05T17:31:14.444 INFO:teuthology.orchestra.run.smithi050.stdout:1969 read 0x5a4b1dc thru 0x5a57264 (0xc089 bytes) 2024-09-05T17:31:14.444 INFO:teuthology.orchestra.run.smithi050.stdout:1970 read 0x84786aa thru 0x847b426 (0x2d7d bytes) 2024-09-05T17:31:14.453 INFO:teuthology.orchestra.run.smithi050.stdout:1974 writesame 0xab5f1bb thru 0xab6e488 data_size 0x1(0xf2ce bytes) 2024-09-05T17:31:14.453 INFO:teuthology.orchestra.run.smithi050.stdout:1976 punch from 0x1bdf4e9 to 0x1bdfd4d, (0x864 bytes) 2024-09-05T17:31:14.453 INFO:teuthology.orchestra.run.smithi050.stdout:1977 write 0x54925fd thru 0x54937a3 (0x11a7 bytes) 2024-09-05T17:31:14.472 INFO:teuthology.orchestra.run.smithi050.stdout:1982 writesame 0xe5e1f8c thru 0xe5ed375 data_size 0x1(0xb3ea bytes) 2024-09-05T17:31:14.473 INFO:teuthology.orchestra.run.smithi050.stdout:1983 write 0x88821e2 thru 0x888cb25 (0xa944 bytes) 2024-09-05T17:31:14.480 INFO:teuthology.orchestra.run.smithi050.stdout:1984 punch from 0xa835742 to 0xa83faeb, (0xa3a9 bytes) 2024-09-05T17:31:14.481 INFO:teuthology.orchestra.run.smithi050.stdout:1987 writesame 0xe4281b2 thru 0xe430800 data_size 0x49(0x864f bytes) 2024-09-05T17:31:14.487 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:14.487 INFO:teuthology.orchestra.run.smithi050.stdout:1990 writesame 0x637df8a thru 0x6389c00 data_size 0x1(0xbc77 bytes) 2024-09-05T17:31:14.488 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:14.488 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:14.488 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:14.488 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:14.503 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:14.545 INFO:teuthology.orchestra.run.smithi050.stdout:1991 read 0x8e7da82 thru 0x8e84162 (0x66e1 bytes) 2024-09-05T17:31:14.545 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:14.543+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:14.545 INFO:teuthology.orchestra.run.smithi050.stdout:1992 write 0xb301101 thru 0xb30c13e (0xb03e bytes) 2024-09-05T17:31:14.553 INFO:teuthology.orchestra.run.smithi050.stdout:1993 read 0x2388417 thru 0x23889c5 (0x5af bytes) 2024-09-05T17:31:14.553 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:14.553 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:14.553 INFO:teuthology.orchestra.run.smithi050.stdout:1999 write 0x9efbdb5 thru 0x9efe4dc (0x2728 bytes) 2024-09-05T17:31:14.556 INFO:teuthology.orchestra.run.smithi050.stdout:2000 writesame 0x17cafe9 thru 0x17d7a1e data_size 0x8f(0xca36 bytes) 2024-09-05T17:31:14.571 INFO:teuthology.orchestra.run.smithi050.stdout:2001 trunc from 0xe5ed376 to 0x8909d50 2024-09-05T17:31:14.589 INFO:teuthology.orchestra.run.smithi050.stderr:set 3.7 pg_upmap mapping to [6,7] 2024-09-05T17:31:14.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:31:14.617 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:14.618+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:14.675 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:14.675 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:14.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:14.718 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:14.718+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:14.804 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.596703140000001, 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:31:14.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.595681813000001, 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:31:14.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.594593315000001, 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.814 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:31:14.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.593572804000001, 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:31:14.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.592545855000001, 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:31:14.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.590203257000001, 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:31:14.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:31:14.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:31:14.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.585251083999999, 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.832 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:14.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13418 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6023168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.836 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.584655184000001, 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14037719400000001, 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13418 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:14.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221572+0000", 2024-09-05T17:31:14.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034026199999999998 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221584+0000", 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1321999999999999e-05 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221603+0000", 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9344e-05 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221615+0000", 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1565e-05 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361125+0000", 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139510734 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361358+0000", 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023231599999999999 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361609+0000", 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025165099999999998 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.584251101, 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.845 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.583645702, 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:31:14.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.582586574, 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:31:14.850 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.854 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.581945291, 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.855 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:31:14.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:31:14.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.581350397, 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:31:14.859 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:31:14.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:31:14.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.580285203000001, 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.864 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:31:14.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:31:14.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.579644513, 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.868 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:14.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:31:14.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.872 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.579193813, 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.873 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:31:14.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:14.877 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.57854807, 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:14.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:31:14.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.578176052, 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:31:14.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.886 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.577534998000001, 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:31:14.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:31:14.890 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 15.576936469, 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:14.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:31:14.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:31:14.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:14.895 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:14.897 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:14.897 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:14.895+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:14.998 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:14.999+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:15.029 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:15.029 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:15.029 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:15.030 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:15.043 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:15.099 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:15.098+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:15.162 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:15.163 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:15.163 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:15.163 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:15.163 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:15.178 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:15.220 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:15.222+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:15.256 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:15.302 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:15.303+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6402247059999997, 2024-09-05T17:31:15.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:31:15.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6401773219999995, 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.64013265, 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.353 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:31:15.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.357 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.640087308, 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:31:15.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:31:15.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6400182979999993, 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:31:15.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6399698610000009, 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:15.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:31:15.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6399235030000003, 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:31:15.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:31:15.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:31:15.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:15.375 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6392609129999993, 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:31:15.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6391695669999997, 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.380 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:31:15.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:31:15.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6391080870000003, 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.385 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:15.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:31:15.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:31:15.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:31:15.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:15.390 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6390511869999997, 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:31:15.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:31:15.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6389579459999997, 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:15.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.399 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6388984180000001, 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:31:15.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:31:15.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6317424559999996, 2024-09-05T17:31:15.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.409 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6316809889999995, 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:31:15.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:31:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:31:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:31:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:31:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6298130200000003, 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:31:15.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6297725100000005, 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.420 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:31:15.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:15.424 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.6297340439999992, 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:15.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:31:15.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.629675937, 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.430 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:31:15.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.629618636, 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:15.434 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:31:15.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:31:15.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:31:15.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:15.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:15.439 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:15.440 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:15.440 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:15.441 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:15.441 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:15.442 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:15.442 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:15.442+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:15.449 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:15.449 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:15.465 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:15.466 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:15.485 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:15.485 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:15.505 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:15.505 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:15.526 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:15.713 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:15.713 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:15.714 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:15.715 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:31:15.716 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:15.716 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:15.716 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:15.758 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:15.759+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:15.817 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:15.818+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:15.842 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:15.843 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:15.857 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:15.918 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:15.919+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:16.019 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:16.023+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:16.025 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:16.026 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:16.035 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:16.120 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:16.119+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:16.157 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:16.157 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:16.171 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:16.221 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:16.223+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:16.289 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:16.289 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:16.304 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:16.322 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:16.323+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:16.423 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:16.423+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:16.429 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:16.429 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:16.443 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:16.524 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:16.523+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:16.560 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:16.560 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:16.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:16.625 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:16.623+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:16.698 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:16.699 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:16.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:16.725 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:16.723+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:16.826 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:16.827+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:16.834 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:16.834 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:16.849 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:16.873 INFO:teuthology.orchestra.run.smithi050.stdout:2002 write 0xce59c2 thru 0xce61d7 (0x816 bytes) 2024-09-05T17:31:16.893 INFO:teuthology.orchestra.run.smithi050.stdout:2003 trunc from 0x8909d50 to 0x43e1a5f 2024-09-05T17:31:16.927 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:16.926+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:16.942 INFO:teuthology.orchestra.run.smithi050.stdout:2004 writesame 0x6981679 thru 0x6983492 data_size 0x1(0x1e1a bytes) 2024-09-05T17:31:16.942 INFO:teuthology.orchestra.run.smithi050.stdout:2005 punch from 0x4bb3af to 0x4c9208, (0xde59 bytes) 2024-09-05T17:31:16.942 INFO:teuthology.orchestra.run.smithi050.stdout:2006 write 0x4effd69 thru 0x4f07006 (0x729e bytes) 2024-09-05T17:31:16.949 INFO:teuthology.orchestra.run.smithi050.stdout:2008 writesame 0x3e0bf05 thru 0x3e17672 data_size 0x35(0xb76e bytes) 2024-09-05T17:31:16.952 INFO:teuthology.orchestra.run.smithi050.stdout:2009 write 0x4bd3d8 thru 0x4c597e (0x85a7 bytes) 2024-09-05T17:31:16.986 INFO:teuthology.orchestra.run.smithi050.stdout:2010 write 0xa098adc thru 0xa09fa24 (0x6f49 bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2011 read 0x6abf1c4 thru 0x6ac7d55 (0x8b92 bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2012 read 0x6e3a8ff thru 0x6e4863b (0xdd3d bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2014 read 0x7545cc0 thru 0x754b3ae (0x56ef bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2015 read 0x7d746a1 thru 0x7d75bef (0x154f bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2016 read 0x21c35be thru 0x21d1dcf (0xe812 bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2017 read 0x1076027 thru 0x10779cd (0x19a7 bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2018 read 0x6bf8475 thru 0x6c01b4d (0x96d9 bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2019 read 0x976a81a thru 0x97782ba (0xdaa1 bytes) 2024-09-05T17:31:16.992 INFO:teuthology.orchestra.run.smithi050.stdout:2020 read 0x429c673 thru 0x42aba17 (0xf3a5 bytes) 2024-09-05T17:31:17.003 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:17.003 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:17.004 INFO:teuthology.orchestra.run.smithi050.stdout:2021 write 0xb314db4 thru 0xb31a2a8 (0x54f5 bytes) 2024-09-05T17:31:17.011 INFO:teuthology.orchestra.run.smithi050.stdout:2024 read 0x787f0af thru 0x788cd84 (0xdcd6 bytes) 2024-09-05T17:31:17.011 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.011 INFO:teuthology.orchestra.run.smithi050.stdout:2026 read 0x5276d8a thru 0x5284845 (0xdabc bytes) 2024-09-05T17:31:17.011 INFO:teuthology.orchestra.run.smithi050.stdout:2027 read 0x99f29c9 thru 0x9a02321 (0xf959 bytes) 2024-09-05T17:31:17.011 INFO:teuthology.orchestra.run.smithi050.stdout:2028 read 0x86ee303 thru 0x86f69a3 (0x86a1 bytes) 2024-09-05T17:31:17.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:17.023 INFO:teuthology.orchestra.run.smithi050.stdout:2029 writesame 0xb490083 thru 0xb49dcf2 data_size 0x8(0xdc70 bytes) 2024-09-05T17:31:17.023 INFO:teuthology.orchestra.run.smithi050.stdout:2030 read 0x8fe22fc thru 0x8fed1e6 (0xaeeb bytes) 2024-09-05T17:31:17.023 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.023 INFO:teuthology.orchestra.run.smithi050.stdout:2032 write 0x434f694 thru 0x435bd88 (0xc6f5 bytes) 2024-09-05T17:31:17.028 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:17.030+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:17.030 INFO:teuthology.orchestra.run.smithi050.stdout:2034 write 0x50d93f9 thru 0x50db101 (0x1d09 bytes) 2024-09-05T17:31:17.037 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.037 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.038 INFO:teuthology.orchestra.run.smithi050.stdout:2041 trunc from 0xb49dcf3 to 0xc61be9b 2024-09-05T17:31:17.048 INFO:teuthology.orchestra.run.smithi050.stdout:2042 write 0x877321 thru 0x884d6f (0xda4f bytes) 2024-09-05T17:31:17.065 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.076 INFO:teuthology.orchestra.run.smithi050.stdout:2044 write 0xd5222e1 thru 0xd52d57c (0xb29c bytes) 2024-09-05T17:31:17.083 INFO:teuthology.orchestra.run.smithi050.stdout:2045 trunc from 0xd52d57d to 0xe0e3898 2024-09-05T17:31:17.109 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.109 INFO:teuthology.orchestra.run.smithi050.stdout:2047 read 0x4a23ca2 thru 0x4a27ee0 (0x423f bytes) 2024-09-05T17:31:17.109 INFO:teuthology.orchestra.run.smithi050.stdout:2048 read 0x61eb853 thru 0x61f5be0 (0xa38e bytes) 2024-09-05T17:31:17.109 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.109 INFO:teuthology.orchestra.run.smithi050.stdout:2050 punch from 0x9ee4d88 to 0x9ee6ab3, (0x1d2b bytes) 2024-09-05T17:31:17.112 INFO:teuthology.orchestra.run.smithi050.stdout:2051 trunc from 0xe0e3898 to 0x231b996 2024-09-05T17:31:17.129 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:17.127+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:17.162 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:17.162 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:17.174 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.174 INFO:teuthology.orchestra.run.smithi050.stdout:2053 read 0x22ab0f9 thru 0x22b6412 (0xb31a bytes) 2024-09-05T17:31:17.179 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:17.207 INFO:teuthology.orchestra.run.smithi050.stdout:2054 write 0xba0d155 thru 0xba1ce4a (0xfcf6 bytes) 2024-09-05T17:31:17.213 INFO:teuthology.orchestra.run.smithi050.stdout:2056 write 0x17554f2 thru 0x175ca58 (0x7567 bytes) 2024-09-05T17:31:17.224 INFO:teuthology.orchestra.run.smithi050.stdout:2057 trunc from 0xba1ce4b to 0xafe6665 2024-09-05T17:31:17.229 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:17.230+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:17.235 INFO:teuthology.orchestra.run.smithi050.stdout:2058 read 0x623fdba thru 0x6243a4d (0x3c94 bytes) 2024-09-05T17:31:17.235 INFO:teuthology.orchestra.run.smithi050.stdout:2059 writesame 0x4a12265 thru 0x4a123ec data_size 0x4(0x188 bytes) 2024-09-05T17:31:17.240 INFO:teuthology.orchestra.run.smithi050.stdout:2060 write 0xce44a8 thru 0xced0c5 (0x8c1e bytes) 2024-09-05T17:31:17.243 INFO:teuthology.orchestra.run.smithi050.stdout:2061 writesame 0xc17e77 thru 0xc1e187 data_size 0x1(0x6311 bytes) 2024-09-05T17:31:17.278 INFO:teuthology.orchestra.run.smithi050.stdout:2062 punch from 0x5d5b46f to 0x5d5bb0f, (0x6a0 bytes) 2024-09-05T17:31:17.278 INFO:teuthology.orchestra.run.smithi050.stdout:2063 read 0x71c411b thru 0x71c5348 (0x122e bytes) 2024-09-05T17:31:17.278 INFO:teuthology.orchestra.run.smithi050.stdout:2064 punch from 0x50a11a7 to 0x50ac41e, (0xb277 bytes) 2024-09-05T17:31:17.278 INFO:teuthology.orchestra.run.smithi050.stdout:2065 read 0x281dc2c thru 0x282a4ea (0xc8bf bytes) 2024-09-05T17:31:17.279 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.279 INFO:teuthology.orchestra.run.smithi050.stdout:2068 write 0x8eb08be thru 0x8eb61e0 (0x5923 bytes) 2024-09-05T17:31:17.287 INFO:teuthology.orchestra.run.smithi050.stdout:2070 punch from 0x4a2d4d3 to 0x4a30657, (0x3184 bytes) 2024-09-05T17:31:17.287 INFO:teuthology.orchestra.run.smithi050.stdout:2072 read 0xb7f5d0 thru 0xb8b7a2 (0xc1d3 bytes) 2024-09-05T17:31:17.305 INFO:teuthology.orchestra.run.smithi050.stdout:2073 write 0xdf3ccf0 thru 0xdf3dca6 (0xfb7 bytes) 2024-09-05T17:31:17.313 INFO:teuthology.orchestra.run.smithi050.stdout:2074 read 0xcef4e8c thru 0xcefd02d (0x81a2 bytes) 2024-09-05T17:31:17.316 INFO:teuthology.orchestra.run.smithi050.stdout:2075 read 0xde6797e thru 0xde6df03 (0x6586 bytes) 2024-09-05T17:31:17.316 INFO:teuthology.orchestra.run.smithi050.stdout:2076 punch from 0xa5578ae to 0xa55a41d, (0x2b6f bytes) 2024-09-05T17:31:17.317 INFO:teuthology.orchestra.run.smithi050.stdout:2077 punch from 0xba05390 to 0xba147dc, (0xf44c bytes) 2024-09-05T17:31:17.320 INFO:teuthology.orchestra.run.smithi050.stdout:2079 trunc from 0xdf3dca7 to 0xaa4c155 2024-09-05T17:31:17.331 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:17.330+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:17.336 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:17.336 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:17.344 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.345 INFO:teuthology.orchestra.run.smithi050.stdout:2082 write 0x8f3e93b thru 0x8f40123 (0x17e9 bytes) 2024-09-05T17:31:17.351 INFO:teuthology.orchestra.run.smithi050.stdout:2083 writesame 0x74b5a41 thru 0x74c5058 data_size 0x96(0xf618 bytes) 2024-09-05T17:31:17.353 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:17.369 INFO:teuthology.orchestra.run.smithi050.stdout:2085 write 0xb35b8c2 thru 0xb35ce44 (0x1583 bytes) 2024-09-05T17:31:17.387 INFO:teuthology.orchestra.run.smithi050.stdout:2086 write 0xbdc5d7f thru 0xbdd0123 (0xa3a5 bytes) 2024-09-05T17:31:17.398 INFO:teuthology.orchestra.run.smithi050.stdout:2087 trunc from 0xbdd0124 to 0x9e3cd69 2024-09-05T17:31:17.417 INFO:teuthology.orchestra.run.smithi050.stdout:2088 read 0x16f7220 thru 0x1705b27 (0xe908 bytes) 2024-09-05T17:31:17.418 INFO:teuthology.orchestra.run.smithi050.stdout:2089 writesame 0x5d125f1 thru 0x5d14c2e data_size 0x16(0x263e bytes) 2024-09-05T17:31:17.425 INFO:teuthology.orchestra.run.smithi050.stdout:2090 read 0x35ce401 thru 0x35dc369 (0xdf69 bytes) 2024-09-05T17:31:17.425 INFO:teuthology.orchestra.run.smithi050.stdout:2092 read 0x6d17090 thru 0x6d21a49 (0xa9ba bytes) 2024-09-05T17:31:17.432 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:17.434+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:17.433 INFO:teuthology.orchestra.run.smithi050.stdout:2093 trunc from 0x9e3cd69 to 0x6996d78 2024-09-05T17:31:17.455 INFO:teuthology.orchestra.run.smithi050.stdout:2094 read 0x66224b5 thru 0x6628acf (0x661b bytes) 2024-09-05T17:31:17.463 INFO:teuthology.orchestra.run.smithi050.stdout:2095 trunc from 0x6996d78 to 0xa62af5b 2024-09-05T17:31:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:2096 read 0x732c166 thru 0x733b650 (0xf4eb bytes) 2024-09-05T17:31:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:2099 read 0x6cacbe1 thru 0x6cb0a6c (0x3e8c bytes) 2024-09-05T17:31:17.473 INFO:teuthology.orchestra.run.smithi050.stdout:2100 write 0x7f816d1 thru 0x7f8aa2f (0x935f bytes) 2024-09-05T17:31:17.481 INFO:teuthology.orchestra.run.smithi050.stdout:2102 read 0x3d5bba4 thru 0x3d612ab (0x5708 bytes) 2024-09-05T17:31:17.481 INFO:teuthology.orchestra.run.smithi050.stdout:2103 punch from 0x3b91ee4 to 0x3b96dfb, (0x4f17 bytes) 2024-09-05T17:31:17.481 INFO:teuthology.orchestra.run.smithi050.stdout:2104 punch from 0x5c06cad to 0x5c11031, (0xa384 bytes) 2024-09-05T17:31:17.481 INFO:teuthology.orchestra.run.smithi050.stdout:2107 write 0x2511837 thru 0x25136da (0x1ea4 bytes) 2024-09-05T17:31:17.485 INFO:teuthology.orchestra.run.smithi050.stdout:2109 read 0x64457a9 thru 0x6453356 (0xdbae bytes) 2024-09-05T17:31:17.489 INFO:teuthology.orchestra.run.smithi050.stdout:2111 writesame 0x57ddad thru 0x57ea82 data_size 0x1f(0xcd6 bytes) 2024-09-05T17:31:17.495 INFO:teuthology.orchestra.run.smithi050.stdout:2112 read 0x932180 thru 0x939c6a (0x7aeb bytes) 2024-09-05T17:31:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:2113 punch from 0x9477646 to 0x947d710, (0x60ca bytes) 2024-09-05T17:31:17.496 INFO:teuthology.orchestra.run.smithi050.stdout:2114 write 0x3a2884 thru 0x3b0bb5 (0xe332 bytes) 2024-09-05T17:31:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:17.512 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:17.522 INFO:teuthology.orchestra.run.smithi050.stdout:2115 trunc from 0xa62af5b to 0x6bfb6c6 2024-09-05T17:31:17.532 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:17.543 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:17.542+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:17.644 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:17.643+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:17.699 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:17.699 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:17.713 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:17.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:17.715 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:31:17.745 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:17.746+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:17.845 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:17.846+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:17.892 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:17.892 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:17.903 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:17.915 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:17.916 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:17.920 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:17.921 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:17.937 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:17.938 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:17.946 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:17.947+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:17.954 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:17.954 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:17.975 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:17.976 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:17.996 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:17.996 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:18.033 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:18.033 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:18.033 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:18.033 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:18.047 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:18.047+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:18.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:18.148 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:18.147+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:18.210 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:18.210 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:18.210 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:18.210 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:18.211 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:18.221 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:18.221 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:18.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:18.248 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:18.249 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:18.250 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:18.250+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:18.349 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:18.350+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:18.367 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4257.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.320059682, 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002468479, 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.368 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:18.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049864+0000", 2024-09-05T17:31:18.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0800000000000004e-07 2024-09-05T17:31:18.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049878+0000", 2024-09-05T17:31:18.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4165000000000001e-05 2024-09-05T17:31:18.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049896+0000", 2024-09-05T17:31:18.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8436000000000001e-05 2024-09-05T17:31:18.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049914+0000", 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7229999999999999e-05 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050094+0000", 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180564 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050134+0000", 2024-09-05T17:31:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9595000000000003e-05 2024-09-05T17:31:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052268+0000", 2024-09-05T17:31:18.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021347580000000001 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052332+0000", 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3022999999999996e-05 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3446 3.9 e28/24 3:91eb5b84:::rbd_data.114070605229.00000000000000ab:head v 28'5, mlcod=28'3)", 2024-09-05T17:31:18.375 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.126436599000002, 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019348169999999999, 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243486+0000", 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243489+0000", 2024-09-05T17:31:18.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8059999999999999e-06 2024-09-05T17:31:18.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243530+0000", 2024-09-05T17:31:18.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1083e-05 2024-09-05T17:31:18.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243568+0000", 2024-09-05T17:31:18.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7987000000000001e-05 2024-09-05T17:31:18.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243583+0000", 2024-09-05T17:31:18.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5492999999999999e-05 2024-09-05T17:31:18.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243709+0000", 2024-09-05T17:31:18.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012500799999999999 2024-09-05T17:31:18.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.243759+0000", 2024-09-05T17:31:18.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0838999999999999e-05 2024-09-05T17:31:18.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.245343+0000", 2024-09-05T17:31:18.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001584006 2024-09-05T17:31:18.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.245421+0000", 2024-09-05T17:31:18.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7595000000000005e-05 2024-09-05T17:31:18.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.383 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.383 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:31:18.383 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:18.383 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.123609252000001, 2024-09-05T17:31:18.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:31:18.384 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.384 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.384 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:31:18.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:31:18.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:31:18.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:31:18.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:31:18.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:31:18.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:31:18.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:31:18.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:31:18.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:31:18.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:31:18.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:31:18.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:31:18.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3604 3.4 e28/24 3:27555207:::rbd_data.114070605229.00000000000000e7:head v 28'21, mlcod=28'19)", 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:18.391 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.921619533000001, 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028585849999999999, 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448306+0000", 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448357+0000", 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0719e-05 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448402+0000", 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5166000000000001e-05 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448426+0000", 2024-09-05T17:31:18.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3813999999999999e-05 2024-09-05T17:31:18.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448574+0000", 2024-09-05T17:31:18.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014806500000000001 2024-09-05T17:31:18.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448613+0000", 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8353999999999999e-05 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451052+0000", 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024396909999999999 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451162+0000", 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109533 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:7801 3.0 e30/24 3:00d91651:::rbd_data.1140d4ae3aec.0000000000000025:head v 30'105, mlcod=30'102)", 2024-09-05T17:31:18.426 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.032934553, 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022194089999999999, 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336989+0000", 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.316e-06 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337179+0000", 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018963199999999999 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337195+0000", 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5880999999999999e-05 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337202+0000", 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3189999999999997e-06 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337272+0000", 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9333999999999997e-05 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337289+0000", 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7445999999999999e-05 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339156+0000", 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001866988 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339208+0000", 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1493000000000003e-05 2024-09-05T17:31:18.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:12781 3.4 e33/24 3:2593df46:::rbd_data.11403aa71fdc.00000000000002f3:head v 33'79, mlcod=30'76)", 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.345653131999999, 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019698900000000002, 2024-09-05T17:31:18.433 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024272+0000", 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3889999999999999e-06 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024292+0000", 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0434000000000001e-05 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024324+0000", 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1615000000000001e-05 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024338+0000", 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024491+0000", 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015269900000000001 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024555+0000", 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3398000000000005e-05 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026149+0000", 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00159431 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026239+0000", 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0637000000000007e-05 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.439 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27061 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'128, mlcod=36'126)", 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.481667051000001, 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019078750000000001, 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:18.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888256+0000", 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888257+0000", 2024-09-05T17:31:18.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.173e-06 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888263+0000", 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1149999999999999e-06 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888283+0000", 2024-09-05T17:31:18.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9684e-05 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888289+0000", 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4649999999999999e-06 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888406+0000", 2024-09-05T17:31:18.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011736299999999999 2024-09-05T17:31:18.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.888473+0000", 2024-09-05T17:31:18.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6657999999999998e-05 2024-09-05T17:31:18.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.890104+0000", 2024-09-05T17:31:18.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016305410000000001 2024-09-05T17:31:18.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:03.890164+0000", 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9876000000000001e-05 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27251 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'174, mlcod=36'172)", 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:18.446 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.150979505, 2024-09-05T17:31:18.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025164060000000001, 2024-09-05T17:31:18.447 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.447 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:18.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:18.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218944+0000", 2024-09-05T17:31:18.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.057e-06 2024-09-05T17:31:18.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218953+0000", 2024-09-05T17:31:18.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5369999999999997e-06 2024-09-05T17:31:18.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218974+0000", 2024-09-05T17:31:18.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0772e-05 2024-09-05T17:31:18.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218986+0000", 2024-09-05T17:31:18.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:18.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219118+0000", 2024-09-05T17:31:18.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132638 2024-09-05T17:31:18.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219177+0000", 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8270000000000003e-05 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221306+0000", 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002128956 2024-09-05T17:31:18.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221460+0000", 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000153991 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27272 3.9 e36/24 3:961ac59e:::rbd_data.1140f3505917.000000000000023a:head v 36'186, mlcod=36'184)", 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.100727571, 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026438630000000002, 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269196+0000", 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2610000000000001e-06 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270692+0000", 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495365 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270721+0000", 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9036000000000001e-05 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270736+0000", 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4979e-05 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270814+0000", 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8010999999999996e-05 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270836+0000", 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2651999999999999e-05 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271799+0000", 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096227200000000002 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271839+0000", 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0287000000000002e-05 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.460 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27439 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'228, mlcod=36'226)", 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.792806861000001, 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031113629999999998, 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577119+0000", 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7549999999999999e-06 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577132+0000", 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3699e-05 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577165+0000", 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2645999999999999e-05 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577181+0000", 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5764999999999999e-05 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577311+0000", 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013032399999999999 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577375+0000", 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3532000000000001e-05 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580116+0000", 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027411520000000002 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580227+0000", 2024-09-05T17:31:18.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011149 2024-09-05T17:31:18.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27440 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'229, mlcod=36'226)", 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.791116503, 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022421120000000001, 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578808+0000", 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0499999999999999e-06 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578823+0000", 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4290999999999999e-05 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578855+0000", 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2682999999999999e-05 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578875+0000", 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9881000000000002e-05 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579029+0000", 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015355499999999999 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579173+0000", 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014394599999999999 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580954+0000", 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001781134 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.581048+0000", 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4572000000000002e-05 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27516 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'242, mlcod=36'240)", 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:18.475 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.589009495999999, 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001967735, 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:18.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780916+0000", 2024-09-05T17:31:18.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2790000000000001e-06 2024-09-05T17:31:18.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780930+0000", 2024-09-05T17:31:18.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4914e-05 2024-09-05T17:31:18.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780958+0000", 2024-09-05T17:31:18.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7217e-05 2024-09-05T17:31:18.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780972+0000", 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4456e-05 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781128+0000", 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015544699999999999 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781166+0000", 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8868999999999997e-05 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782803+0000", 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016366519999999999 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782881+0000", 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7900999999999998e-05 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27750 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'288, mlcod=36'286)", 2024-09-05T17:31:18.482 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:18.483 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.185671679, 2024-09-05T17:31:18.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021578209999999999, 2024-09-05T17:31:18.483 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.483 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.483 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184254+0000", 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184272+0000", 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8284e-05 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184311+0000", 2024-09-05T17:31:18.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-05T17:31:18.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184329+0000", 2024-09-05T17:31:18.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8077999999999999e-05 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184507+0000", 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000177035 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184573+0000", 2024-09-05T17:31:18.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6729000000000004e-05 2024-09-05T17:31:18.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186301+0000", 2024-09-05T17:31:18.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017280279999999999 2024-09-05T17:31:18.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186409+0000", 2024-09-05T17:31:18.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107601 2024-09-05T17:31:18.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.490 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27759 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'289, mlcod=36'287)", 2024-09-05T17:31:18.490 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:18.490 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.171863223000001, 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026394679999999998, 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:18.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:18.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198063+0000", 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0570000000000001e-06 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198077+0000", 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4270999999999999e-05 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198112+0000", 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4953000000000002e-05 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198127+0000", 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5597999999999999e-05 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198290+0000", 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162631 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198352+0000", 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1796000000000003e-05 2024-09-05T17:31:18.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200559+0000", 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022068579999999999 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200699+0000", 2024-09-05T17:31:18.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000140304 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:30784 3.9 e37/24 3:9275f381:::rbd_data.1140f3505917.00000000000001d4:head v 37'308, mlcod=37'305)", 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.484646197, 2024-09-05T17:31:18.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023488469999999998, 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:18.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:18.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1399999999999995e-07 2024-09-05T17:31:18.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885285+0000", 2024-09-05T17:31:18.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7810000000000005e-06 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885300+0000", 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4833e-05 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885308+0000", 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5769999999999996e-06 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885748+0000", 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044075899999999999 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885769+0000", 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0922999999999999e-05 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.887576+0000", 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018066359999999999 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.887625+0000", 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9424e-05 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34616 3.0 e40/24 3:026e24ed:::rbd_data.11404462ede9.0000000000000037:head v 40'154, mlcod=39'152)", 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.3977380499999992, 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019695590000000001, 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.504 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972187+0000", 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4849999999999999e-06 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972224+0000", 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6563999999999998e-05 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972254+0000", 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0772000000000003e-05 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972267+0000", 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2728000000000001e-05 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972388+0000", 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120797 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972430+0000", 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2023000000000001e-05 2024-09-05T17:31:18.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.974032+0000", 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016015840000000001 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.974154+0000", 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012260600000000001 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34666 3.0 e40/24 3:002dc5db:::rbd_data.11404462ede9.0000000000000009:head v 40'156, mlcod=40'154)", 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.2714626419999995, 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022195069999999999, 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:18.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098462+0000", 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0490000000000002e-06 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098473+0000", 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1297999999999999e-05 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098503+0000", 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9904999999999999e-05 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098516+0000", 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2435e-05 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.099032+0000", 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051637500000000002 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.099068+0000", 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5559999999999998e-05 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.100613+0000", 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015457159999999999 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.100680+0000", 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6168999999999996e-05 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34899 3.4 e40/24 3:21eb45c5:::rbd_data.11404462ede9.0000000000000026:head v 40'111, mlcod=40'109)", 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.7665054080000004, 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003148802, 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603420+0000", 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603437+0000", 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6891000000000001e-05 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603479+0000", 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2222999999999999e-05 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603501+0000", 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1297999999999998e-05 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603838+0000", 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033740899999999999 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603900+0000", 2024-09-05T17:31:18.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2150000000000006e-05 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.606418+0000", 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025176560000000001 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.606566+0000", 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148355 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34903 3.4 e40/24 3:23501bd1:::rbd_data.11404462ede9.0000000000000030:head v 40'112, mlcod=40'109)", 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.765044176, 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023817030000000002, 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604880+0000", 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.141e-06 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604893+0000", 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.33e-05 2024-09-05T17:31:18.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604914+0000", 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1438e-05 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604925+0000", 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0730000000000001e-05 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.605156+0000", 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023070499999999999 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.605186+0000", 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0306000000000001e-05 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.607152+0000", 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019654210000000002 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.607260+0000", 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108662 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34979 3.0 e40/24 3:058d46e1:::rbd_data.11404462ede9.0000000000000072:head v 40'158, mlcod=40'156)", 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.6505673600000001, 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002034831, 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:18.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719358+0000", 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0429999999999999e-06 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719401+0000", 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2642999999999998e-05 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719441+0000", 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0031999999999999e-05 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719513+0000", 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1829000000000006e-05 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719722+0000", 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020864899999999999 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719779+0000", 2024-09-05T17:31:18.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7377999999999999e-05 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.721306+0000", 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015273419999999999 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.721390+0000", 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3914999999999999e-05 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:18.526 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:18.527 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:18.528 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:18.529 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:31:18.530 INFO:teuthology.orchestra.run.smithi050.stdout:2116 read 0x60217b6 thru 0x6022fd7 (0x1822 bytes) 2024-09-05T17:31:18.530 INFO:teuthology.orchestra.run.smithi050.stdout:2117 punch from 0x403d644 to 0x404893f, (0xb2fb bytes) 2024-09-05T17:31:18.530 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:18.530 INFO:teuthology.orchestra.run.smithi050.stdout:2119 write 0x44541a1 thru 0x4462250 (0xe0b0 bytes) 2024-09-05T17:31:18.530 INFO:teuthology.orchestra.run.smithi050.stdout:2120 read 0x1ba1c6c thru 0x1baa163 (0x84f8 bytes) 2024-09-05T17:31:18.531 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:18.530+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:18.532 INFO:teuthology.orchestra.run.smithi050.stdout:2122 trunc from 0x6bfb6c6 to 0x8346aad 2024-09-05T17:31:18.545 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:18.545 INFO:teuthology.orchestra.run.smithi050.stdout:2125 write 0x7d0f514 thru 0x7d1650d (0x6ffa bytes) 2024-09-05T17:31:18.551 INFO:teuthology.orchestra.run.smithi050.stdout:2126 write 0x39a9558 thru 0x39acb31 (0x35da bytes) 2024-09-05T17:31:18.557 INFO:teuthology.orchestra.run.smithi050.stdout:2128 read 0x1e339ad thru 0x1e3d9dc (0xa030 bytes) 2024-09-05T17:31:18.562 INFO:teuthology.orchestra.run.smithi050.stdout:2129 trunc from 0x8346aad to 0xa9f9a3b 2024-09-05T17:31:18.572 INFO:teuthology.orchestra.run.smithi050.stdout:2130 write 0x5ac9b58 thru 0x5acde48 (0x42f1 bytes) 2024-09-05T17:31:18.579 INFO:teuthology.orchestra.run.smithi050.stdout:2133 read 0x75f497a thru 0x75fa831 (0x5eb8 bytes) 2024-09-05T17:31:18.579 INFO:teuthology.orchestra.run.smithi050.stdout:2134 write 0x2a69a2d thru 0x2a6d095 (0x3669 bytes) 2024-09-05T17:31:18.582 INFO:teuthology.orchestra.run.smithi050.stdout:2135 write 0x9e052e4 thru 0x9e0be84 (0x6ba1 bytes) 2024-09-05T17:31:18.600 INFO:teuthology.orchestra.run.smithi050.stdout:2136 trunc from 0xa9f9a3b to 0x44a9d76 2024-09-05T17:31:18.622 INFO:teuthology.orchestra.run.smithi050.stdout:2137 read 0x40f038c thru 0x40f256d (0x21e2 bytes) 2024-09-05T17:31:18.626 INFO:teuthology.orchestra.run.smithi050.stdout:2138 trunc from 0x44a9d76 to 0x201a3b2 2024-09-05T17:31:18.628 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:18.630+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:18.678 INFO:teuthology.orchestra.run.smithi050.stdout:2139 trunc from 0x201a3b2 to 0xe2199e8 2024-09-05T17:31:18.679 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:18.679 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:18.679 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:18.679 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:18.689 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:18.689 INFO:teuthology.orchestra.run.smithi050.stdout:2141 punch from 0x5b64ea7 to 0x5b73f2d, (0xf086 bytes) 2024-09-05T17:31:18.689 INFO:teuthology.orchestra.run.smithi050.stdout:2143 write 0xdce362a thru 0xdcef918 (0xc2ef bytes) 2024-09-05T17:31:18.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:18.696 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:18.696 INFO:teuthology.orchestra.run.smithi050.stdout:2146 read 0x23e7570 thru 0x23efc45 (0x86d6 bytes) 2024-09-05T17:31:18.696 INFO:teuthology.orchestra.run.smithi050.stdout:2147 write 0x4839925 thru 0x483fec3 (0x659f bytes) 2024-09-05T17:31:18.714 INFO:teuthology.orchestra.run.smithi050.stdout:2149 write 0xe51f5d4 thru 0xe526c47 (0x7674 bytes) 2024-09-05T17:31:18.719 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:18.719 INFO:teuthology.orchestra.run.smithi050.stdout:2154 write 0x54ac2f4 thru 0x54ae5b4 (0x22c1 bytes) 2024-09-05T17:31:18.726 INFO:teuthology.orchestra.run.smithi050.stdout:2158 trunc from 0xe526c48 to 0xe03c4a4 2024-09-05T17:31:18.729 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:18.730+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:18.736 INFO:teuthology.orchestra.run.smithi050.stdout:2160 write 0x5525d02 thru 0x5528429 (0x2728 bytes) 2024-09-05T17:31:18.743 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:18.748 INFO:teuthology.orchestra.run.smithi050.stdout:2162 trunc from 0xe03c4a4 to 0xbbe0ebc 2024-09-05T17:31:18.763 INFO:teuthology.orchestra.run.smithi050.stdout:2163 write 0x7a8fc63 thru 0x7a95b5d (0x5efb bytes) 2024-09-05T17:31:18.769 INFO:teuthology.orchestra.run.smithi050.stdout:2164 read 0x688a987 thru 0x688e46f (0x3ae9 bytes) 2024-09-05T17:31:18.769 INFO:teuthology.orchestra.run.smithi050.stdout:2166 punch from 0x4d0f925 to 0x4d1b489, (0xbb64 bytes) 2024-09-05T17:31:18.770 INFO:teuthology.orchestra.run.smithi050.stdout:2168 writesame 0x5b8a361 thru 0x5b8c6c6 data_size 0x17(0x2366 bytes) 2024-09-05T17:31:18.775 INFO:teuthology.orchestra.run.smithi050.stdout:2169 clone 11 order 25 su 16777216 sc 12 2024-09-05T17:31:18.827 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:18.828 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:18.828 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:18.828 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:18.828 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:18.830 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:18.830+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:18.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:18.934 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:18.935+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:19.011 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.011 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.804302371999999, 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:31:19.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:19.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:31:19.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:31:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:31:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.017 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.803281044999999, 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:31:19.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:31:19.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.802192547000001, 2024-09-05T17:31:19.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:31:19.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:31:19.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:31:19.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:31:19.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:31:19.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.801172036000001, 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.800145087000001, 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:19.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:31:19.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:31:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:31:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.797802488999999, 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.041 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:31:19.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:31:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:31:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:31:19.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.792850315999999, 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:19.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:31:19.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:31:19.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13418 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6023168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:19.051 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.792254415999999, 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14037719400000001, 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13418 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:19.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221572+0000", 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034026199999999998 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221584+0000", 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1321999999999999e-05 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221603+0000", 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9344e-05 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221615+0000", 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1565e-05 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361125+0000", 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139510734 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361358+0000", 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023231599999999999 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361609+0000", 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025165099999999998 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.055 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.791850332999999, 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.056 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:31:19.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.791244934000002, 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.060 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:31:19.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.790185806, 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:31:19.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:31:19.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.789544523, 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.069 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.073 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.788949629000001, 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:31:19.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:31:19.077 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.787884434999999, 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.078 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:31:19.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:31:19.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.787243745000001, 2024-09-05T17:31:19.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:31:19.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:31:19.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.786793045, 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.087 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:31:19.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:31:19.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.786147302, 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.091 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:19.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.095 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.785775284, 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:31:19.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.785134230000001, 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.100 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:31:19.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.784535700999999, 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:31:19.104 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:31:19.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:31:19.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:19.109 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:19.109 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:19.110 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:19.111 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:19.110+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:19.211 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:19.211+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:19.241 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:19.242 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:19.242 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:19.242 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:19.255 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:19.312 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:19.311+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:19.373 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:19.373 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:19.374 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:19.374 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:19.374 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:19.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:19.412 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:19.411+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:19.513 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:19.514+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:19.517 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.813823885, 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:19.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:31:19.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.813776501, 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.523 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:31:19.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.813731829, 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:31:19.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:31:19.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.813686487, 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:31:19.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.536 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.813617476999999, 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:31:19.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.813569040000001, 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:19.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.813522682, 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:31:19.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.812860091999999, 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:31:19.550 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:31:19.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.812768746, 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.555 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:31:19.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:31:19.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.559 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.812707266, 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.560 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:31:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:31:19.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:31:19.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:31:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:31:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:31:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.566 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.812650366, 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:19.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.571 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.812557125, 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:31:19.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.812497597, 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:19.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:31:19.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.805341635, 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:31:19.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.805280167999999, 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:31:19.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:31:19.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.803412199, 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:31:19.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:31:19.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.803371689, 2024-09-05T17:31:19.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:31:19.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.803333222999999, 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.604 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.803275116, 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:31:19.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:31:19.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.803217815, 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:19.609 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:19.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:31:19.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:19.613 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:19.614 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:19.615 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:19.616 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:19.615+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:19.616 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:19.616 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:19.616 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-05T17:31:19.616 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-05T17:31:19.616 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-05T17:31:19.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-05T17:31:19.716 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:19.718+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:19.754 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone10 from 0xbbe0ebc (overlap 0x201a3b2) to 0x0 2024-09-05T17:31:19.794 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:19.794 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:19.794 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:19.794 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:19.794 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:19.794 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-05T17:31:19.794 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:19.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:19.860 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:19.862+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:19.905 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-05T17:31:19.917 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:19.918+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:19.983 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:19.987 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:19.987 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:19.987 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:19.987 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:19.997 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:20.040 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:20.042+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:20.119 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:20.118+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:20.169 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:20.169 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:20.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:20.169 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:20.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.169 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.169 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4246077179999999, 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:31:20.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4245495249999998, 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:31:20.174 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:31:20.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:31:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4244882069999996, 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:31:20.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:20.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.183 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4244217399999997, 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:31:20.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.424345583, 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.192 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4242826160000002, 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:31:20.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:31:20.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:31:20.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4242208850000004, 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.197 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:31:20.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:20.201 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4241378579999999, 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:20.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:31:20.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.424079184, 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.206 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:20.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.210 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.424022237, 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.211 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:31:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:31:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:31:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:31:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.215 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4239577619999997, 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:31:20.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:31:20.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4238871089999998, 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.221 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:31:20.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:31:20.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:20.225 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4238101189999997, 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:20.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:20.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:31:20.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:20.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:31:20.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:31:20.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:31:20.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:31:20.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:31:20.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:31:20.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:31:20.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:31:20.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:31:20.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:31:20.233 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.233 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.234 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.234 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4237513579999996, 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4236886870000003, 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:31:20.239 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:31:20.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:31:20.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4236265560000003, 2024-09-05T17:31:20.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:31:20.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4235074809999997, 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:31:20.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:31:20.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4234530300000001, 2024-09-05T17:31:20.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:31:20.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:31:20.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4232905899999997, 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.257 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.4221062030000002, 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:20.261 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:31:20.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:20.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:20.265 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:20.267 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:20.268 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:20.266+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:20.271 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:20.350 INFO:teuthology.orchestra.run.smithi050.stdout:2172 read 0x4098159 thru 0x409a85d (0x2705 bytes) 2024-09-05T17:31:20.367 INFO:teuthology.orchestra.run.smithi050.stdout:2173 writesame 0xdd88bbe thru 0xdd95ac9 data_size 0x2a(0xcf0c bytes) 2024-09-05T17:31:20.368 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:20.366+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:20.378 INFO:teuthology.orchestra.run.smithi050.stdout:2174 write 0xbaef74 thru 0xbbc767 (0xd7f4 bytes) 2024-09-05T17:31:20.410 INFO:teuthology.orchestra.run.smithi050.stdout:2175 read 0x331ec15 thru 0x33263f1 (0x77dd bytes) 2024-09-05T17:31:20.410 INFO:teuthology.orchestra.run.smithi050.stdout:2177 punch from 0xa354b61 to 0xa35d75b, (0x8bfa bytes) 2024-09-05T17:31:20.410 INFO:teuthology.orchestra.run.smithi050.stdout:2178 write 0x8f61f5d thru 0x8f68230 (0x62d4 bytes) 2024-09-05T17:31:20.415 INFO:teuthology.orchestra.run.smithi050.stdout:2179 write 0x3bd5c83 thru 0x3be0fb1 (0xb32f bytes) 2024-09-05T17:31:20.418 INFO:teuthology.orchestra.run.smithi050.stdout:2180 read 0xba79cda thru 0xba7ce13 (0x313a bytes) 2024-09-05T17:31:20.418 INFO:teuthology.orchestra.run.smithi050.stdout:2181 writesame 0xcef0799 thru 0xcf00636 data_size 0x2(0xfe9e bytes) 2024-09-05T17:31:20.425 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:20.426 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:20.443 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:20.443 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:20.445 INFO:teuthology.orchestra.run.smithi050.stdout:2182 trunc from 0xdd95aca to 0xd7f15a6 2024-09-05T17:31:20.453 INFO:teuthology.orchestra.run.smithi050.stdout:2183 write 0x4f22f8b thru 0x4f2e965 (0xb9db bytes) 2024-09-05T17:31:20.454 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:20.454 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:20.454 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:20.454 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:20.461 INFO:teuthology.orchestra.run.smithi050.stdout:2186 write 0x1dc3352 thru 0x1dc827f (0x4f2e bytes) 2024-09-05T17:31:20.461 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:20.461 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:20.464 INFO:teuthology.orchestra.run.smithi050.stdout:2187 punch from 0x79dd973 to 0x79e58e1, (0x7f6e bytes) 2024-09-05T17:31:20.464 INFO:teuthology.orchestra.run.smithi050.stdout:2188 write 0x1a34316 thru 0x1a40f2e (0xcc19 bytes) 2024-09-05T17:31:20.467 INFO:teuthology.orchestra.run.smithi050.stdout:2190 read 0x957b692 thru 0x957ea28 (0x3397 bytes) 2024-09-05T17:31:20.468 INFO:teuthology.orchestra.run.smithi050.stdout:2191 write 0xf61aae thru 0xf6d30e (0xb861 bytes) 2024-09-05T17:31:20.470 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.470 INFO:teuthology.orchestra.run.smithi050.stdout:2193 read 0x28f74d0 thru 0x28fe766 (0x7297 bytes) 2024-09-05T17:31:20.471 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:20.466+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:20.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:20.474 INFO:teuthology.orchestra.run.smithi050.stdout:2194 trunc from 0xd7f15a6 to 0xc285c6a 2024-09-05T17:31:20.479 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:20.480 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:20.489 INFO:teuthology.orchestra.run.smithi050.stdout:2196 write 0xdb703c6 thru 0xdb76c41 (0x687c bytes) 2024-09-05T17:31:20.491 INFO:teuthology.orchestra.run.smithi050.stdout:2199 write 0x2474ef2 thru 0x247d692 (0x87a1 bytes) 2024-09-05T17:31:20.496 INFO:teuthology.orchestra.run.smithi050.stdout:2200 write 0x1a62765 thru 0x1a66806 (0x40a2 bytes) 2024-09-05T17:31:20.498 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.498 INFO:teuthology.orchestra.run.smithi050.stdout:2202 write 0x6b91b88 thru 0x6b9ef89 (0xd402 bytes) 2024-09-05T17:31:20.499 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:20.499 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:20.502 INFO:teuthology.orchestra.run.smithi050.stdout:2205 write 0x394d02 thru 0x3a04de (0xb7dd bytes) 2024-09-05T17:31:20.505 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.505 INFO:teuthology.orchestra.run.smithi050.stdout:2207 read 0xbf6b8f9 thru 0xbf706eb (0x4df3 bytes) 2024-09-05T17:31:20.505 INFO:teuthology.orchestra.run.smithi050.stdout:2208 write 0x5db88f7 thru 0x5dc7349 (0xea53 bytes) 2024-09-05T17:31:20.509 INFO:teuthology.orchestra.run.smithi050.stdout:2209 write 0x918c3d2 thru 0x9197cc3 (0xb8f2 bytes) 2024-09-05T17:31:20.513 INFO:teuthology.orchestra.run.smithi050.stdout:2210 write 0xc7ea52b thru 0xc7ed288 (0x2d5e bytes) 2024-09-05T17:31:20.515 INFO:teuthology.orchestra.run.smithi050.stdout:2212 write 0x86f661e thru 0x8703233 (0xcc16 bytes) 2024-09-05T17:31:20.517 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.517 INFO:teuthology.orchestra.run.smithi050.stdout:2215 read 0xc674ca thru 0xc68f43 (0x1a7a bytes) 2024-09-05T17:31:20.519 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:20.520 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:20.520 INFO:teuthology.orchestra.run.smithi050.stdout:2216 writesame 0xd9ddf43 thru 0xd9e4a6f data_size 0x1(0x6b2d bytes) 2024-09-05T17:31:20.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:31:20.534 INFO:teuthology.orchestra.run.smithi050.stdout:2217 writesame 0x4be08da thru 0x4be7ad4 data_size 0x1(0x71fb bytes) 2024-09-05T17:31:20.538 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:20.538 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:20.555 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.555 INFO:teuthology.orchestra.run.smithi050.stdout:2219 read 0xb59322d thru 0xb5a2e3b (0xfc0f bytes) 2024-09-05T17:31:20.555 INFO:teuthology.orchestra.run.smithi050.stdout:2220 read 0x6abc695 thru 0x6acb590 (0xeefc bytes) 2024-09-05T17:31:20.557 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:20.557 INFO:teuthology.orchestra.run.smithi050.stdout:2221 read 0x420c26 thru 0x429c79 (0x9054 bytes) 2024-09-05T17:31:20.558 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:20.558 INFO:teuthology.orchestra.run.smithi050.stdout:2222 punch from 0xd81c823 to 0xd8238eb, (0x70c8 bytes) 2024-09-05T17:31:20.558 INFO:teuthology.orchestra.run.smithi050.stdout:2224 punch from 0x610b6f2 to 0x6111e79, (0x6787 bytes) 2024-09-05T17:31:20.558 INFO:teuthology.orchestra.run.smithi050.stdout:2225 read 0x192c4ec thru 0x192ea95 (0x25aa bytes) 2024-09-05T17:31:20.561 INFO:teuthology.orchestra.run.smithi050.stdout:2226 trunc from 0xdb76c42 to 0xbcb86d6 2024-09-05T17:31:20.571 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:20.570+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:20.580 INFO:teuthology.orchestra.run.smithi050.stdout:2227 write 0xc73c988 thru 0xc746213 (0x988c bytes) 2024-09-05T17:31:20.584 INFO:teuthology.orchestra.run.smithi050.stdout:2228 trunc from 0xc746214 to 0xb202ed7 2024-09-05T17:31:20.593 INFO:teuthology.orchestra.run.smithi050.stdout:2229 read 0x62d7d5d thru 0x62e2494 (0xa738 bytes) 2024-09-05T17:31:20.594 INFO:teuthology.orchestra.run.smithi050.stdout:2230 read 0x772c134 thru 0x7732989 (0x6856 bytes) 2024-09-05T17:31:20.594 INFO:teuthology.orchestra.run.smithi050.stdout:2232 write 0x3855396 thru 0x3858739 (0x33a4 bytes) 2024-09-05T17:31:20.595 INFO:teuthology.orchestra.run.smithi050.stdout:2234 read 0x6a62185 thru 0x6a6cb73 (0xa9ef bytes) 2024-09-05T17:31:20.601 INFO:teuthology.orchestra.run.smithi050.stdout:2235 trunc from 0xb202ed7 to 0x8af9d38 2024-09-05T17:31:20.611 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:20.611 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:20.615 INFO:teuthology.orchestra.run.smithi050.stdout:2236 writesame 0x51eaa09 thru 0x51f4813 data_size 0x1(0x9e0b bytes) 2024-09-05T17:31:20.628 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:20.656 INFO:teuthology.orchestra.run.smithi050.stdout:2238 punch from 0x21074f1 to 0x2115505, (0xe014 bytes) 2024-09-05T17:31:20.656 INFO:teuthology.orchestra.run.smithi050.stdout:2239 write 0xc8e2dc thru 0xc9224d (0x3f72 bytes) 2024-09-05T17:31:20.659 INFO:teuthology.orchestra.run.smithi050.stdout:2240 punch from 0x4747dca to 0x4754659, (0xc88f bytes) 2024-09-05T17:31:20.659 INFO:teuthology.orchestra.run.smithi050.stdout:2241 writesame 0x1fe03fa thru 0x1feef93 data_size 0x35(0xeb9a bytes) 2024-09-05T17:31:20.662 INFO:teuthology.orchestra.run.smithi050.stdout:2242 write 0x264adde thru 0x2653715 (0x8938 bytes) 2024-09-05T17:31:20.664 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.664 INFO:teuthology.orchestra.run.smithi050.stdout:2245 punch from 0x6fd911b to 0x6fda072, (0xf57 bytes) 2024-09-05T17:31:20.664 INFO:teuthology.orchestra.run.smithi050.stdout:2246 write 0x43c8cd thru 0x44ba7e (0xf1b2 bytes) 2024-09-05T17:31:20.666 INFO:teuthology.orchestra.run.smithi050.stdout:2247 write 0x5c8f93 thru 0x5ca498 (0x1506 bytes) 2024-09-05T17:31:20.667 INFO:teuthology.orchestra.run.smithi050.stdout:2248 write 0x4ff1973 thru 0x4ffa2d4 (0x8962 bytes) 2024-09-05T17:31:20.672 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:20.670+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:20.676 INFO:teuthology.orchestra.run.smithi050.stdout:2249 trunc from 0x8af9d38 to 0x4f6fa0c 2024-09-05T17:31:20.690 INFO:teuthology.orchestra.run.smithi050.stdout:2250 read 0x275f249 thru 0x2767c64 (0x8a1c bytes) 2024-09-05T17:31:20.690 INFO:teuthology.orchestra.run.smithi050.stdout:2251 punch from 0x1f16ec7 to 0x1f1cb01, (0x5c3a bytes) 2024-09-05T17:31:20.713 INFO:teuthology.orchestra.run.smithi050.stdout:2254 writesame 0xde51196 thru 0xde5361e data_size 0x1(0x2489 bytes) 2024-09-05T17:31:20.714 INFO:teuthology.orchestra.run.smithi050.stdout:2256 read 0x6caf2dc thru 0x6cbc6f1 (0xd416 bytes) 2024-09-05T17:31:20.714 INFO:teuthology.orchestra.run.smithi050.stdout:2257 write 0x1b478bc thru 0x1b4ba7f (0x41c4 bytes) 2024-09-05T17:31:20.716 INFO:teuthology.orchestra.run.smithi050.stdout:2259 write 0xb0693ad thru 0xb075f5b (0xcbaf bytes) 2024-09-05T17:31:20.720 INFO:teuthology.orchestra.run.smithi050.stdout:2260 writesame 0xa3abc48 thru 0xa3b19a3 data_size 0x32(0x5d5c bytes) 2024-09-05T17:31:20.724 INFO:teuthology.orchestra.run.smithi050.stdout:2261 write 0xb266ae thru 0xb314f5 (0xae48 bytes) 2024-09-05T17:31:20.727 INFO:teuthology.orchestra.run.smithi050.stdout:2262 read 0x5ee1d7d thru 0x5eecb93 (0xae17 bytes) 2024-09-05T17:31:20.727 INFO:teuthology.orchestra.run.smithi050.stdout:2265 write 0x7164181 thru 0x716a553 (0x63d3 bytes) 2024-09-05T17:31:20.730 INFO:teuthology.orchestra.run.smithi050.stdout:2266 read 0x867fc32 thru 0x86861d6 (0x65a5 bytes) 2024-09-05T17:31:20.730 INFO:teuthology.orchestra.run.smithi050.stdout:2267 punch from 0x87b0217 to 0x87b1ebd, (0x1ca6 bytes) 2024-09-05T17:31:20.730 INFO:teuthology.orchestra.run.smithi050.stdout:2269 read 0x5d96021 thru 0x5d9bdc2 (0x5da2 bytes) 2024-09-05T17:31:20.730 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.731 INFO:teuthology.orchestra.run.smithi050.stdout:2271 read 0x75e659f thru 0x75f3a81 (0xd4e3 bytes) 2024-09-05T17:31:20.731 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.731 INFO:teuthology.orchestra.run.smithi050.stdout:2274 write 0xa80f25d thru 0xa817d4c (0x8af0 bytes) 2024-09-05T17:31:20.732 INFO:teuthology.orchestra.run.smithi050.stdout:2276 write 0x8cf77eb thru 0x8cf7e4c (0x662 bytes) 2024-09-05T17:31:20.739 INFO:teuthology.orchestra.run.smithi050.stdout:2277 trunc from 0xde5361f to 0xbbcbb2d 2024-09-05T17:31:20.749 INFO:teuthology.orchestra.run.smithi050.stdout:2278 read 0x99a9015 thru 0x99aa1f7 (0x11e3 bytes) 2024-09-05T17:31:20.762 INFO:teuthology.orchestra.run.smithi050.stdout:2279 write 0xdc3c654 thru 0xdc4a761 (0xe10e bytes) 2024-09-05T17:31:20.764 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.773 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:20.770+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:20.783 INFO:teuthology.orchestra.run.smithi050.stdout:2283 trunc from 0xdc4a762 to 0x340d604 2024-09-05T17:31:20.801 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:20.801 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:20.806 INFO:teuthology.orchestra.run.smithi050.stdout:2284 read 0x338fcd8 thru 0x339858b (0x88b4 bytes) 2024-09-05T17:31:20.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:20.821 INFO:teuthology.orchestra.run.smithi050.stdout:2289 trunc from 0x340d604 to 0xcc6443e 2024-09-05T17:31:20.837 INFO:teuthology.orchestra.run.smithi050.stdout:2290 trunc from 0xcc6443e to 0x79ed9bf 2024-09-05T17:31:20.847 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.847 INFO:teuthology.orchestra.run.smithi050.stdout:2292 writesame 0x545a1c7 thru 0x545e178 data_size 0x1f(0x3fb2 bytes) 2024-09-05T17:31:20.851 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.852 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.852 INFO:teuthology.orchestra.run.smithi050.stdout:2295 read 0x175ac25 thru 0x175feee (0x52ca bytes) 2024-09-05T17:31:20.867 INFO:teuthology.orchestra.run.smithi050.stdout:2296 writesame 0xb110fff thru 0xb11f48c data_size 0x5(0xe48e bytes) 2024-09-05T17:31:20.867 INFO:teuthology.orchestra.run.smithi050.stdout:2297 write 0x4212382 thru 0x4215c2d (0x38ac bytes) 2024-09-05T17:31:20.871 INFO:teuthology.orchestra.run.smithi050.stdout:2299 read 0x40bc120 thru 0x40c13a5 (0x5286 bytes) 2024-09-05T17:31:20.874 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:20.870+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:20.884 INFO:teuthology.orchestra.run.smithi050.stdout:2300 writesame 0xce1e3ad thru 0xce24226 data_size 0x6(0x5e7a bytes) 2024-09-05T17:31:20.893 INFO:teuthology.orchestra.run.smithi050.stdout:2302 trunc from 0xce24227 to 0xa15d837 2024-09-05T17:31:20.904 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.904 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.904 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.905 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.905 INFO:teuthology.orchestra.run.smithi050.stdout:2309 writesame 0x85b1d2f thru 0x85bb34e data_size 0x10(0x9620 bytes) 2024-09-05T17:31:20.909 INFO:teuthology.orchestra.run.smithi050.stdout:2310 write 0x57a2d72 thru 0x57b1f73 (0xf202 bytes) 2024-09-05T17:31:20.913 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:20.913 INFO:teuthology.orchestra.run.smithi050.stdout:2312 read 0x284a679 thru 0x2850ae9 (0x6471 bytes) 2024-09-05T17:31:20.913 INFO:teuthology.orchestra.run.smithi050.stdout:2314 punch from 0x566b63b to 0x566ef38, (0x38fd bytes) 2024-09-05T17:31:20.928 INFO:teuthology.orchestra.run.smithi050.stdout:2315 trunc from 0xa15d837 to 0x10b69e1 2024-09-05T17:31:20.942 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:20.942 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:20.950 INFO:teuthology.orchestra.run.smithi050.stdout:2316 read 0x5aeb41 thru 0x5b0dd8 (0x2298 bytes) 2024-09-05T17:31:20.951 INFO:teuthology.orchestra.run.smithi050.stdout:2317 punch from 0x9899a7 to 0x9965f2, (0xcc4b bytes) 2024-09-05T17:31:20.951 INFO:teuthology.orchestra.run.smithi050.stdout:2318 punch from 0xebc402 to 0xebe8a7, (0x24a5 bytes) 2024-09-05T17:31:20.951 INFO:teuthology.orchestra.run.smithi050.stdout:2319 punch from 0x716c39 to 0x7175ec, (0x9b3 bytes) 2024-09-05T17:31:20.956 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:20.981 INFO:teuthology.orchestra.run.smithi050.stdout:2320 write 0xd28e4d0 thru 0xd28fd15 (0x1846 bytes) 2024-09-05T17:31:20.984 INFO:teuthology.orchestra.run.smithi050.stdout:2321 trunc from 0xd28fd16 to 0xd0616ca 2024-09-05T17:31:20.995 INFO:teuthology.orchestra.run.smithi050.stdout:2322 write 0x46bc437 thru 0x46be0d2 (0x1c9c bytes) 2024-09-05T17:31:21.001 INFO:teuthology.orchestra.run.smithi050.stdout:2323 read 0x26e684a thru 0x26eabe1 (0x4398 bytes) 2024-09-05T17:31:21.001 INFO:teuthology.orchestra.run.smithi050.stdout:2324 punch from 0x910aea1 to 0x911708b, (0xc1ea bytes) 2024-09-05T17:31:21.001 INFO:teuthology.orchestra.run.smithi050.stdout:2325 read 0xa8b5b23 thru 0xa8c2a51 (0xcf2f bytes) 2024-09-05T17:31:21.005 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:21.006+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:21.016 INFO:teuthology.orchestra.run.smithi050.stdout:2326 writesame 0xe64b9de thru 0xe650a80 data_size 0x7(0x50a3 bytes) 2024-09-05T17:31:21.016 INFO:teuthology.orchestra.run.smithi050.stdout:2327 write 0x8e9adc4 thru 0x8ea6ba1 (0xbdde bytes) 2024-09-05T17:31:21.024 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.024 INFO:teuthology.orchestra.run.smithi050.stdout:2329 writesame 0xce2b47d thru 0xce2c80c data_size 0x8(0x1390 bytes) 2024-09-05T17:31:21.027 INFO:teuthology.orchestra.run.smithi050.stdout:2330 write 0xa086f68 thru 0xa08ba34 (0x4acd bytes) 2024-09-05T17:31:21.034 INFO:teuthology.orchestra.run.smithi050.stdout:2331 write 0x2896128 thru 0x28a1990 (0xb869 bytes) 2024-09-05T17:31:21.041 INFO:teuthology.orchestra.run.smithi050.stdout:2332 read 0xc11e6db thru 0xc1227c7 (0x40ed bytes) 2024-09-05T17:31:21.042 INFO:teuthology.orchestra.run.smithi050.stdout:2333 writesame 0xc91a574 thru 0xc91b043 data_size 0x8(0xad0 bytes) 2024-09-05T17:31:21.046 INFO:teuthology.orchestra.run.smithi050.stdout:2334 write 0x21c22c0 thru 0x21ce219 (0xbf5a bytes) 2024-09-05T17:31:21.062 INFO:teuthology.orchestra.run.smithi050.stdout:2337 write 0xea2f656 thru 0xea2f7b7 (0x162 bytes) 2024-09-05T17:31:21.070 INFO:teuthology.orchestra.run.smithi050.stdout:2338 trunc from 0xea2f7b8 to 0xcbb866b 2024-09-05T17:31:21.074 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:21.074+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:21.085 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:21.085 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:21.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:21.101 INFO:teuthology.orchestra.run.smithi050.stdout:2340 trunc from 0xcbb866b to 0x56dbd62 2024-09-05T17:31:21.127 INFO:teuthology.orchestra.run.smithi050.stdout:2341 read 0x373204f thru 0x373817e (0x6130 bytes) 2024-09-05T17:31:21.157 INFO:teuthology.orchestra.run.smithi050.stdout:2342 writesame 0xbc25258 thru 0xbc3331b data_size 0x8c(0xe0c4 bytes) 2024-09-05T17:31:21.175 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:21.174+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:21.177 INFO:teuthology.orchestra.run.smithi050.stdout:2343 write 0xec21f90 thru 0xec24f75 (0x2fe6 bytes) 2024-09-05T17:31:21.179 INFO:teuthology.orchestra.run.smithi050.stdout:2344 punch from 0xa28fcc2 to 0xa295974, (0x5cb2 bytes) 2024-09-05T17:31:21.180 INFO:teuthology.orchestra.run.smithi050.stdout:2345 writesame 0x2bb91c6 thru 0x2bc213f data_size 0x5(0x8f7a bytes) 2024-09-05T17:31:21.189 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.189 INFO:teuthology.orchestra.run.smithi050.stdout:2348 read 0xc255b35 thru 0xc25b0c1 (0x558d bytes) 2024-09-05T17:31:21.190 INFO:teuthology.orchestra.run.smithi050.stdout:2349 writesame 0x888f87 thru 0x88cfba data_size 0xe(0x4034 bytes) 2024-09-05T17:31:21.194 INFO:teuthology.orchestra.run.smithi050.stdout:2350 writesame 0x623bc04 thru 0x623f3e2 data_size 0x1(0x37df bytes) 2024-09-05T17:31:21.207 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.207 INFO:teuthology.orchestra.run.smithi050.stdout:2352 write 0xb8d0b5d thru 0xb8e0784 (0xfc28 bytes) 2024-09-05T17:31:21.215 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.231 INFO:teuthology.orchestra.run.smithi050.stdout:2354 trunc from 0xec24f76 to 0x8f4482d 2024-09-05T17:31:21.264 INFO:teuthology.orchestra.run.smithi050.stdout:2360 trunc from 0x8f4482d to 0xbcc64a8 2024-09-05T17:31:21.267 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:21.267 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:21.276 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:21.278+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:21.277 INFO:teuthology.orchestra.run.smithi050.stdout:2363 write 0x1901ec9 thru 0x1910f74 (0xf0ac bytes) 2024-09-05T17:31:21.282 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:21.283 INFO:teuthology.orchestra.run.smithi050.stdout:2364 read 0x78e9492 thru 0x78e94d1 (0x40 bytes) 2024-09-05T17:31:21.283 INFO:teuthology.orchestra.run.smithi050.stdout:2365 punch from 0x1d25a44 to 0x1d27b2c, (0x20e8 bytes) 2024-09-05T17:31:21.283 INFO:teuthology.orchestra.run.smithi050.stdout:2366 write 0x75d274d thru 0x75e23b8 (0xfc6c bytes) 2024-09-05T17:31:21.296 INFO:teuthology.orchestra.run.smithi050.stdout:2367 trunc from 0xbcc64a8 to 0xe32f808 2024-09-05T17:31:21.305 INFO:teuthology.orchestra.run.smithi050.stdout:2368 read 0x48bd544 thru 0x48c7861 (0xa31e bytes) 2024-09-05T17:31:21.306 INFO:teuthology.orchestra.run.smithi050.stdout:2369 punch from 0x636f917 to 0x637ee24, (0xf50d bytes) 2024-09-05T17:31:21.306 INFO:teuthology.orchestra.run.smithi050.stdout:2370 write 0x4f04981 thru 0x4f06810 (0x1e90 bytes) 2024-09-05T17:31:21.309 INFO:teuthology.orchestra.run.smithi050.stdout:2373 read 0x88134cc thru 0x881dfef (0xab24 bytes) 2024-09-05T17:31:21.309 INFO:teuthology.orchestra.run.smithi050.stdout:2374 write 0x8c9e393 thru 0x8cac55e (0xe1cc bytes) 2024-09-05T17:31:21.314 INFO:teuthology.orchestra.run.smithi050.stdout:2375 trunc from 0xe32f808 to 0xe5d0dd7 2024-09-05T17:31:21.323 INFO:teuthology.orchestra.run.smithi050.stdout:2376 writesame 0x4bdfcdd thru 0x4bec702 data_size 0x8a(0xca26 bytes) 2024-09-05T17:31:21.326 INFO:teuthology.orchestra.run.smithi050.stdout:2377 write 0x4c1b52e thru 0x4c1ec4a (0x371d bytes) 2024-09-05T17:31:21.329 INFO:teuthology.orchestra.run.smithi050.stdout:2378 read 0x10aa3d2 thru 0x10ab74b (0x137a bytes) 2024-09-05T17:31:21.329 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.345 INFO:teuthology.orchestra.run.smithi050.stdout:2380 trunc from 0xe5d0dd7 to 0x5efd4cc 2024-09-05T17:31:21.370 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.377 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:21.378+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:21.388 INFO:teuthology.orchestra.run.smithi050.stdout:2382 write 0xa005cfb thru 0xa007c6b (0x1f71 bytes) 2024-09-05T17:31:21.395 INFO:teuthology.orchestra.run.smithi050.stdout:2383 read 0x95c5e0d thru 0x95c6a98 (0xc8c bytes) 2024-09-05T17:31:21.396 INFO:teuthology.orchestra.run.smithi050.stdout:2384 trunc from 0xa007c6c to 0x9927d1f 2024-09-05T17:31:21.417 INFO:teuthology.orchestra.run.smithi050.stdout:2385 read 0x5687870 thru 0x5695ef3 (0xe684 bytes) 2024-09-05T17:31:21.418 INFO:teuthology.orchestra.run.smithi050.stdout:2387 write 0x2f44a7f thru 0x2f49aff (0x5081 bytes) 2024-09-05T17:31:21.421 INFO:teuthology.orchestra.run.smithi050.stdout:2388 read 0x62d309f thru 0x62df7c8 (0xc72a bytes) 2024-09-05T17:31:21.421 INFO:teuthology.orchestra.run.smithi050.stdout:2389 read 0x4431328 thru 0x4435488 (0x4161 bytes) 2024-09-05T17:31:21.421 INFO:teuthology.orchestra.run.smithi050.stdout:2390 writesame 0x4972d06 thru 0x497fc0e data_size 0x75(0xcf09 bytes) 2024-09-05T17:31:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:21.426 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:21.442 INFO:teuthology.orchestra.run.smithi050.stdout:2391 trunc from 0x9927d1f to 0x136415b 2024-09-05T17:31:21.448 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:21.478 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:21.478+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:21.483 INFO:teuthology.orchestra.run.smithi050.stdout:2392 writesame 0x5cad85a thru 0x5cb10e9 data_size 0x14(0x3890 bytes) 2024-09-05T17:31:21.511 INFO:teuthology.orchestra.run.smithi050.stdout:2393 write 0xee3d832 thru 0xee44e4c (0x761b bytes) 2024-09-05T17:31:21.515 INFO:teuthology.orchestra.run.smithi050.stdout:2394 write 0xd942065 thru 0xd94a727 (0x86c3 bytes) 2024-09-05T17:31:21.518 INFO:teuthology.orchestra.run.smithi050.stdout:2395 write 0x945f2f3 thru 0x9469c85 (0xa993 bytes) 2024-09-05T17:31:21.525 INFO:teuthology.orchestra.run.smithi050.stdout:2399 writesame 0x21ffadd thru 0x2209efc data_size 0x20(0xa420 bytes) 2024-09-05T17:31:21.546 INFO:teuthology.orchestra.run.smithi050.stdout:2400 trunc from 0xee44e4d to 0x5fcbda3 2024-09-05T17:31:21.572 INFO:teuthology.orchestra.run.smithi050.stdout:2401 write 0x6851e59 thru 0x6860949 (0xeaf1 bytes) 2024-09-05T17:31:21.578 INFO:teuthology.orchestra.run.smithi050.stdout:2402 punch from 0x4fe9c32 to 0x4ff7eac, (0xe27a bytes) 2024-09-05T17:31:21.578 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:21.578+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:21.592 INFO:teuthology.orchestra.run.smithi050.stdout:2403 write 0x86fe1a3 thru 0x870ac99 (0xcaf7 bytes) 2024-09-05T17:31:21.597 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.602 INFO:teuthology.orchestra.run.smithi050.stdout:2405 trunc from 0x870ac9a to 0xbd8f2e2 2024-09-05T17:31:21.611 INFO:teuthology.orchestra.run.smithi050.stdout:2406 writesame 0xbbccaea thru 0xbbce566 data_size 0x1(0x1a7d bytes) 2024-09-05T17:31:21.620 INFO:teuthology.orchestra.run.smithi050.stdout:2407 punch from 0x4fa30c2 to 0x4fa3357, (0x295 bytes) 2024-09-05T17:31:21.620 INFO:teuthology.orchestra.run.smithi050.stdout:2408 read 0x6659177 thru 0x6665fbf (0xce49 bytes) 2024-09-05T17:31:21.621 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:31:21.621 INFO:teuthology.orchestra.run.smithi050.stdout:2409 read 0x2bdbf9c thru 0x2be14cf (0x5534 bytes) 2024-09-05T17:31:21.625 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:21.625 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:21.634 INFO:teuthology.orchestra.run.smithi050.stdout:2410 trunc from 0xbd8f2e2 to 0x6d4d4ed 2024-09-05T17:31:21.651 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:21.660 INFO:teuthology.orchestra.run.smithi050.stdout:2411 write 0x8cfdf73 thru 0x8d01d48 (0x3dd6 bytes) 2024-09-05T17:31:21.674 INFO:teuthology.orchestra.run.smithi050.stdout:2412 trunc from 0x8d01d49 to 0x11b3d07 2024-09-05T17:31:21.679 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:21.678+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:21.689 INFO:teuthology.orchestra.run.smithi050.stdout:2414 punch from 0xdf0558 to 0xdf5f38, (0x59e0 bytes) 2024-09-05T17:31:21.689 INFO:teuthology.orchestra.run.smithi050.stdout:2415 read 0x87c2e4 thru 0x88b017 (0xed34 bytes) 2024-09-05T17:31:21.705 INFO:teuthology.orchestra.run.smithi050.stdout:2416 write 0x4700061 thru 0x47082af (0x824f bytes) 2024-09-05T17:31:21.710 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.710 INFO:teuthology.orchestra.run.smithi050.stdout:2422 punch from 0x467c953 to 0x467edb6, (0x2463 bytes) 2024-09-05T17:31:21.719 INFO:teuthology.orchestra.run.smithi050.stdout:2423 writesame 0x5fe98be thru 0x5fee47d data_size 0x40(0x4bc0 bytes) 2024-09-05T17:31:21.735 INFO:teuthology.orchestra.run.smithi050.stdout:2425 writesame 0xc4f4d14 thru 0xc4fbdc1 data_size 0x1(0x70ae bytes) 2024-09-05T17:31:21.740 INFO:teuthology.orchestra.run.smithi050.stdout:2426 trunc from 0xc4fbdc2 to 0xd87ee96 2024-09-05T17:31:21.747 INFO:teuthology.orchestra.run.smithi050.stdout:2427 read 0xc552bd1 thru 0xc561865 (0xec95 bytes) 2024-09-05T17:31:21.748 INFO:teuthology.orchestra.run.smithi050.stdout:2428 punch from 0xb6d5abe to 0xb6dcb7a, (0x70bc bytes) 2024-09-05T17:31:21.748 INFO:teuthology.orchestra.run.smithi050.stdout:2429 write 0xb6a9880 thru 0xb6b52f8 (0xba79 bytes) 2024-09-05T17:31:21.753 INFO:teuthology.orchestra.run.smithi050.stdout:2430 write 0x97fb895 thru 0x9808af2 (0xd25e bytes) 2024-09-05T17:31:21.759 INFO:teuthology.orchestra.run.smithi050.stdout:2431 punch from 0x9aa2ab6 to 0x9aad622, (0xab6c bytes) 2024-09-05T17:31:21.760 INFO:teuthology.orchestra.run.smithi050.stdout:2432 read 0x77eb260 thru 0x77f1ca7 (0x6a48 bytes) 2024-09-05T17:31:21.760 INFO:teuthology.orchestra.run.smithi050.stdout:2433 punch from 0xb6385eb to 0xb63dce0, (0x56f5 bytes) 2024-09-05T17:31:21.760 INFO:teuthology.orchestra.run.smithi050.stdout:2436 write 0xa307185 thru 0xa30fd3d (0x8bb9 bytes) 2024-09-05T17:31:21.766 INFO:teuthology.orchestra.run.smithi050.stdout:2437 write 0x68e55bc thru 0x68e85d3 (0x3018 bytes) 2024-09-05T17:31:21.771 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.776 INFO:teuthology.orchestra.run.smithi050.stdout:2439 trunc from 0xd87ee96 to 0xa1cfbca 2024-09-05T17:31:21.780 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:21.782+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:21.794 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:21.794 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:21.803 INFO:teuthology.orchestra.run.smithi050.stdout:2440 write 0xd3c74a7 thru 0xd3ceac4 (0x761e bytes) 2024-09-05T17:31:21.806 INFO:teuthology.orchestra.run.smithi050.stdout:2442 punch from 0x5f851e2 to 0x5f8c680, (0x749e bytes) 2024-09-05T17:31:21.806 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:21.812 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:21.816 INFO:teuthology.orchestra.run.smithi050.stdout:2444 write 0xe60f5ef thru 0xe61e17c (0xeb8e bytes) 2024-09-05T17:31:21.821 INFO:teuthology.orchestra.run.smithi050.stdout:2445 read 0xd3b5d84 thru 0xd3bb7f6 (0x5a73 bytes) 2024-09-05T17:31:21.822 INFO:teuthology.orchestra.run.smithi050.stdout:2446 write 0x47111af thru 0x47181eb (0x703d bytes) 2024-09-05T17:31:21.841 INFO:teuthology.orchestra.run.smithi050.stdout:2448 trunc from 0xe61e17d to 0x49277ac 2024-09-05T17:31:21.867 INFO:teuthology.orchestra.run.smithi050.stdout:2450 trunc from 0x49277ac to 0x9dbdabb 2024-09-05T17:31:21.874 INFO:teuthology.orchestra.run.smithi050.stdout:2451 write 0x2acfcbe thru 0x2ad6246 (0x6589 bytes) 2024-09-05T17:31:21.877 INFO:teuthology.orchestra.run.smithi050.stdout:2452 read 0x894162a thru 0x8949ef3 (0x88ca bytes) 2024-09-05T17:31:21.881 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:21.878+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:21.891 INFO:teuthology.orchestra.run.smithi050.stdout:2453 write 0xdd13799 thru 0xdd1488b (0x10f3 bytes) 2024-09-05T17:31:21.894 INFO:teuthology.orchestra.run.smithi050.stdout:2455 read 0x1461d88 thru 0x14716fe (0xf977 bytes) 2024-09-05T17:31:21.894 INFO:teuthology.orchestra.run.smithi050.stdout:2456 punch from 0x9a67d47 to 0x9a7122b, (0x94e4 bytes) 2024-09-05T17:31:21.903 INFO:teuthology.orchestra.run.smithi050.stdout:2457 write 0xe994588 thru 0xe99fa27 (0xb4a0 bytes) 2024-09-05T17:31:21.907 INFO:teuthology.orchestra.run.smithi050.stdout:2459 writesame 0xd976f95 thru 0xd983709 data_size 0x1(0xc775 bytes) 2024-09-05T17:31:21.942 INFO:teuthology.orchestra.run.smithi050.stdout:2460 write 0xd7adc5d thru 0xd7b3354 (0x56f8 bytes) 2024-09-05T17:31:21.946 INFO:teuthology.orchestra.run.smithi050.stdout:2461 read 0xb1603b0 thru 0xb16513a (0x4d8b bytes) 2024-09-05T17:31:21.946 INFO:teuthology.orchestra.run.smithi050.stdout:2463 write 0xc730adb thru 0xc73973e (0x8c64 bytes) 2024-09-05T17:31:21.949 INFO:teuthology.orchestra.run.smithi050.stdout:2464 write 0x7a428f8 thru 0x7a4b5b7 (0x8cc0 bytes) 2024-09-05T17:31:21.956 INFO:teuthology.orchestra.run.smithi050.stdout:2466 write 0xe61bd7d thru 0xe626ae7 (0xad6b bytes) 2024-09-05T17:31:21.964 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:21.965 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:21.977 INFO:teuthology.orchestra.run.smithi050.stdout:2467 trunc from 0xe99fa28 to 0x5bb450b 2024-09-05T17:31:21.982 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:21.982+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:21.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:22.011 INFO:teuthology.orchestra.run.smithi050.stdout:2468 write 0xb7c6406 thru 0xb7d5799 (0xf394 bytes) 2024-09-05T17:31:22.015 INFO:teuthology.orchestra.run.smithi050.stdout:2469 read 0x9fcc49a thru 0x9fce473 (0x1fda bytes) 2024-09-05T17:31:22.015 INFO:teuthology.orchestra.run.smithi050.stdout:2470 write 0x32b1ce0 thru 0x32bfbb6 (0xded7 bytes) 2024-09-05T17:31:22.019 INFO:teuthology.orchestra.run.smithi050.stdout:2471 writesame 0xad2a26c thru 0xad2a566 data_size 0x1(0x2fb bytes) 2024-09-05T17:31:22.025 INFO:teuthology.orchestra.run.smithi050.stdout:2472 punch from 0xb26d261 to 0xb271a51, (0x47f0 bytes) 2024-09-05T17:31:22.025 INFO:teuthology.orchestra.run.smithi050.stdout:2473 write 0xa01526 thru 0xa083b2 (0x6e8d bytes) 2024-09-05T17:31:22.028 INFO:teuthology.orchestra.run.smithi050.stdout:2474 write 0x2d0a374 thru 0x2d16b66 (0xc7f3 bytes) 2024-09-05T17:31:22.032 INFO:teuthology.orchestra.run.smithi050.stdout:2475 punch from 0xb1e67c to 0xb25d41, (0x76c5 bytes) 2024-09-05T17:31:22.032 INFO:teuthology.orchestra.run.smithi050.stdout:2476 trunc from 0xb7d579a to 0xb819072 2024-09-05T17:31:22.039 INFO:teuthology.orchestra.run.smithi050.stdout:2477 write 0x3d3807a thru 0x3d3daf2 (0x5a79 bytes) 2024-09-05T17:31:22.041 INFO:teuthology.orchestra.run.smithi050.stdout:2480 punch from 0x6623ad7 to 0x662bf65, (0x848e bytes) 2024-09-05T17:31:22.041 INFO:teuthology.orchestra.run.smithi050.stdout:2481 punch from 0x3e0e05 to 0x3e82a2, (0x749d bytes) 2024-09-05T17:31:22.042 INFO:teuthology.orchestra.run.smithi050.stdout:2482 writesame 0x60c739b thru 0x60d47fe data_size 0x5c(0xd464 bytes) 2024-09-05T17:31:22.048 INFO:teuthology.orchestra.run.smithi050.stdout:2485 read 0x2117f99 thru 0x2122677 (0xa6df bytes) 2024-09-05T17:31:22.055 INFO:teuthology.orchestra.run.smithi050.stdout:2489 write 0xba8cc01 thru 0xba928d4 (0x5cd4 bytes) 2024-09-05T17:31:22.058 INFO:teuthology.orchestra.run.smithi050.stdout:2490 punch from 0x693b1aa to 0x693e2b6, (0x310c bytes) 2024-09-05T17:31:22.058 INFO:teuthology.orchestra.run.smithi050.stdout:2491 read 0x4afacdb thru 0x4b05274 (0xa59a bytes) 2024-09-05T17:31:22.059 INFO:teuthology.orchestra.run.smithi050.stdout:2492 writesame 0x1b769f3 thru 0x1b83d11 data_size 0x7(0xd31f bytes) 2024-09-05T17:31:22.065 INFO:teuthology.orchestra.run.smithi050.stdout:2493 punch from 0x117269f to 0x117e945, (0xc2a6 bytes) 2024-09-05T17:31:22.065 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:22.073 INFO:teuthology.orchestra.run.smithi050.stdout:2497 trunc from 0xba928d5 to 0x79c14f7 2024-09-05T17:31:22.083 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:22.082+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:22.108 INFO:teuthology.orchestra.run.smithi050.stdout:2498 writesame 0xc0a0349 thru 0xc0aed2d data_size 0x3(0xe9e5 bytes) 2024-09-05T17:31:22.126 INFO:teuthology.orchestra.run.smithi050.stdout:2499 write 0xee67162 thru 0xee6b27f (0x411e bytes) 2024-09-05T17:31:22.156 INFO:teuthology.orchestra.run.smithi050.stdout:2503 trunc from 0xee6b280 to 0x1796d66 2024-09-05T17:31:22.157 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:22.157 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:22.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:22.184 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:22.186+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:22.202 INFO:teuthology.orchestra.run.smithi050.stdout:2504 trunc from 0x1796d66 to 0xd00cc34 2024-09-05T17:31:22.210 INFO:teuthology.orchestra.run.smithi050.stdout:2505 write 0xbb778c thru 0xbbf1d8 (0x7a4d bytes) 2024-09-05T17:31:22.215 INFO:teuthology.orchestra.run.smithi050.stdout:2506 write 0xbf7c22d thru 0xbf8814d (0xbf21 bytes) 2024-09-05T17:31:22.220 INFO:teuthology.orchestra.run.smithi050.stdout:2507 write 0x5f09c56 thru 0x5f183da (0xe785 bytes) 2024-09-05T17:31:22.229 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:22.229 INFO:teuthology.orchestra.run.smithi050.stdout:2509 writesame 0x621e988 thru 0x6225551 data_size 0x2a(0x6bca bytes) 2024-09-05T17:31:22.245 INFO:teuthology.orchestra.run.smithi050.stdout:2510 write 0xead68a1 thru 0xeae2a63 (0xc1c3 bytes) 2024-09-05T17:31:22.250 INFO:teuthology.orchestra.run.smithi050.stdout:2511 writesame 0xbd0f95a thru 0xbd1b3d8 data_size 0x1(0xba7f bytes) 2024-09-05T17:31:22.272 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:22.272 INFO:teuthology.orchestra.run.smithi050.stdout:2513 read 0x9f38715 thru 0x9f41cb7 (0x95a3 bytes) 2024-09-05T17:31:22.272 INFO:teuthology.orchestra.run.smithi050.stdout:2516 read 0xe4932d4 thru 0xe497525 (0x4252 bytes) 2024-09-05T17:31:22.272 INFO:teuthology.orchestra.run.smithi050.stdout:2517 read 0xce24530 thru 0xce24aa6 (0x577 bytes) 2024-09-05T17:31:22.273 INFO:teuthology.orchestra.run.smithi050.stdout:2519 punch from 0x4d6098a to 0x4d68dd5, (0x844b bytes) 2024-09-05T17:31:22.273 INFO:teuthology.orchestra.run.smithi050.stdout:2522 clone 12 order 25 su 262144 sc 12 2024-09-05T17:31:22.284 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:22.282+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:22.332 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:22.332 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:22.346 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:22.386 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:22.386+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:22.487 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:22.486+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:22.524 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:22.524 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:22.538 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:22.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:22.627 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:22.626+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:22.663 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:22.663 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:22.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:22.688 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:22.686+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:22.747 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone11 from 0xeae2a64 (overlap 0x10b69e1) to 0x6af726 2024-09-05T17:31:22.758 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:22.758 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:22.778 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:22.779 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:22.788 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:22.790+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:22.811 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:22.812 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:22.834 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:22.834 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:22.835 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-05T17:31:22.852 INFO:teuthology.orchestra.run.smithi050.stdout:2524 trunc from 0xeae2a64 to 0x58d099c 2024-09-05T17:31:22.868 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:22.868 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:22.875 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4257.0:1 2.3 e20/19 2:c4c92e5a:::rbd_trash:head v 20'1, mlcod=0'0)", 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.827702141000003, 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002468479, 2024-09-05T17:31:22.876 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049863+0000", 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049864+0000", 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0800000000000004e-07 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049878+0000", 2024-09-05T17:31:22.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4165000000000001e-05 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049896+0000", 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8436000000000001e-05 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.049914+0000", 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7229999999999999e-05 2024-09-05T17:31:22.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050094+0000", 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000180564 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.050134+0000", 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9595000000000003e-05 2024-09-05T17:31:22.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052268+0000", 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021347580000000001 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:32.052332+0000", 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3022999999999996e-05 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.631251710999997, 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:31:22.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:31:22.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3604 3.4 e28/24 3:27555207:::rbd_data.114070605229.00000000000000e7:head v 28'21, mlcod=28'19)", 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:22.887 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.429261992000001, 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028585849999999999, 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448303+0000", 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448306+0000", 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448357+0000", 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0719e-05 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448402+0000", 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5166000000000001e-05 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448426+0000", 2024-09-05T17:31:22.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3813999999999999e-05 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448574+0000", 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014806500000000001 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.448613+0000", 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8353999999999999e-05 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451052+0000", 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024396909999999999 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.451162+0000", 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109533 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.892 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:7801 3.0 e30/24 3:00d91651:::rbd_data.1140d4ae3aec.0000000000000025:head v 30'105, mlcod=30'102)", 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.540577012, 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022194089999999999, 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336988+0000", 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.336989+0000", 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.316e-06 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337179+0000", 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018963199999999999 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337195+0000", 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5880999999999999e-05 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337202+0000", 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3189999999999997e-06 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337272+0000", 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9333999999999997e-05 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.337289+0000", 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7445999999999999e-05 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339156+0000", 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001866988 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:55.339208+0000", 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1493000000000003e-05 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:12781 3.4 e33/24 3:2593df46:::rbd_data.11403aa71fdc.00000000000002f3:head v 33'79, mlcod=30'76)", 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.853295590999998, 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019698900000000002, 2024-09-05T17:31:22.898 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024270+0000", 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024272+0000", 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3889999999999999e-06 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024292+0000", 2024-09-05T17:31:22.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0434000000000001e-05 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024324+0000", 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1615000000000001e-05 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024338+0000", 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:22.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024491+0000", 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015269900000000001 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.024555+0000", 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3398000000000005e-05 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026149+0000", 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00159431 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.026239+0000", 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0637000000000007e-05 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27251 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'174, mlcod=36'172)", 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.658621963999998, 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025164060000000001, 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218943+0000", 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218944+0000", 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.057e-06 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218953+0000", 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5369999999999997e-06 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218974+0000", 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0772e-05 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.218986+0000", 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:22.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219118+0000", 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132638 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.219177+0000", 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8270000000000003e-05 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221306+0000", 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002128956 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.221460+0000", 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000153991 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27272 3.9 e36/24 3:961ac59e:::rbd_data.1140f3505917.000000000000023a:head v 36'186, mlcod=36'184)", 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.60837003, 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026438630000000002, 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.909 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269195+0000", 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.269196+0000", 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2610000000000001e-06 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270692+0000", 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001495365 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270721+0000", 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9036000000000001e-05 2024-09-05T17:31:22.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270736+0000", 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4979e-05 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270814+0000", 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.8010999999999996e-05 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.270836+0000", 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2651999999999999e-05 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271799+0000", 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00096227200000000002 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.271839+0000", 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0287000000000002e-05 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27439 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'228, mlcod=36'226)", 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.300449319999998, 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031113629999999998, 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577119+0000", 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7549999999999999e-06 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577132+0000", 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3699e-05 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577165+0000", 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2645999999999999e-05 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577181+0000", 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5764999999999999e-05 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577311+0000", 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013032399999999999 2024-09-05T17:31:22.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577375+0000", 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3532000000000001e-05 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580116+0000", 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027411520000000002 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580227+0000", 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011149 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27440 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'229, mlcod=36'226)", 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.298758962000001, 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022421120000000001, 2024-09-05T17:31:22.919 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578806+0000", 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578808+0000", 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0499999999999999e-06 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578823+0000", 2024-09-05T17:31:22.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4290999999999999e-05 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578855+0000", 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2682999999999999e-05 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.578875+0000", 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9881000000000002e-05 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579029+0000", 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015355499999999999 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.579173+0000", 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014394599999999999 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580954+0000", 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001781134 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.581048+0000", 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4572000000000002e-05 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27516 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'242, mlcod=36'240)", 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.096651954999999, 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001967735, 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.925 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780913+0000", 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780916+0000", 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2790000000000001e-06 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780930+0000", 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4914e-05 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780958+0000", 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7217e-05 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.780972+0000", 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4456e-05 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781128+0000", 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015544699999999999 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.781166+0000", 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8868999999999997e-05 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782803+0000", 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016366519999999999 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.782881+0000", 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7900999999999998e-05 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27750 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'288, mlcod=36'286)", 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.693314138000002, 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021578209999999999, 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184251+0000", 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184254+0000", 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0699999999999998e-06 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184272+0000", 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8284e-05 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184311+0000", 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8995999999999997e-05 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184329+0000", 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8077999999999999e-05 2024-09-05T17:31:22.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184507+0000", 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000177035 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.184573+0000", 2024-09-05T17:31:22.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6729000000000004e-05 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186301+0000", 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017280279999999999 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.186409+0000", 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107601 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.935 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27759 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'289, mlcod=36'287)", 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.679505681999999, 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026394679999999998, 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198059+0000", 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198063+0000", 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0570000000000001e-06 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198077+0000", 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4270999999999999e-05 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198112+0000", 2024-09-05T17:31:22.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4953000000000002e-05 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198127+0000", 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5597999999999999e-05 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198290+0000", 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000162631 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.198352+0000", 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1796000000000003e-05 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200559+0000", 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022068579999999999 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.200699+0000", 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000140304 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:30784 3.9 e37/24 3:9275f381:::rbd_data.1140f3505917.00000000000001d4:head v 37'308, mlcod=37'305)", 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.992288655999999, 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023488469999999998, 2024-09-05T17:31:22.941 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885277+0000", 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1399999999999995e-07 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885285+0000", 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7810000000000005e-06 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885300+0000", 2024-09-05T17:31:22.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4833e-05 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885308+0000", 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5769999999999996e-06 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885748+0000", 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00044075899999999999 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.885769+0000", 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0922999999999999e-05 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.887576+0000", 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0018066359999999999 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:05.887625+0000", 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9424e-05 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34616 3.0 e40/24 3:026e24ed:::rbd_data.11404462ede9.0000000000000037:head v 40'154, mlcod=39'152)", 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.905380509, 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019695590000000001, 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972185+0000", 2024-09-05T17:31:22.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972187+0000", 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4849999999999999e-06 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972224+0000", 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6563999999999998e-05 2024-09-05T17:31:22.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972254+0000", 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0772000000000003e-05 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972267+0000", 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2728000000000001e-05 2024-09-05T17:31:22.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972388+0000", 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120797 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.972430+0000", 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2023000000000001e-05 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.974032+0000", 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0016015840000000001 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:09.974154+0000", 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012260600000000001 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34666 3.0 e40/24 3:002dc5db:::rbd_data.11404462ede9.0000000000000009:head v 40'156, mlcod=40'154)", 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.779105101000001, 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0022195069999999999, 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098460+0000", 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098462+0000", 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0490000000000002e-06 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098473+0000", 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1297999999999999e-05 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098503+0000", 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9904999999999999e-05 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.098516+0000", 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2435e-05 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.099032+0000", 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00051637500000000002 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.099068+0000", 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5559999999999998e-05 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.100613+0000", 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015457159999999999 2024-09-05T17:31:22.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.100680+0000", 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6168999999999996e-05 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34899 3.4 e40/24 3:21eb45c5:::rbd_data.11404462ede9.0000000000000026:head v 40'111, mlcod=40'109)", 2024-09-05T17:31:22.957 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.274147867, 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003148802, 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:22.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603420+0000", 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603437+0000", 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6891000000000001e-05 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603479+0000", 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2222999999999999e-05 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603501+0000", 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1297999999999998e-05 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603838+0000", 2024-09-05T17:31:22.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033740899999999999 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603900+0000", 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2150000000000006e-05 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.606418+0000", 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025176560000000001 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.606566+0000", 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148355 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34903 3.4 e40/24 3:23501bd1:::rbd_data.11404462ede9.0000000000000030:head v 40'112, mlcod=40'109)", 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:22.963 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.272686634999999, 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023817030000000002, 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604879+0000", 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604880+0000", 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.141e-06 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604893+0000", 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.33e-05 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604914+0000", 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1438e-05 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.604925+0000", 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0730000000000001e-05 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.605156+0000", 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023070499999999999 2024-09-05T17:31:22.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.605186+0000", 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0306000000000001e-05 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.607152+0000", 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019654210000000002 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.607260+0000", 2024-09-05T17:31:22.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108662 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34979 3.0 e40/24 3:058d46e1:::rbd_data.11404462ede9.0000000000000072:head v 40'158, mlcod=40'156)", 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.158209819, 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002034831, 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.968 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719355+0000", 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719358+0000", 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0429999999999999e-06 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719401+0000", 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2642999999999998e-05 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719441+0000", 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0031999999999999e-05 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719513+0000", 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1829000000000006e-05 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719722+0000", 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020864899999999999 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.719779+0000", 2024-09-05T17:31:22.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7377999999999999e-05 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.721306+0000", 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0015273419999999999 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.721390+0000", 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3914999999999999e-05 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.972 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.110308861, 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:31:22.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:31:22.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47373 3.0 e49/24 3:06c812ca:::rbd_data.1140bd729420.0000000000000013:head v 49'184, mlcod=48'181)", 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.783117+0000", 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.094448399, 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00256113, 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.783117+0000", 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.783117+0000", 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.783119+0000", 2024-09-05T17:31:22.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6129999999999998e-06 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.783134+0000", 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4995e-05 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.783172+0000", 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7771000000000001e-05 2024-09-05T17:31:22.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.783193+0000", 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1098e-05 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.783352+0000", 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158484 2024-09-05T17:31:22.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.783409+0000", 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7262999999999997e-05 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.785532+0000", 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021229769999999999 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:22.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.785678+0000", 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014592899999999999 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:22.983 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:22.985 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:22.986 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:22.986 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:22.986 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:22.987 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:22.987 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:22.988 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:22.988 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:22.982+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:22.989 INFO:teuthology.orchestra.run.smithi050.stdout:2525 write 0x5727cce thru 0x5729dab (0x20de bytes) 2024-09-05T17:31:22.991 INFO:teuthology.orchestra.run.smithi050.stdout:2527 clone 13 order 22 su 2097152 sc 15 2024-09-05T17:31:23.086 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:23.086+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:23.105 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:23.105 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:23.105 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:23.105 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:23.119 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:23.206 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:23.206+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:23.285 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:23.285 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:23.285 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:23.285 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:23.285 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:23.289 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:23.286+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:23.299 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:23.391 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:23.390+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:23.478 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.270533138000001, 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.479 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:23.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:31:23.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:31:23.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.269511811000001, 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:31:23.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:31:23.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.268423313, 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.489 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.267402801999999, 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:31:23.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:23.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:31:23.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:31:23.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:31:23.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.266375853, 2024-09-05T17:31:23.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:23.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:31:23.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:31:23.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.504 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.264033255000001, 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.259081082000002, 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:23.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:31:23.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13418 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6023168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.258485182000001, 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14037719400000001, 2024-09-05T17:31:23.514 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13418 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221572+0000", 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034026199999999998 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221584+0000", 2024-09-05T17:31:23.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1321999999999999e-05 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221603+0000", 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9344e-05 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221615+0000", 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1565e-05 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361125+0000", 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139510734 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361358+0000", 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023231599999999999 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361609+0000", 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025165099999999998 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.518 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.258081099000002, 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.519 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:31:23.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.520 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:23.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:31:23.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:31:23.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.257475700000001, 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:31:23.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:31:23.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.256416571999999, 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.531 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:31:23.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.531 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:23.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:31:23.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:23.535 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.255775288999999, 2024-09-05T17:31:23.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:31:23.536 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.536 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.536 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.536 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:31:23.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:31:23.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.255180395, 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.541 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.542 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.542 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.542 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.542 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:31:23.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.542 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:31:23.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.546 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.254115201000001, 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.547 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:31:23.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.253474511, 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.552 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:31:23.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.253023810999998, 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.556 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:23.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:31:23.560 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.252378067999999, 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.561 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:31:23.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.252006049999999, 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:31:23.565 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:31:23.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:31:23.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.251364996, 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:31:23.570 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:23.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:31:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:31:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:31:23.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:31:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:31:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:31:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:31:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:31:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:31:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:31:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:31:23.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 24.250766466999998, 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:23.577 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:23.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:23.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:23.582 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:23.584 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:23.585 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:23.582+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:23.656 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:31:23.684 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:23.686+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:23.718 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:23.719 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:23.719 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:23.733 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:23.786 INFO:teuthology.orchestra.run.smithi050.stdout:flattening image image_client.0-clone12 2024-09-05T17:31:23.820 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:23.822+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:23.886 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:23.886+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:23.901 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:23.902 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:23.902 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:23.902 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:23.902 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:23.910 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-05T17:31:23.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:23.934 INFO:teuthology.orchestra.run.smithi050.stdout:2528 read 0xd6d2d4 thru 0xd72a9e (0x57cb bytes) 2024-09-05T17:31:23.936 INFO:teuthology.orchestra.run.smithi050.stdout:2529 read 0x53cd0b9 thru 0x53d3fa5 (0x6eed bytes) 2024-09-05T17:31:23.958 INFO:teuthology.orchestra.run.smithi050.stdout:2532 writesame 0x985c397 thru 0x98695c7 data_size 0x1(0xd231 bytes) 2024-09-05T17:31:23.962 INFO:teuthology.orchestra.run.smithi050.stdout:2533 trunc from 0x98695c8 to 0x6d269d8 2024-09-05T17:31:23.987 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:23.986+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:23.999 INFO:teuthology.orchestra.run.smithi050.stdout:2535 writesame 0x912cdb3 thru 0x913ab3f data_size 0x1(0xdd8d bytes) 2024-09-05T17:31:23.999 INFO:teuthology.orchestra.run.smithi050.stdout:2536 write 0x43f0c43 thru 0x43f20f2 (0x14b0 bytes) 2024-09-05T17:31:24.005 INFO:teuthology.orchestra.run.smithi050.stdout:2537 write 0x6ea7f13 thru 0x6eaf93f (0x7a2d bytes) 2024-09-05T17:31:24.008 INFO:teuthology.orchestra.run.smithi050.stdout:2538 write 0xced023 thru 0xcf5d1f (0x8cfd bytes) 2024-09-05T17:31:24.017 INFO:teuthology.orchestra.run.smithi050.stdout:2539 write 0x307bedd thru 0x307ed74 (0x2e98 bytes) 2024-09-05T17:31:24.025 INFO:teuthology.orchestra.run.smithi050.stdout:2540 read 0x91387ac thru 0x913ab3f (0x2394 bytes) 2024-09-05T17:31:24.041 INFO:teuthology.orchestra.run.smithi050.stdout:2542 write 0xe1558fc thru 0xe15ff8e (0xa693 bytes) 2024-09-05T17:31:24.048 INFO:teuthology.orchestra.run.smithi050.stdout:2543 read 0xdc93328 thru 0xdc968f0 (0x35c9 bytes) 2024-09-05T17:31:24.048 INFO:teuthology.orchestra.run.smithi050.stdout:2544 write 0xca34568 thru 0xca41e1d (0xd8b6 bytes) 2024-09-05T17:31:24.053 INFO:teuthology.orchestra.run.smithi050.stdout:2545 trunc from 0xe15ff8f to 0xe45ba0e 2024-09-05T17:31:24.061 INFO:teuthology.orchestra.run.smithi050.stdout:2547 writesame 0x9a7abf3 thru 0x9a7d77f data_size 0x1(0x2b8d bytes) 2024-09-05T17:31:24.070 INFO:teuthology.orchestra.run.smithi050.stdout:2548 write 0x69b5fab thru 0x69c5d0f (0xfd65 bytes) 2024-09-05T17:31:24.082 INFO:teuthology.orchestra.run.smithi050.stdout:2549 trunc from 0xe45ba0e to 0xbd858f8 2024-09-05T17:31:24.088 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:24.090+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:24.096 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.392390678000002, 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:24.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.101 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.392343294, 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:31:24.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.392298621999998, 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:31:24.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:31:24.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.392253279999998, 2024-09-05T17:31:24.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:31:24.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:31:24.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:31:24.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:31:24.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:31:24.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:31:24.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:31:24.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.392184270000001, 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.116 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.120 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.392135833000001, 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:31:24.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.392089474999999, 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.125 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:31:24.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.391426885000001, 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.130 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:31:24.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.391335539, 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.135 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:31:24.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.391274059000001, 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:24.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.391217159, 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:31:24.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:31:24.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:31:24.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.391123918000002, 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:24.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:31:24.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:31:24.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:24.152 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.39106439, 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:24.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.383908428000002, 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.157 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.383846961, 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:31:24.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:31:24.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.165 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.381978992000001, 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:31:24.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:31:24.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:31:24.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.381938481999999, 2024-09-05T17:31:24.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:31:24.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:31:24.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.381900015999999, 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.175 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:31:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:31:24.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.381841908999998, 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:31:24.179 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:31:24.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.183 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.381784608, 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.184 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:31:24.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:31:24.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.188 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:2550 writesame 0x8263ac4 thru 0x826f84e data_size 0x1(0xbd8b bytes) 2024-09-05T17:31:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:2554 write 0xa6a9330 thru 0xa6a9f4a (0xc1b bytes) 2024-09-05T17:31:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:2555 writesame 0x1eb862 thru 0x1eefb4 data_size 0x1(0x3753 bytes) 2024-09-05T17:31:24.190 INFO:teuthology.orchestra.run.smithi050.stdout:2556 trunc from 0xbd858f8 to 0xc63890 2024-09-05T17:31:24.190 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:24.186+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:24.191 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:24.254 INFO:teuthology.orchestra.run.smithi050.stdout:2557 read 0x78b0b5 thru 0x793005 (0x7f51 bytes) 2024-09-05T17:31:24.277 INFO:teuthology.orchestra.run.smithi050.stdout:2558 trunc from 0xc63890 to 0x9a8e42d 2024-09-05T17:31:24.290 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:24.290+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:24.303 INFO:teuthology.orchestra.run.smithi050.stdout:2559 trunc from 0x9a8e42d to 0xe6e2410 2024-09-05T17:31:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:2560 punch from 0x1dd995d to 0x1de6e07, (0xd4aa bytes) 2024-09-05T17:31:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:2561 read 0x75778e2 thru 0x7581931 (0xa050 bytes) 2024-09-05T17:31:24.317 INFO:teuthology.orchestra.run.smithi050.stdout:2564 write 0x71e7f89 thru 0x71ece02 (0x4e7a bytes) 2024-09-05T17:31:24.324 INFO:teuthology.orchestra.run.smithi050.stdout:2565 write 0x6208463 thru 0x6209344 (0xee2 bytes) 2024-09-05T17:31:24.331 INFO:teuthology.orchestra.run.smithi050.stdout:2566 read 0x7ebcc3e thru 0x7ecbce7 (0xf0aa bytes) 2024-09-05T17:31:24.331 INFO:teuthology.orchestra.run.smithi050.stdout:2568 writesame 0x1e2ecee thru 0x1e339e7 data_size 0x3b(0x4cfa bytes) 2024-09-05T17:31:24.335 INFO:teuthology.orchestra.run.smithi050.stdout:2569 write 0x73b2cb8 thru 0x73b584f (0x2b98 bytes) 2024-09-05T17:31:24.343 INFO:teuthology.orchestra.run.smithi050.stdout:2571 write 0x19b72f5 thru 0x19bf667 (0x8373 bytes) 2024-09-05T17:31:24.352 INFO:teuthology.orchestra.run.smithi050.stdout:2572 read 0xa071770 thru 0xa0811f8 (0xfa89 bytes) 2024-09-05T17:31:24.352 INFO:teuthology.orchestra.run.smithi050.stdout:2573 write 0xb541a92 thru 0xb5494b3 (0x7a22 bytes) 2024-09-05T17:31:24.359 INFO:teuthology.orchestra.run.smithi050.stdout:2574 read 0x8a9d6db thru 0x8aa4e03 (0x7729 bytes) 2024-09-05T17:31:24.360 INFO:teuthology.orchestra.run.smithi050.stdout:2575 punch from 0x9be0be9 to 0x9bebf4f, (0xb366 bytes) 2024-09-05T17:31:24.361 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:24.362 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:24.362 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:24.362 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:24.376 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:24.378 INFO:teuthology.orchestra.run.smithi050.stdout:2576 trunc from 0xe6e2410 to 0x7a3da48 2024-09-05T17:31:24.392 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:24.390+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:24.432 INFO:teuthology.orchestra.run.smithi050.stdout:2577 writesame 0xdd1f786 thru 0xdd250db data_size 0x5(0x5956 bytes) 2024-09-05T17:31:24.433 INFO:teuthology.orchestra.run.smithi050.stdout:2578 writesame 0xc55e27f thru 0xc56dae3 data_size 0x1(0xf865 bytes) 2024-09-05T17:31:24.472 INFO:teuthology.orchestra.run.smithi050.stdout:2580 punch from 0xa201867 to 0xa205aed, (0x4286 bytes) 2024-09-05T17:31:24.472 INFO:teuthology.orchestra.run.smithi050.stdout:2581 write 0xb3b30db thru 0xb3b763b (0x4561 bytes) 2024-09-05T17:31:24.478 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.478 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.478 INFO:teuthology.orchestra.run.smithi050.stdout:2584 writesame 0x5453a50 thru 0x5455e62 data_size 0x1(0x2413 bytes) 2024-09-05T17:31:24.491 INFO:teuthology.orchestra.run.smithi050.stdout:2585 read 0x6513011 thru 0x651f882 (0xc872 bytes) 2024-09-05T17:31:24.491 INFO:teuthology.orchestra.run.smithi050.stdout:2587 read 0x8d39059 thru 0x8d43ed3 (0xae7b bytes) 2024-09-05T17:31:24.491 INFO:teuthology.orchestra.run.smithi050.stdout:2590 writesame 0x41583d8 thru 0x415f214 data_size 0x17(0x6e3d bytes) 2024-09-05T17:31:24.493 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:24.494+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:24.499 INFO:teuthology.orchestra.run.smithi050.stdout:2593 write 0x197e622 thru 0x198bdbe (0xd79d bytes) 2024-09-05T17:31:24.504 INFO:teuthology.orchestra.run.smithi050.stdout:2595 read 0xd03d3b6 thru 0xd041ee6 (0x4b31 bytes) 2024-09-05T17:31:24.504 INFO:teuthology.orchestra.run.smithi050.stdout:2596 read 0x957542 thru 0x95c05c (0x4b1b bytes) 2024-09-05T17:31:24.505 INFO:teuthology.orchestra.run.smithi050.stdout:2598 read 0x37a4b08 thru 0x37a71be (0x26b7 bytes) 2024-09-05T17:31:24.505 INFO:teuthology.orchestra.run.smithi050.stdout:2599 read 0xd0b4802 thru 0xd0beb17 (0xa316 bytes) 2024-09-05T17:31:24.521 INFO:teuthology.orchestra.run.smithi050.stdout:2601 trunc from 0xdd250dc to 0x797423a 2024-09-05T17:31:24.549 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:24.549 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:24.549 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:24.554 INFO:teuthology.orchestra.run.smithi050.stdout:2602 punch from 0x449da37 to 0x44a4f55, (0x751e bytes) 2024-09-05T17:31:24.554 INFO:teuthology.orchestra.run.smithi050.stdout:2603 write 0x71c791 thru 0x72216e (0x59de bytes) 2024-09-05T17:31:24.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:24.565 INFO:teuthology.orchestra.run.smithi050.stdout:2604 trunc from 0x797423a to 0xa4a35a5 2024-09-05T17:31:24.581 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.581 INFO:teuthology.orchestra.run.smithi050.stdout:2607 read 0xa09960 thru 0xa0cb64 (0x3205 bytes) 2024-09-05T17:31:24.604 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:24.606+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:24.606 INFO:teuthology.orchestra.run.smithi050.stdout:2608 writesame 0xdbc71ff thru 0xdbc9584 data_size 0x1(0x2386 bytes) 2024-09-05T17:31:24.606 INFO:teuthology.orchestra.run.smithi050.stdout:2609 punch from 0x20d9f4a to 0x20e04f5, (0x65ab bytes) 2024-09-05T17:31:24.607 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.607 INFO:teuthology.orchestra.run.smithi050.stdout:2611 punch from 0x5790ca0 to 0x57a0539, (0xf899 bytes) 2024-09-05T17:31:24.607 INFO:teuthology.orchestra.run.smithi050.stdout:2613 punch from 0xb58922f to 0xb5968fe, (0xd6cf bytes) 2024-09-05T17:31:24.607 INFO:teuthology.orchestra.run.smithi050.stdout:2614 write 0x22e52c thru 0x234959 (0x642e bytes) 2024-09-05T17:31:24.609 INFO:teuthology.orchestra.run.smithi050.stdout:2616 read 0x929ed0f thru 0x92a2a67 (0x3d59 bytes) 2024-09-05T17:31:24.609 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.610 INFO:teuthology.orchestra.run.smithi050.stdout:2619 writesame 0x3f785e1 thru 0x3f7ec4c data_size 0x73(0x666c bytes) 2024-09-05T17:31:24.617 INFO:teuthology.orchestra.run.smithi050.stdout:2620 punch from 0xa8ffb38 to 0xa90e07a, (0xe542 bytes) 2024-09-05T17:31:24.654 INFO:teuthology.orchestra.run.smithi050.stdout:2621 trunc from 0xdbc9585 to 0x113d352 2024-09-05T17:31:24.657 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:31:24.687 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.688 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.688 INFO:teuthology.orchestra.run.smithi050.stdout:2625 punch from 0x4c137f to 0x4cc47e, (0xb0ff bytes) 2024-09-05T17:31:24.688 INFO:teuthology.orchestra.run.smithi050.stdout:2626 punch from 0x9faa82 to 0xa022aa, (0x7828 bytes) 2024-09-05T17:31:24.716 INFO:teuthology.orchestra.run.smithi050.stdout:2627 write 0xd20f6f2 thru 0xd212cb6 (0x35c5 bytes) 2024-09-05T17:31:24.716 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:24.714+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:24.720 INFO:teuthology.orchestra.run.smithi050.stdout:2629 read 0x5b0bf88 thru 0x5b14f60 (0x8fd9 bytes) 2024-09-05T17:31:24.720 INFO:teuthology.orchestra.run.smithi050.stdout:2630 read 0x7c786cf thru 0x7c838cd (0xb1ff bytes) 2024-09-05T17:31:24.720 INFO:teuthology.orchestra.run.smithi050.stdout:2631 writesame 0x40c6c7b thru 0x40cf3df data_size 0x17(0x8765 bytes) 2024-09-05T17:31:24.725 INFO:teuthology.orchestra.run.smithi050.stdout:2633 write 0x8dea02d thru 0x8dedd05 (0x3cd9 bytes) 2024-09-05T17:31:24.732 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.732 INFO:teuthology.orchestra.run.smithi050.stdout:2635 punch from 0x978fb19 to 0x9794df9, (0x52e0 bytes) 2024-09-05T17:31:24.732 INFO:teuthology.orchestra.run.smithi050.stdout:2638 read 0x9458921 thru 0x9466a3c (0xe11c bytes) 2024-09-05T17:31:24.732 INFO:teuthology.orchestra.run.smithi050.stdout:2639 read 0x16a0c7f thru 0x16a31ab (0x252d bytes) 2024-09-05T17:31:24.732 INFO:teuthology.orchestra.run.smithi050.stdout:2640 writesame 0x1064f7a thru 0x1074e83 data_size 0x5(0xff0a bytes) 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991723519000001, 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:31:24.736 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:31:24.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:31:24.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991665326, 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991604007999999, 2024-09-05T17:31:24.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:24.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:31:24.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991537541, 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:24.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991461384000001, 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:31:24.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991398416999999, 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:31:24.759 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:31:24.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:31:24.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991336686, 2024-09-05T17:31:24.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.767 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991253659, 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:31:24.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:31:24.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991194985, 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:31:24.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:31:24.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991138038000001, 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:31:24.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:31:24.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:31:24.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991073563, 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:31:24.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:31:24.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.991002910000001, 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.790 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.99092592, 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:31:24.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.990867159, 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:31:24.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.990804488, 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:31:24.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:31:24.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:31:24.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:24.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.990742357, 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:31:24.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.990623282, 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.990568831000001, 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:31:24.812 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:31:24.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:24.816 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.990406391, 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:24.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.820 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.989222004, 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:24.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:31:24.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:24.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:24.825 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:24.825 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:24.825 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:24.825 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:24.825 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-05T17:31:24.826 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-05T17:31:24.826 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-05T17:31:24.826 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-05T17:31:24.828 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:24.828 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:24.826+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:24.829 INFO:teuthology.orchestra.run.smithi050.stdout:2641 write 0xb717fb3 thru 0xb719b5a (0x1ba8 bytes) 2024-09-05T17:31:24.829 INFO:teuthology.orchestra.run.smithi050.stdout:2642 writesame 0xa9d8202 thru 0xa9df811 data_size 0x8(0x7610 bytes) 2024-09-05T17:31:24.829 INFO:teuthology.orchestra.run.smithi050.stdout:2643 writesame 0x60be9f7 thru 0x60bf364 data_size 0x11(0x96e bytes) 2024-09-05T17:31:24.829 INFO:teuthology.orchestra.run.smithi050.stdout:2644 read 0xa3995ba thru 0xa39986f (0x2b6 bytes) 2024-09-05T17:31:24.829 INFO:teuthology.orchestra.run.smithi050.stdout:2645 punch from 0x55c90da to 0x55d1ec4, (0x8dea bytes) 2024-09-05T17:31:24.829 INFO:teuthology.orchestra.run.smithi050.stdout:2646 punch from 0x320e300 to 0x3210773, (0x2473 bytes) 2024-09-05T17:31:24.829 INFO:teuthology.orchestra.run.smithi050.stdout:2647 read 0x52628a7 thru 0x5262bb1 (0x30b bytes) 2024-09-05T17:31:24.830 INFO:teuthology.orchestra.run.smithi050.stdout:2648 trunc from 0xd212cb7 to 0x15d5bc0 2024-09-05T17:31:24.830 INFO:teuthology.orchestra.run.smithi050.stdout:2649 read 0x85af4d thru 0x865982 (0xaa36 bytes) 2024-09-05T17:31:24.830 INFO:teuthology.orchestra.run.smithi050.stdout:2650 trunc from 0x15d5bc0 to 0xc0764a7 2024-09-05T17:31:24.836 INFO:teuthology.orchestra.run.smithi050.stdout:2652 read 0x488c971 thru 0x489317a (0x680a bytes) 2024-09-05T17:31:24.837 INFO:teuthology.orchestra.run.smithi050.stdout:2653 read 0x9232635 thru 0x92371bd (0x4b89 bytes) 2024-09-05T17:31:24.837 INFO:teuthology.orchestra.run.smithi050.stdout:2655 writesame 0x146e515 thru 0x147db68 data_size 0x1e(0xf654 bytes) 2024-09-05T17:31:24.843 INFO:teuthology.orchestra.run.smithi050.stdout:2657 read 0x25add5d thru 0x25b2a9a (0x4d3e bytes) 2024-09-05T17:31:24.844 INFO:teuthology.orchestra.run.smithi050.stdout:2658 write 0xa4dda4f thru 0xa4e7044 (0x95f6 bytes) 2024-09-05T17:31:24.850 INFO:teuthology.orchestra.run.smithi050.stdout:2661 writesame 0xbebab35 thru 0xbec7eac data_size 0x86(0xd378 bytes) 2024-09-05T17:31:24.855 INFO:teuthology.orchestra.run.smithi050.stdout:2662 punch from 0x38edc83 to 0x38f0f13, (0x3290 bytes) 2024-09-05T17:31:24.855 INFO:teuthology.orchestra.run.smithi050.stdout:2663 punch from 0x71e656 to 0x72421c, (0x5bc6 bytes) 2024-09-05T17:31:24.856 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.856 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:24.874 INFO:teuthology.orchestra.run.smithi050.stdout:2666 trunc from 0xc0764a7 to 0x3676653 2024-09-05T17:31:24.902 INFO:teuthology.orchestra.run.smithi050.stdout:2667 trunc from 0x3676653 to 0x9c6de 2024-09-05T17:31:24.926 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:24.926+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:24.987 INFO:teuthology.orchestra.run.smithi050.stdout:2668 trunc from 0x9c6de to 0xeb47c19 2024-09-05T17:31:24.989 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:24.999 INFO:teuthology.orchestra.run.smithi050.stdout:2669 writesame 0xb9070a6 thru 0xb90a380 data_size 0x1(0x32db bytes) 2024-09-05T17:31:24.999 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:25.000 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-05T17:31:25.000 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:25.002 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:25.002 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:25.002 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:25.002 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:25.013 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.013 INFO:teuthology.orchestra.run.smithi050.stdout:2672 writesame 0xa3dbe9c thru 0xa3e5abb data_size 0x10(0x9c20 bytes) 2024-09-05T17:31:25.019 INFO:teuthology.orchestra.run.smithi050.stdout:2673 write 0xda63053 thru 0xda6e4c4 (0xb472 bytes) 2024-09-05T17:31:25.023 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:25.023 INFO:teuthology.orchestra.run.smithi050.stdout:2674 write 0xdf90104 thru 0xdf90373 (0x270 bytes) 2024-09-05T17:31:25.028 INFO:teuthology.orchestra.run.smithi050.stdout:2675 writesame 0x7fbf39 thru 0x7fe9e0 data_size 0x1e(0x2aa8 bytes) 2024-09-05T17:31:25.032 INFO:teuthology.orchestra.run.smithi050.stdout:2678 read 0xaa96a09 thru 0xaa9a3ac (0x39a4 bytes) 2024-09-05T17:31:25.033 INFO:teuthology.orchestra.run.smithi050.stdout:2679 write 0xa278917 thru 0xa27f208 (0x68f2 bytes) 2024-09-05T17:31:25.036 INFO:teuthology.orchestra.run.smithi050.stdout:2680 read 0x676d8e9 thru 0x6775547 (0x7c5f bytes) 2024-09-05T17:31:25.036 INFO:teuthology.orchestra.run.smithi050.stdout:2681 read 0x40458de thru 0x40493dd (0x3b00 bytes) 2024-09-05T17:31:25.036 INFO:teuthology.orchestra.run.smithi050.stdout:2682 read 0xb2efbeb thru 0xb2f0a97 (0xead bytes) 2024-09-05T17:31:25.036 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.036 INFO:teuthology.orchestra.run.smithi050.stdout:2685 read 0x34348ce thru 0x3443acc (0xf1ff bytes) 2024-09-05T17:31:25.036 INFO:teuthology.orchestra.run.smithi050.stdout:2686 read 0x1d1fcfe thru 0x1d2b9dc (0xbcdf bytes) 2024-09-05T17:31:25.036 INFO:teuthology.orchestra.run.smithi050.stdout:2687 read 0x3a58ff5 thru 0x3a5f018 (0x6024 bytes) 2024-09-05T17:31:25.036 INFO:teuthology.orchestra.run.smithi050.stdout:2688 write 0xae98384 thru 0xae99958 (0x15d5 bytes) 2024-09-05T17:31:25.039 INFO:teuthology.orchestra.run.smithi050.stdout:2689 read 0xe9f4541 thru 0xe9fd88d (0x934d bytes) 2024-09-05T17:31:25.039 INFO:teuthology.orchestra.run.smithi050.stdout:2690 write 0x8dd16a2 thru 0x8dd1a47 (0x3a6 bytes) 2024-09-05T17:31:25.043 INFO:teuthology.orchestra.run.smithi050.stdout:2691 writesame 0x3832e8e thru 0x383d0bb data_size 0x1(0xa22e bytes) 2024-09-05T17:31:25.064 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:25.066+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:25.071 INFO:teuthology.orchestra.run.smithi050.stdout:2692 write 0x217d787 thru 0x2180a60 (0x32da bytes) 2024-09-05T17:31:25.076 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.076 INFO:teuthology.orchestra.run.smithi050.stdout:2694 punch from 0xbc12c9d to 0xbc1509d, (0x2400 bytes) 2024-09-05T17:31:25.076 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.080 INFO:teuthology.orchestra.run.smithi050.stdout:2696 trunc from 0xeb47c19 to 0xc413c3b 2024-09-05T17:31:25.092 INFO:teuthology.orchestra.run.smithi050.stdout:2697 punch from 0x1334fa2 to 0x133f06d, (0xa0cb bytes) 2024-09-05T17:31:25.092 INFO:teuthology.orchestra.run.smithi050.stdout:2699 punch from 0xc04baa4 to 0xc04eb8f, (0x30eb bytes) 2024-09-05T17:31:25.092 INFO:teuthology.orchestra.run.smithi050.stdout:2703 write 0x408b196 thru 0x4092c8f (0x7afa bytes) 2024-09-05T17:31:25.098 INFO:teuthology.orchestra.run.smithi050.stdout:2704 read 0xbed216b thru 0xbee1fd3 (0xfe69 bytes) 2024-09-05T17:31:25.098 INFO:teuthology.orchestra.run.smithi050.stdout:2705 read 0x65cc4d8 thru 0x65ce974 (0x249d bytes) 2024-09-05T17:31:25.098 INFO:teuthology.orchestra.run.smithi050.stdout:2707 punch from 0x32fd41d to 0x330cfab, (0xfb8e bytes) 2024-09-05T17:31:25.098 INFO:teuthology.orchestra.run.smithi050.stdout:2708 read 0xb847f4b thru 0xb84e9ed (0x6aa3 bytes) 2024-09-05T17:31:25.099 INFO:teuthology.orchestra.run.smithi050.stdout:2710 read 0x7e58d9 thru 0x7e7107 (0x182f bytes) 2024-09-05T17:31:25.099 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.099 INFO:teuthology.orchestra.run.smithi050.stdout:2712 read 0x46cf55d thru 0x46dd72d (0xe1d1 bytes) 2024-09-05T17:31:25.101 INFO:teuthology.orchestra.run.smithi050.stdout:2713 trunc from 0xc413c3b to 0xdb69555 2024-09-05T17:31:25.125 INFO:teuthology.orchestra.run.smithi050.stdout:2714 trunc from 0xdb69555 to 0x38ccfc8 2024-09-05T17:31:25.127 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:25.126+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:25.156 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:25.157 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:25.160 INFO:teuthology.orchestra.run.smithi050.stdout:2716 write 0xa218069 thru 0xa2246f2 (0xc68a bytes) 2024-09-05T17:31:25.165 INFO:teuthology.orchestra.run.smithi050.stdout:2717 read 0x2855f72 thru 0x285b5f3 (0x5682 bytes) 2024-09-05T17:31:25.165 INFO:teuthology.orchestra.run.smithi050.stdout:2718 read 0x16c0baa thru 0x16cf00f (0xe466 bytes) 2024-09-05T17:31:25.165 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.178 INFO:teuthology.orchestra.run.smithi050.stdout:2720 writesame 0xdec766c thru 0xded445f data_size 0x62(0xcdf4 bytes) 2024-09-05T17:31:25.178 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.178 INFO:teuthology.orchestra.run.smithi050.stdout:2722 write 0x98be87c thru 0x98c1b60 (0x32e5 bytes) 2024-09-05T17:31:25.180 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:25.180 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:25.182 INFO:teuthology.orchestra.run.smithi050.stdout:2723 write 0xc714243 thru 0xc71603c (0x1dfa bytes) 2024-09-05T17:31:25.188 INFO:teuthology.orchestra.run.smithi050.stdout:2724 read 0xaab0508 thru 0xaab29dd (0x24d6 bytes) 2024-09-05T17:31:25.188 INFO:teuthology.orchestra.run.smithi050.stdout:2725 read 0xde84b69 thru 0xde8b0c3 (0x655b bytes) 2024-09-05T17:31:25.188 INFO:teuthology.orchestra.run.smithi050.stdout:2726 read 0x1cfd996 thru 0x1d08c97 (0xb302 bytes) 2024-09-05T17:31:25.188 INFO:teuthology.orchestra.run.smithi050.stdout:2728 write 0x927a076 thru 0x927c8ed (0x2878 bytes) 2024-09-05T17:31:25.190 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:25.190 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:25.190 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:25.190 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:25.190 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:25.191 INFO:teuthology.orchestra.run.smithi050.stdout:2729 write 0x71f174b thru 0x71fc667 (0xaf1d bytes) 2024-09-05T17:31:25.195 INFO:teuthology.orchestra.run.smithi050.stdout:2730 write 0x186a6c2 thru 0x186c57e (0x1ebd bytes) 2024-09-05T17:31:25.198 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:25.199 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:25.199 INFO:teuthology.orchestra.run.smithi050.stdout:2732 read 0xbad28a1 thru 0xbad7343 (0x4aa3 bytes) 2024-09-05T17:31:25.206 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:25.215 INFO:teuthology.orchestra.run.smithi050.stdout:2733 trunc from 0xded4460 to 0x488ecc2 2024-09-05T17:31:25.227 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:25.227 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:25.228 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:25.226+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:25.232 INFO:teuthology.orchestra.run.smithi050.stdout:2734 read 0x2f0d93e thru 0x2f13ca6 (0x6369 bytes) 2024-09-05T17:31:25.232 INFO:teuthology.orchestra.run.smithi050.stdout:2735 writesame 0x3d683d0 thru 0x3d77799 data_size 0x2(0xf3ca bytes) 2024-09-05T17:31:25.247 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:25.247 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:25.266 INFO:teuthology.orchestra.run.smithi050.stdout:2737 write 0x8789717 thru 0x8798a56 (0xf340 bytes) 2024-09-05T17:31:25.271 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:25.272 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:25.280 INFO:teuthology.orchestra.run.smithi050.stdout:2738 writesame 0xb25bb35 thru 0xb264b86 data_size 0x62(0x9052 bytes) 2024-09-05T17:31:25.281 INFO:teuthology.orchestra.run.smithi050.stdout:2739 read 0xa5a8a2b thru 0xa5b5b4a (0xd120 bytes) 2024-09-05T17:31:25.281 INFO:teuthology.orchestra.run.smithi050.stdout:2740 write 0x73230f7 thru 0x7325762 (0x266c bytes) 2024-09-05T17:31:25.284 INFO:teuthology.orchestra.run.smithi050.stdout:2742 write 0x1e87a0b thru 0x1e8d011 (0x5607 bytes) 2024-09-05T17:31:25.290 INFO:teuthology.orchestra.run.smithi050.stdout:2743 trunc from 0xb264b87 to 0x86e7877 2024-09-05T17:31:25.298 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:25.298 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:25.299 INFO:teuthology.orchestra.run.smithi050.stdout:2744 read 0x64f9fda thru 0x6503421 (0x9448 bytes) 2024-09-05T17:31:25.299 INFO:teuthology.orchestra.run.smithi050.stdout:2745 read 0x550478b thru 0x550b5d2 (0x6e48 bytes) 2024-09-05T17:31:25.306 INFO:teuthology.orchestra.run.smithi050.stdout:2748 write 0x9a1a7a3 thru 0x9a1ef74 (0x47d2 bytes) 2024-09-05T17:31:25.310 INFO:teuthology.orchestra.run.smithi050.stdout:2750 read 0x3bc6f2d thru 0x3bcaf62 (0x4036 bytes) 2024-09-05T17:31:25.311 INFO:teuthology.orchestra.run.smithi050.stdout:2751 write 0x3b264d2 thru 0x3b276be (0x11ed bytes) 2024-09-05T17:31:25.318 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:25.318 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:25.321 INFO:teuthology.orchestra.run.smithi050.stdout:2754 writesame 0xa31af04 thru 0xa31f4ee data_size 0x1(0x45eb bytes) 2024-09-05T17:31:25.321 INFO:teuthology.orchestra.run.smithi050.stdout:2755 writesame 0xc9f98a thru 0xcab03e data_size 0x3(0xb6b5 bytes) 2024-09-05T17:31:25.329 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:25.326+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:25.332 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.332 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.332 INFO:teuthology.orchestra.run.smithi050.stdout:2759 read 0x558670 thru 0x55dbf6 (0x5587 bytes) 2024-09-05T17:31:25.332 INFO:teuthology.orchestra.run.smithi050.stdout:2760 write 0x2d7a6af thru 0x2d855f4 (0xaf46 bytes) 2024-09-05T17:31:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:25.335 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:25.338 INFO:teuthology.orchestra.run.smithi050.stdout:2761 read 0x35bcafd thru 0x35c4d33 (0x8237 bytes) 2024-09-05T17:31:25.346 INFO:teuthology.orchestra.run.smithi050.stdout:2763 write 0xb111dc0 thru 0xb118e58 (0x7099 bytes) 2024-09-05T17:31:25.350 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:25.354 INFO:teuthology.orchestra.run.smithi050.stdout:2765 trunc from 0xb118e59 to 0x8aa01cd 2024-09-05T17:31:25.366 INFO:teuthology.orchestra.run.smithi050.stdout:2766 trunc from 0x8aa01cd to 0x880ff45 2024-09-05T17:31:25.372 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.372 INFO:teuthology.orchestra.run.smithi050.stdout:2768 read 0x4dc478e thru 0x4dd10b4 (0xc927 bytes) 2024-09-05T17:31:25.378 INFO:teuthology.orchestra.run.smithi050.stdout:2770 trunc from 0x880ff45 to 0xc3ade81 2024-09-05T17:31:25.385 INFO:teuthology.orchestra.run.smithi050.stdout:2772 punch from 0x36e2ec6 to 0x36f1a9f, (0xebd9 bytes) 2024-09-05T17:31:25.385 INFO:teuthology.orchestra.run.smithi050.stdout:2773 read 0x58c380c thru 0x58ce6ec (0xaee1 bytes) 2024-09-05T17:31:25.385 INFO:teuthology.orchestra.run.smithi050.stdout:2774 read 0x3afd8e7 thru 0x3b03913 (0x602d bytes) 2024-09-05T17:31:25.386 INFO:teuthology.orchestra.run.smithi050.stdout:2775 write 0x9b7178 thru 0x9c6064 (0xeeed bytes) 2024-09-05T17:31:25.390 INFO:teuthology.orchestra.run.smithi050.stdout:2776 punch from 0x702430 to 0x7088be, (0x648e bytes) 2024-09-05T17:31:25.390 INFO:teuthology.orchestra.run.smithi050.stdout:2777 punch from 0x61360fc to 0x613a343, (0x4247 bytes) 2024-09-05T17:31:25.410 INFO:teuthology.orchestra.run.smithi050.stdout:2779 trunc from 0xc3ade81 to 0x14d2fc1 2024-09-05T17:31:25.430 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:25.430+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:25.454 INFO:teuthology.orchestra.run.smithi050.stdout:2780 trunc from 0x14d2fc1 to 0x7818e0a 2024-09-05T17:31:25.464 INFO:teuthology.orchestra.run.smithi050.stdout:2781 read 0x5e96ec6 thru 0x5ea5ef2 (0xf02d bytes) 2024-09-05T17:31:25.477 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:25.477 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:25.480 INFO:teuthology.orchestra.run.smithi050.stdout:2782 trunc from 0x7818e0a to 0xe665c2d 2024-09-05T17:31:25.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:25.492 INFO:teuthology.orchestra.run.smithi050.stdout:2783 write 0x427c599 thru 0x427cde6 (0x84e bytes) 2024-09-05T17:31:25.497 INFO:teuthology.orchestra.run.smithi050.stdout:2784 writesame 0xc34efe4 thru 0xc355624 data_size 0x1(0x6641 bytes) 2024-09-05T17:31:25.521 INFO:teuthology.orchestra.run.smithi050.stdout:2786 read 0x939fb73 thru 0x93a962c (0x9aba bytes) 2024-09-05T17:31:25.522 INFO:teuthology.orchestra.run.smithi050.stdout:2788 read 0x82dc244 thru 0x82de527 (0x22e4 bytes) 2024-09-05T17:31:25.522 INFO:teuthology.orchestra.run.smithi050.stdout:2789 read 0x74fde9a thru 0x7500146 (0x22ad bytes) 2024-09-05T17:31:25.522 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.522 INFO:teuthology.orchestra.run.smithi050.stdout:2791 read 0x96efc9d thru 0x96f15bb (0x191f bytes) 2024-09-05T17:31:25.532 INFO:teuthology.orchestra.run.smithi050.stdout:2792 trunc from 0xe665c2d to 0xa8db509 2024-09-05T17:31:25.533 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:25.534+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:25.555 INFO:teuthology.orchestra.run.smithi050.stdout:2795 punch from 0x5447ba7 to 0x544bc1c, (0x4075 bytes) 2024-09-05T17:31:25.555 INFO:teuthology.orchestra.run.smithi050.stdout:2797 write 0x2f835dc thru 0x2f92a5e (0xf483 bytes) 2024-09-05T17:31:25.562 INFO:teuthology.orchestra.run.smithi050.stdout:2798 trunc from 0xa8db509 to 0xac1ca67 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2799 read 0x85a38cf thru 0x85a80b5 (0x47e7 bytes) 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2801 write 0xdca8e13 thru 0xdcb63e3 (0xd5d1 bytes) 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2802 read 0x781b966 thru 0x7822ede (0x7579 bytes) 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2803 writesame 0x6084c8d thru 0x60945c0 data_size 0x29(0xf934 bytes) 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2804 read 0xd29bd46 thru 0xd2a8c67 (0xcf22 bytes) 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2805 write 0x3ce2cc3 thru 0x3ce72f3 (0x4631 bytes) 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2806 write 0x2ef4359 thru 0x2efbad3 (0x777b bytes) 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2807 write 0x487078f thru 0x487c0f5 (0xb967 bytes) 2024-09-05T17:31:25.658 INFO:teuthology.orchestra.run.smithi050.stdout:2808 read 0x29f7af3 thru 0x29fa999 (0x2ea7 bytes) 2024-09-05T17:31:25.659 INFO:teuthology.orchestra.run.smithi050.stdout:2810 read 0xe513b5 thru 0xe55831 (0x447d bytes) 2024-09-05T17:31:25.659 INFO:teuthology.orchestra.run.smithi050.stdout:2811 write 0xb155678 thru 0xb15c582 (0x6f0b bytes) 2024-09-05T17:31:25.659 INFO:teuthology.orchestra.run.smithi050.stdout:2812 trunc from 0xdcb63e4 to 0xb7add0b 2024-09-05T17:31:25.659 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:25.654+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:25.660 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:25.660 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:25.668 INFO:teuthology.orchestra.run.smithi050.stdout:2814 writesame 0x5a2c5e2 thru 0x5a2ec8d data_size 0x3(0x26ac bytes) 2024-09-05T17:31:25.674 INFO:teuthology.orchestra.run.smithi050.stdout:2815 write 0x9ce9dc5 thru 0x9cf1908 (0x7b44 bytes) 2024-09-05T17:31:25.675 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:25.682 INFO:teuthology.orchestra.run.smithi050.stdout:2816 writesame 0x83c6c68 thru 0x83d457c data_size 0x1(0xd915 bytes) 2024-09-05T17:31:25.712 INFO:teuthology.orchestra.run.smithi050.stdout:2817 trunc from 0xb7add0b to 0xa3e852 2024-09-05T17:31:25.758 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:25.754+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:25.775 INFO:teuthology.orchestra.run.smithi050.stdout:2818 write 0x2a930b2 thru 0x2a9d19a (0xa0e9 bytes) 2024-09-05T17:31:25.783 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:25.796 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:25.807 INFO:teuthology.orchestra.run.smithi050.stdout:2821 writesame 0x65ae2f6 thru 0x65b77c0 data_size 0x1(0x94cb bytes) 2024-09-05T17:31:25.807 INFO:teuthology.orchestra.run.smithi050.stdout:2822 read 0x41a59e4 thru 0x41b240a (0xca27 bytes) 2024-09-05T17:31:25.811 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:25.821 INFO:teuthology.orchestra.run.smithi050.stdout:2823 trunc from 0x65b77c1 to 0xc28f754 2024-09-05T17:31:25.830 INFO:teuthology.orchestra.run.smithi050.stdout:2824 read 0xb078275 thru 0xb081fba (0x9d46 bytes) 2024-09-05T17:31:25.830 INFO:teuthology.orchestra.run.smithi050.stdout:2825 write 0x65b1fba thru 0x65b4fed (0x3034 bytes) 2024-09-05T17:31:25.835 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.835 INFO:teuthology.orchestra.run.smithi050.stdout:2827 punch from 0x854adfa to 0x8552bd9, (0x7ddf bytes) 2024-09-05T17:31:25.835 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.848 INFO:teuthology.orchestra.run.smithi050.stdout:2829 write 0xedb9e73 thru 0xedbe3da (0x4568 bytes) 2024-09-05T17:31:25.859 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:25.858+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:25.869 INFO:teuthology.orchestra.run.smithi050.stdout:2830 trunc from 0xedbe3db to 0x6595703 2024-09-05T17:31:25.892 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.892 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:25.892 INFO:teuthology.orchestra.run.smithi050.stdout:2833 punch from 0x481203b to 0x48169b2, (0x4977 bytes) 2024-09-05T17:31:25.895 INFO:teuthology.orchestra.run.smithi050.stdout:2834 trunc from 0x6595703 to 0x4096d97 2024-09-05T17:31:25.917 INFO:teuthology.orchestra.run.smithi050.stdout:2836 read 0x3475dda thru 0x347f59e (0x97c5 bytes) 2024-09-05T17:31:25.935 INFO:teuthology.orchestra.run.smithi050.stdout:2837 writesame 0x6a0327a thru 0x6a08cbf data_size 0x5(0x5a46 bytes) 2024-09-05T17:31:25.955 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:25.955 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:25.957 INFO:teuthology.orchestra.run.smithi050.stdout:2839 write 0xe503cb9 thru 0xe50f199 (0xb4e1 bytes) 2024-09-05T17:31:25.959 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:25.958+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:25.963 INFO:teuthology.orchestra.run.smithi050.stdout:2840 read 0x72ba250 thru 0x72bdff7 (0x3da8 bytes) 2024-09-05T17:31:25.964 INFO:teuthology.orchestra.run.smithi050.stdout:2841 writesame 0x9f277ee thru 0x9f2e112 data_size 0x1(0x6925 bytes) 2024-09-05T17:31:25.971 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:26.001 INFO:teuthology.orchestra.run.smithi050.stdout:2843 read 0xbbec5db thru 0xbbee10a (0x1b30 bytes) 2024-09-05T17:31:26.001 INFO:teuthology.orchestra.run.smithi050.stdout:2844 write 0xc767ece thru 0xc76b574 (0x36a7 bytes) 2024-09-05T17:31:26.005 INFO:teuthology.orchestra.run.smithi050.stdout:2845 writesame 0x348f734 thru 0x349d4bc data_size 0x1(0xdd89 bytes) 2024-09-05T17:31:26.061 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:26.058+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:26.076 INFO:teuthology.orchestra.run.smithi050.stdout:2846 read 0xfa24d3 thru 0xfa7b29 (0x5657 bytes) 2024-09-05T17:31:26.076 INFO:teuthology.orchestra.run.smithi050.stdout:2847 read 0x6d25b4f thru 0x6d340be (0xe570 bytes) 2024-09-05T17:31:26.076 INFO:teuthology.orchestra.run.smithi050.stdout:2848 read 0xdc20129 thru 0xdc212e1 (0x11b9 bytes) 2024-09-05T17:31:26.076 INFO:teuthology.orchestra.run.smithi050.stdout:2851 write 0x674ce82 thru 0x675c6d3 (0xf852 bytes) 2024-09-05T17:31:26.083 INFO:teuthology.orchestra.run.smithi050.stdout:2854 read 0xab0ca57 thru 0xab1096a (0x3f14 bytes) 2024-09-05T17:31:26.083 INFO:teuthology.orchestra.run.smithi050.stdout:2855 punch from 0xb29dbfd to 0xb2a336f, (0x5772 bytes) 2024-09-05T17:31:26.084 INFO:teuthology.orchestra.run.smithi050.stdout:2856 writesame 0x7bdfb8 thru 0x7c9d34 data_size 0x1(0xbd7d bytes) 2024-09-05T17:31:26.129 INFO:teuthology.orchestra.run.smithi050.stdout:2857 trunc from 0xe50f19a to 0xd1b4be6 2024-09-05T17:31:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:26.140 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:26.159 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:26.160 INFO:teuthology.orchestra.run.smithi050.stdout:2858 trunc from 0xd1b4be6 to 0x67d0845 2024-09-05T17:31:26.161 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:26.162+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:26.186 INFO:teuthology.orchestra.run.smithi050.stdout:2859 trunc from 0x67d0845 to 0x30a6020 2024-09-05T17:31:26.221 INFO:teuthology.orchestra.run.smithi050.stdout:2860 writesame 0x5da7ab2 thru 0x5db26dc data_size 0x2b(0xac2b bytes) 2024-09-05T17:31:26.221 INFO:teuthology.orchestra.run.smithi050.stdout:2861 read 0x4818c18 thru 0x481dd40 (0x5129 bytes) 2024-09-05T17:31:26.239 INFO:teuthology.orchestra.run.smithi050.stdout:2862 write 0xac729ed thru 0xac7aa21 (0x8035 bytes) 2024-09-05T17:31:26.244 INFO:teuthology.orchestra.run.smithi050.stdout:2863 punch from 0x923b7f7 to 0x92465c8, (0xadd1 bytes) 2024-09-05T17:31:26.244 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.244 INFO:teuthology.orchestra.run.smithi050.stdout:2865 read 0x594b06e thru 0x5951fb5 (0x6f48 bytes) 2024-09-05T17:31:26.248 INFO:teuthology.orchestra.run.smithi050.stdout:2867 trunc from 0xac7aa22 to 0x8a238ea 2024-09-05T17:31:26.262 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:26.262+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:26.280 INFO:teuthology.orchestra.run.smithi050.stdout:2870 writesame 0xd8ea227 thru 0xd8f583f data_size 0x29(0xb619 bytes) 2024-09-05T17:31:26.280 INFO:teuthology.orchestra.run.smithi050.stdout:2872 writesame 0x415ff20 thru 0x416042e data_size 0x7(0x50f bytes) 2024-09-05T17:31:26.285 INFO:teuthology.orchestra.run.smithi050.stdout:2873 write 0x1b7c2c1 thru 0x1b887cf (0xc50f bytes) 2024-09-05T17:31:26.291 INFO:teuthology.orchestra.run.smithi050.stdout:2874 read 0x8ecc401 thru 0x8ed7615 (0xb215 bytes) 2024-09-05T17:31:26.291 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.291 INFO:teuthology.orchestra.run.smithi050.stdout:2876 write 0x2b90eaa thru 0x2b9510f (0x4266 bytes) 2024-09-05T17:31:26.293 INFO:teuthology.orchestra.run.smithi050.stdout:2878 write 0x4e76851 thru 0x4e80a39 (0xa1e9 bytes) 2024-09-05T17:31:26.299 INFO:teuthology.orchestra.run.smithi050.stdout:2880 punch from 0xbc41935 to 0xbc49494, (0x7b5f bytes) 2024-09-05T17:31:26.299 INFO:teuthology.orchestra.run.smithi050.stdout:2883 punch from 0x7b2dbfc to 0x7b3a6bd, (0xcac1 bytes) 2024-09-05T17:31:26.309 INFO:teuthology.orchestra.run.smithi050.stdout:2884 writesame 0xda67e5a thru 0xda71422 data_size 0x1(0x95c9 bytes) 2024-09-05T17:31:26.309 INFO:teuthology.orchestra.run.smithi050.stdout:2885 write 0x8aa59e6 thru 0x8aa8a62 (0x307d bytes) 2024-09-05T17:31:26.315 INFO:teuthology.orchestra.run.smithi050.stdout:2887 punch from 0x5cc614d to 0x5ccf69c, (0x954f bytes) 2024-09-05T17:31:26.315 INFO:teuthology.orchestra.run.smithi050.stdout:2888 read 0xcc3eaf0 thru 0xcc4c86a (0xdd7b bytes) 2024-09-05T17:31:26.315 INFO:teuthology.orchestra.run.smithi050.stdout:2889 read 0x859de3d thru 0x85a2d2c (0x4ef0 bytes) 2024-09-05T17:31:26.316 INFO:teuthology.orchestra.run.smithi050.stdout:2891 punch from 0xbafbb7d to 0xbafbfbb, (0x43e bytes) 2024-09-05T17:31:26.316 INFO:teuthology.orchestra.run.smithi050.stdout:2892 write 0xab99fb1 thru 0xaba11cc (0x721c bytes) 2024-09-05T17:31:26.323 INFO:teuthology.orchestra.run.smithi050.stdout:2893 write 0x285bd68 thru 0x28686c2 (0xc95b bytes) 2024-09-05T17:31:26.331 INFO:teuthology.orchestra.run.smithi050.stdout:2895 write 0x3002b24 thru 0x30085bd (0x5a9a bytes) 2024-09-05T17:31:26.333 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:26.333 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:26.347 INFO:teuthology.orchestra.run.smithi050.stdout:2896 trunc from 0xda71423 to 0x73c1143 2024-09-05T17:31:26.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:26.365 INFO:teuthology.orchestra.run.smithi050.stdout:2898 read 0x23d3614 thru 0x23dd343 (0x9d30 bytes) 2024-09-05T17:31:26.365 INFO:teuthology.orchestra.run.smithi050.stdout:2899 read 0x37880 thru 0x43296 (0xba17 bytes) 2024-09-05T17:31:26.366 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:26.362+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:26.367 INFO:teuthology.orchestra.run.smithi050.stdout:2900 read 0x73a19ab thru 0x73b1071 (0xf6c7 bytes) 2024-09-05T17:31:26.367 INFO:teuthology.orchestra.run.smithi050.stdout:2903 writesame 0x3fa0ecd thru 0x3fafe3b data_size 0x41(0xef6f bytes) 2024-09-05T17:31:26.371 INFO:teuthology.orchestra.run.smithi050.stdout:2904 read 0x90f55 thru 0x92409 (0x14b5 bytes) 2024-09-05T17:31:26.373 INFO:teuthology.orchestra.run.smithi050.stdout:2906 write 0x471779e thru 0x4726231 (0xea94 bytes) 2024-09-05T17:31:26.377 INFO:teuthology.orchestra.run.smithi050.stdout:2907 write 0x31dc980 thru 0x31e85ba (0xbc3b bytes) 2024-09-05T17:31:26.379 INFO:teuthology.orchestra.run.smithi050.stdout:2908 punch from 0x69f3fb1 to 0x69f432a, (0x379 bytes) 2024-09-05T17:31:26.388 INFO:teuthology.orchestra.run.smithi050.stdout:2911 writesame 0x7c0e955 thru 0x7c0ea04 data_size 0x4(0xb0 bytes) 2024-09-05T17:31:26.404 INFO:teuthology.orchestra.run.smithi050.stdout:2912 writesame 0xc0e4702 thru 0xc0eae11 data_size 0x61(0x6710 bytes) 2024-09-05T17:31:26.404 INFO:teuthology.orchestra.run.smithi050.stdout:2913 read 0xbab16a6 thru 0xbac0d36 (0xf691 bytes) 2024-09-05T17:31:26.404 INFO:teuthology.orchestra.run.smithi050.stdout:2914 writesame 0x6aee103 thru 0x6af6386 data_size 0x2(0x8284 bytes) 2024-09-05T17:31:26.416 INFO:teuthology.orchestra.run.smithi050.stdout:2915 read 0xabfe476 thru 0xac07bee (0x9779 bytes) 2024-09-05T17:31:26.416 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.435 INFO:teuthology.orchestra.run.smithi050.stdout:2917 trunc from 0xc0eae12 to 0xa06be9 2024-09-05T17:31:26.464 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:26.462+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:26.465 INFO:teuthology.orchestra.run.smithi050.stdout:2919 read 0x73640e thru 0x74346e (0xd061 bytes) 2024-09-05T17:31:26.466 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.466 INFO:teuthology.orchestra.run.smithi050.stdout:2923 trunc from 0xa06be9 to 0xa61ef8 2024-09-05T17:31:26.503 INFO:teuthology.orchestra.run.smithi050.stdout:2924 write 0xccabbc3 thru 0xccbb98c (0xfdca bytes) 2024-09-05T17:31:26.510 INFO:teuthology.orchestra.run.smithi050.stdout:2925 punch from 0x7313d04 to 0x731bd4d, (0x8049 bytes) 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:2930 read 0x9de07b9 thru 0x9dec810 (0xc058 bytes) 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:2933 read 0x8d95473 thru 0x8d9a761 (0x52ef bytes) 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:2936 read 0xaac9a95 thru 0xaaccfb4 (0x3520 bytes) 2024-09-05T17:31:26.511 INFO:teuthology.orchestra.run.smithi050.stdout:2937 punch from 0x943095e to 0x943fd2c, (0xf3ce bytes) 2024-09-05T17:31:26.512 INFO:teuthology.orchestra.run.smithi050.stdout:2939 read 0x4582e3 thru 0x4631b0 (0xaece bytes) 2024-09-05T17:31:26.512 INFO:teuthology.orchestra.run.smithi050.stdout:2940 writesame 0x52c372d thru 0x52c474c data_size 0x20(0x1020 bytes) 2024-09-05T17:31:26.517 INFO:teuthology.orchestra.run.smithi050.stdout:2941 punch from 0x48f51af to 0x48fdada, (0x892b bytes) 2024-09-05T17:31:26.517 INFO:teuthology.orchestra.run.smithi050.stdout:2942 read 0x96f9eea thru 0x9705dfe (0xbf15 bytes) 2024-09-05T17:31:26.517 INFO:teuthology.orchestra.run.smithi050.stdout:2943 write 0xe540c8 thru 0xe5cd4c (0x8c85 bytes) 2024-09-05T17:31:26.520 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:26.520 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:26.524 INFO:teuthology.orchestra.run.smithi050.stdout:2944 read 0x7ebf66d thru 0x7ecb434 (0xbdc8 bytes) 2024-09-05T17:31:26.524 INFO:teuthology.orchestra.run.smithi050.stdout:2945 punch from 0x45a001c to 0x45abaf8, (0xbadc bytes) 2024-09-05T17:31:26.524 INFO:teuthology.orchestra.run.smithi050.stdout:2946 punch from 0xae9b629 to 0xaea65e4, (0xafbb bytes) 2024-09-05T17:31:26.524 INFO:teuthology.orchestra.run.smithi050.stdout:2947 writesame 0xb0db51f thru 0xb0e6564 data_size 0x17(0xb046 bytes) 2024-09-05T17:31:26.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:26.546 INFO:teuthology.orchestra.run.smithi050.stdout:2950 writesame 0xce0022a thru 0xce0b1a4 data_size 0x1(0xaf7b bytes) 2024-09-05T17:31:26.546 INFO:teuthology.orchestra.run.smithi050.stdout:2951 write 0x7cde3e7 thru 0x7cdef5e (0xb78 bytes) 2024-09-05T17:31:26.553 INFO:teuthology.orchestra.run.smithi050.stdout:2952 writesame 0x45a6a12 thru 0x45aac7a data_size 0x3(0x4269 bytes) 2024-09-05T17:31:26.564 INFO:teuthology.orchestra.run.smithi050.stdout:2955 punch from 0x8b983a2 to 0x8b9bb5d, (0x37bb bytes) 2024-09-05T17:31:26.564 INFO:teuthology.orchestra.run.smithi050.stdout:2956 punch from 0x31630b3 to 0x316ec56, (0xbba3 bytes) 2024-09-05T17:31:26.564 INFO:teuthology.orchestra.run.smithi050.stdout:2957 read 0x7fad936 thru 0x7fb7ecf (0xa59a bytes) 2024-09-05T17:31:26.564 INFO:teuthology.orchestra.run.smithi050.stdout:2959 punch from 0x72225ae to 0x722d69f, (0xb0f1 bytes) 2024-09-05T17:31:26.564 INFO:teuthology.orchestra.run.smithi050.stdout:2960 punch from 0x4e06843 to 0x4e12426, (0xbbe3 bytes) 2024-09-05T17:31:26.565 INFO:teuthology.orchestra.run.smithi050.stdout:2961 write 0x32746c1 thru 0x327ddd2 (0x9712 bytes) 2024-09-05T17:31:26.566 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:26.566+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:26.569 INFO:teuthology.orchestra.run.smithi050.stdout:2962 write 0x5a8346b thru 0x5a91139 (0xdccf bytes) 2024-09-05T17:31:26.575 INFO:teuthology.orchestra.run.smithi050.stdout:2964 writesame 0x44c48af thru 0x44ce970 data_size 0x3(0xa0c2 bytes) 2024-09-05T17:31:26.593 INFO:teuthology.orchestra.run.smithi050.stdout:2965 read 0x724ff1e thru 0x725aca0 (0xad83 bytes) 2024-09-05T17:31:26.593 INFO:teuthology.orchestra.run.smithi050.stdout:2966 read 0x14e0185 thru 0x14eeeb7 (0xed33 bytes) 2024-09-05T17:31:26.594 INFO:teuthology.orchestra.run.smithi050.stdout:2968 writesame 0x670f0bc thru 0x671cf94 data_size 0x1(0xded9 bytes) 2024-09-05T17:31:26.663 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:26.663 INFO:teuthology.orchestra.run.smithi050.stdout:2970 read 0xb2aa6c9 thru 0xb2b5509 (0xae41 bytes) 2024-09-05T17:31:26.663 INFO:teuthology.orchestra.run.smithi050.stdout:2971 read 0x14cdcd1 thru 0x14dc33a (0xe66a bytes) 2024-09-05T17:31:26.664 INFO:teuthology.orchestra.run.smithi050.stdout:2972 punch from 0x3901d5c to 0x3907873, (0x5b17 bytes) 2024-09-05T17:31:26.664 INFO:teuthology.orchestra.run.smithi050.stdout:2974 clone 14 order 21 su 524288 sc 13 2024-09-05T17:31:26.666 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:26.666+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:26.672 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:26.672 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:26.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:26.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:31:26.768 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:26.766+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:26.868 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:26.870+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:26.870 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:26.870 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:26.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:26.970 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:26.970+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:27.001 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:27.001 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:27.016 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:27.070 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:27.070+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:27.135 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:27.135 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:27.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:27.195 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:27.198+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:27.271 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:27.270+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:27.273 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:27.273 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:27.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:27.340 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:27.372 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:27.374+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:27.458 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:27.458 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:27.473 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:27.474 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:27.474+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:27.527 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:27.527 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:27.545 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:27.545 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:27.561 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:27.562 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:27.574 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:27.574+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:27.594 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:27.594 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:27.615 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:27.616 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:27.651 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:27.651 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:27.660 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:27.660 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:27.666 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:31:27.674 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:27.674+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:27.685 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:27.686 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:27.687 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:27.708 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:27.709 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:27.776 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:27.778+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:27.788 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone13 from 0xce0b1a5 (overlap 0x9c6de) to 0x0 2024-09-05T17:31:27.837 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.629615600000001, 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.838 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:31:27.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:31:27.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:27.843 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.628594273000001, 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:31:27.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:31:27.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:31:27.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:31:27.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:31:27.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:31:27.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:31:27.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.627505774999999, 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.850 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:31:27.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.626485263999999, 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.856 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:31:27.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.625458314999999, 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.861 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:31:27.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.865 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.623115717000001, 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.866 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:31:27.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:31:27.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.618163544000002, 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.871 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:31:27.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:31:27.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:31:27.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13418 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6023168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.617567644000001, 2024-09-05T17:31:27.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14037719400000001, 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13418 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:27.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221572+0000", 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034026199999999998 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221584+0000", 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1321999999999999e-05 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221603+0000", 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9344e-05 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221615+0000", 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1565e-05 2024-09-05T17:31:27.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361125+0000", 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139510734 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361358+0000", 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023231599999999999 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361609+0000", 2024-09-05T17:31:27.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025165099999999998 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.617163561000002, 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:27.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.885 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.616558162, 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:31:27.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:27.890 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.615499033999999, 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:31:27.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:31:27.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.614857750999999, 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.895 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:27.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.899 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.900 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:27.900 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.614262857, 2024-09-05T17:31:27.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:31:27.900 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.900 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:31:27.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.904 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.613197663000001, 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.905 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:31:27.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.612556973, 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:31:27.909 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:31:27.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.612106272999998, 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:31:27.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.611460529999999, 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.918 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:27.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:31:27.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.611088511999998, 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.923 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:31:27.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.610447457999999, 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.927 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.931 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.609848929000002, 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:27.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:31:27.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:27.936 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:27.938 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:27.938 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-05T17:31:27.939 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:27.938+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:28.014 INFO:teuthology.orchestra.run.smithi050.stdout:2976 write 0x77022d6 thru 0x7704603 (0x232e bytes) 2024-09-05T17:31:28.026 INFO:teuthology.orchestra.run.smithi050.stdout:2977 write 0x38f40fe thru 0x38fc423 (0x8326 bytes) 2024-09-05T17:31:28.033 INFO:teuthology.orchestra.run.smithi050.stdout:2978 writesame 0x1668b0 thru 0x169ded data_size 0xa(0x353e bytes) 2024-09-05T17:31:28.038 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:28.038+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:28.041 INFO:teuthology.orchestra.run.smithi050.stdout:2979 read 0x699fa76 thru 0x69a76ba (0x7c45 bytes) 2024-09-05T17:31:28.041 INFO:teuthology.orchestra.run.smithi050.stdout:2980 writesame 0x5009969 thru 0x50138ed data_size 0x1(0x9f85 bytes) 2024-09-05T17:31:28.072 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:28.072 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:28.073 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:28.073 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:28.073 INFO:teuthology.orchestra.run.smithi050.stdout:2981 write 0x1988a4 thru 0x19ea0d (0x616a bytes) 2024-09-05T17:31:28.081 INFO:teuthology.orchestra.run.smithi050.stdout:2982 writesame 0x286c92c thru 0x2875900 data_size 0x1(0x8fd5 bytes) 2024-09-05T17:31:28.088 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:28.109 INFO:teuthology.orchestra.run.smithi050.stdout:2983 read 0x189f09 thru 0x18dbb0 (0x3ca8 bytes) 2024-09-05T17:31:28.110 INFO:teuthology.orchestra.run.smithi050.stdout:2984 read 0x8e0d721 thru 0x8e0f59d (0x1e7d bytes) 2024-09-05T17:31:28.120 INFO:teuthology.orchestra.run.smithi050.stdout:2985 trunc from 0xce0b1a5 to 0x7a16a72 2024-09-05T17:31:28.139 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:28.142+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:28.164 INFO:teuthology.orchestra.run.smithi050.stdout:2986 write 0x603d145 thru 0x6040588 (0x3444 bytes) 2024-09-05T17:31:28.185 INFO:teuthology.orchestra.run.smithi050.stdout:2989 writesame 0x83497a9 thru 0x8352e44 data_size 0x54(0x969c bytes) 2024-09-05T17:31:28.185 INFO:teuthology.orchestra.run.smithi050.stdout:2990 read 0x7749963 thru 0x774fd11 (0x63af bytes) 2024-09-05T17:31:28.191 INFO:teuthology.orchestra.run.smithi050.stdout:2991 trunc from 0x8352e45 to 0xa81a8b2 2024-09-05T17:31:28.206 INFO:teuthology.orchestra.run.smithi050.stdout:2993 read 0x33da1df thru 0x33e1c74 (0x7a96 bytes) 2024-09-05T17:31:28.207 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:28.207 INFO:teuthology.orchestra.run.smithi050.stdout:2995 write 0xa6b205d thru 0xa6b535a (0x32fe bytes) 2024-09-05T17:31:28.213 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:28.213 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:28.213 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:28.213 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:28.213 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:28.215 INFO:teuthology.orchestra.run.smithi050.stdout:2996 read 0x82fa40e thru 0x8308585 (0xe178 bytes) 2024-09-05T17:31:28.215 INFO:teuthology.orchestra.run.smithi050.stdout:2997 writesame 0x6c0866c thru 0x6c09a6d data_size 0xd(0x1402 bytes) 2024-09-05T17:31:28.218 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:28.218 INFO:teuthology.orchestra.run.smithi050.stdout:3001 read 0x9b69cf3 thru 0x9b782d3 (0xe5e1 bytes) 2024-09-05T17:31:28.218 INFO:teuthology.orchestra.run.smithi050.stdout:3002 read 0x6c72259 thru 0x6c75088 (0x2e30 bytes) 2024-09-05T17:31:28.219 INFO:teuthology.orchestra.run.smithi050.stdout:3003 read 0x44592df thru 0x4468b1d (0xf83f bytes) 2024-09-05T17:31:28.221 INFO:teuthology.orchestra.run.smithi050.stdout:3004 write 0x1bb79d5 thru 0x1bc38be (0xbeea bytes) 2024-09-05T17:31:28.228 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:28.229 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:28.249 INFO:teuthology.orchestra.run.smithi050.stdout:3008 write 0xe3aa2bf thru 0xe3adaba (0x37fc bytes) 2024-09-05T17:31:28.255 INFO:teuthology.orchestra.run.smithi050.stdout:3009 read 0x5e912a7 thru 0x5e93ebe (0x2c18 bytes) 2024-09-05T17:31:28.255 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:28.255 INFO:teuthology.orchestra.run.smithi050.stdout:3012 read 0xabf262f thru 0xabf5503 (0x2ed5 bytes) 2024-09-05T17:31:28.255 INFO:teuthology.orchestra.run.smithi050.stdout:3013 write 0xd974ea7 thru 0xd9787d7 (0x3931 bytes) 2024-09-05T17:31:28.261 INFO:teuthology.orchestra.run.smithi050.stdout:3015 read 0xa2ffba4 thru 0xa30ec9a (0xf0f7 bytes) 2024-09-05T17:31:28.272 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:28.274+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:28.290 INFO:teuthology.orchestra.run.smithi050.stdout:3016 trunc from 0xe3adabb to 0x2003705 2024-09-05T17:31:28.341 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:28.342+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:28.367 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:28.367 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:28.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:28.367 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.655107877999999, 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:31:28.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:31:28.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:31:28.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:31:28.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:31:28.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.373 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.373 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.374 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:28.374 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.655060494000001, 2024-09-05T17:31:28.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:31:28.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:31:28.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.376 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:28.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:28.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:31:28.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:31:28.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:31:28.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:31:28.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:31:28.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:31:28.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:31:28.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:31:28.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:31:28.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:31:28.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:28.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.655015821999999, 2024-09-05T17:31:28.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:31:28.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.384 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.384 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:31:28.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.385 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:28.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:28.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:31:28.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:31:28.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:31:28.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:31:28.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:31:28.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:31:28.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:31:28.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:31:28.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:31:28.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:31:28.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:31:28.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:31:28.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:31:28.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:31:28.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.393 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:28.393 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.654970479999999, 2024-09-05T17:31:28.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:31:28.393 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:28.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:31:28.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:31:28.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.654901469999999, 2024-09-05T17:31:28.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:31:28.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.404 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.654853032999998, 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:31:28.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:31:28.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:28.409 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.654806675, 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:31:28.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.654144084999999, 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.414 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:28.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.654052739000001, 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.419 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:31:28.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.653991259000001, 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:31:28.423 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:28.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:31:28.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:31:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:28.428 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.653934359000001, 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:28.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:31:28.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.653841117999999, 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.433 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:31:28.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.653781590000001, 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:31:28.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.442 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.646625627999999, 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:31:28.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.646564161000001, 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.447 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:31:28.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.644696192000001, 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:31:28.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:31:28.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.644655682, 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:31:28.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:31:28.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:28.461 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.644617216, 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:31:28.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.644559108999999, 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:31:28.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.644501808000001, 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:31:28.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:31:28.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:31:28.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.475 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:28.478 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:28.478 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:28.478+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:3017 writesame 0x701a12b thru 0x702729e data_size 0x23(0xd174 bytes) 2024-09-05T17:31:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:3019 punch from 0x93e347 to 0x94aaeb, (0xc7a4 bytes) 2024-09-05T17:31:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:3020 trunc from 0x702729f to 0x37160fc 2024-09-05T17:31:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:28.479 INFO:teuthology.orchestra.run.smithi050.stdout:3022 write 0x2746d70 thru 0x275028a (0x951b bytes) 2024-09-05T17:31:28.479 INFO:teuthology.orchestra.run.smithi050.stdout:3025 writesame 0xa0b29df thru 0xa0b50a6 data_size 0x44(0x26c8 bytes) 2024-09-05T17:31:28.479 INFO:teuthology.orchestra.run.smithi050.stdout:3026 trunc from 0xa0b50a7 to 0x7b7d788 2024-09-05T17:31:28.479 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:28.479 INFO:teuthology.orchestra.run.smithi050.stdout:3028 write 0x2c7a2bf thru 0x2c7d465 (0x31a7 bytes) 2024-09-05T17:31:28.482 INFO:teuthology.orchestra.run.smithi050.stdout:3030 write 0xaf45af1 thru 0xaf4864b (0x2b5b bytes) 2024-09-05T17:31:28.512 INFO:teuthology.orchestra.run.smithi050.stdout:3031 writesame 0xe30f084 thru 0xe31cd67 data_size 0x4(0xdce4 bytes) 2024-09-05T17:31:28.527 INFO:teuthology.orchestra.run.smithi050.stdout:3033 write 0xeb98409 thru 0xeba0801 (0x83f9 bytes) 2024-09-05T17:31:28.534 INFO:teuthology.orchestra.run.smithi050.stdout:3034 write 0x1f2d224 thru 0x1f2eeb4 (0x1c91 bytes) 2024-09-05T17:31:28.537 INFO:teuthology.orchestra.run.smithi050.stdout:3035 read 0xd1c964e thru 0xd1d314c (0x9aff bytes) 2024-09-05T17:31:28.538 INFO:teuthology.orchestra.run.smithi050.stdout:3037 write 0xa6e6c7e thru 0xa6eacd2 (0x4055 bytes) 2024-09-05T17:31:28.545 INFO:teuthology.orchestra.run.smithi050.stdout:3038 writesame 0x422456 thru 0x427472 data_size 0x1(0x501d bytes) 2024-09-05T17:31:28.569 INFO:teuthology.orchestra.run.smithi050.stdout:3040 writesame 0x59ed605 thru 0x59ed938 data_size 0x2(0x334 bytes) 2024-09-05T17:31:28.577 INFO:teuthology.orchestra.run.smithi050.stdout:3042 read 0x473f632 thru 0x474d456 (0xde25 bytes) 2024-09-05T17:31:28.577 INFO:teuthology.orchestra.run.smithi050.stdout:3043 read 0x79b96e thru 0x79e896 (0x2f29 bytes) 2024-09-05T17:31:28.578 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:28.578+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:28.578 INFO:teuthology.orchestra.run.smithi050.stdout:3044 write 0x9f4c2c2 thru 0x9f51ad5 (0x5814 bytes) 2024-09-05T17:31:28.586 INFO:teuthology.orchestra.run.smithi050.stdout:3045 write 0x81a647 thru 0x8278a7 (0xd261 bytes) 2024-09-05T17:31:28.590 INFO:teuthology.orchestra.run.smithi050.stdout:3046 read 0xbe3af4 thru 0xbe65f5 (0x2b02 bytes) 2024-09-05T17:31:28.591 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:28.605 INFO:teuthology.orchestra.run.smithi050.stdout:3048 trunc from 0xeba0802 to 0x9a175dc 2024-09-05T17:31:28.632 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:28.633 INFO:teuthology.orchestra.run.smithi050.stdout:3050 write 0x118dd29 thru 0x118fd55 (0x202d bytes) 2024-09-05T17:31:28.641 INFO:teuthology.orchestra.run.smithi050.stdout:3051 write 0x4e9b125 thru 0x4ea924b (0xe127 bytes) 2024-09-05T17:31:28.649 INFO:teuthology.orchestra.run.smithi050.stdout:3052 write 0x8d2d0a1 thru 0x8d2ee4b (0x1dab bytes) 2024-09-05T17:31:28.655 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:28.655 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:28.655 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:28.656 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:28.656 INFO:teuthology.orchestra.run.smithi050.stdout:3053 write 0x92e78e6 thru 0x92f73cb (0xfae6 bytes) 2024-09-05T17:31:28.664 INFO:teuthology.orchestra.run.smithi050.stdout:3054 read 0xddbea2 thru 0xde89a4 (0xcb03 bytes) 2024-09-05T17:31:28.665 INFO:teuthology.orchestra.run.smithi050.stdout:3055 punch from 0x97ce05d to 0x97ce3c8, (0x36b bytes) 2024-09-05T17:31:28.665 INFO:teuthology.orchestra.run.smithi050.stdout:3056 write 0x6838a97 thru 0x6840ee6 (0x8450 bytes) 2024-09-05T17:31:28.671 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:28.672 INFO:teuthology.orchestra.run.smithi050.stdout:3057 punch from 0x4e29ded to 0x4e3304e, (0x9261 bytes) 2024-09-05T17:31:28.678 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:28.682+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:28.691 INFO:teuthology.orchestra.run.smithi050.stdout:3058 writesame 0xc1cf3a3 thru 0xc1dde80 data_size 0x1(0xeade bytes) 2024-09-05T17:31:28.691 INFO:teuthology.orchestra.run.smithi050.stdout:3059 read 0xbf49a31 thru 0xbf4c2e7 (0x28b7 bytes) 2024-09-05T17:31:28.691 INFO:teuthology.orchestra.run.smithi050.stdout:3060 punch from 0x8ea75dd to 0x8eac4f9, (0x4f1c bytes) 2024-09-05T17:31:28.691 INFO:teuthology.orchestra.run.smithi050.stdout:3061 read 0xb9a6e2f thru 0xb9ac07f (0x5251 bytes) 2024-09-05T17:31:28.702 INFO:teuthology.orchestra.run.smithi050.stdout:3062 trunc from 0xc1dde81 to 0x7d52759 2024-09-05T17:31:28.724 INFO:teuthology.orchestra.run.smithi050.stdout:3063 read 0x3c20e69 thru 0x3c27df9 (0x6f91 bytes) 2024-09-05T17:31:28.724 INFO:teuthology.orchestra.run.smithi050.stdout:3064 write 0x27ecf19 thru 0x27f986c (0xc954 bytes) 2024-09-05T17:31:28.755 INFO:teuthology.orchestra.run.smithi050.stdout:3066 write 0xd793dff thru 0xd796283 (0x2485 bytes) 2024-09-05T17:31:28.763 INFO:teuthology.orchestra.run.smithi050.stdout:3067 clone 15 order 25 su 16777216 sc 3 2024-09-05T17:31:28.780 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:28.782+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:28.796 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:28.796 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:28.796 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:28.796 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:28.796 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:28.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:28.881 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:28.882+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:28.978 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:28.978 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:28.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:28.978 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:28.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.978 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:28.978 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233808648, 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:31:28.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:31:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:31:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:31:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233750454999999, 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:31:28.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.989 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233689137000001, 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:31:28.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:31:28.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:31:28.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.994 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.994 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233622670000001, 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:28.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:31:28.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.998 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233546513, 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:28.999 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:31:29.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233483546, 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:31:29.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:31:29.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:31:29.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233421815, 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.009 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:31:29.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233338787999999, 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.014 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:31:29.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233280113999999, 2024-09-05T17:31:29.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.022 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233223167, 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:31:29.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233158692, 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.027 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:31:29.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233088039, 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.233011049, 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.035 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:31:29.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.232952288, 2024-09-05T17:31:29.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:31:29.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.232889617, 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:29.048 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.232827486, 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.052 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.232708411000001, 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:31:29.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.23265396, 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:31:29.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:31:29.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:31:29.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:31:29.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.062 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.23249152, 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.063 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.231307133, 2024-09-05T17:31:29.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:31:29.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:31:29.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.072 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.072 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.072 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:29.073 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:29.074 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:29.074+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:29.175 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:29.174+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:29.200 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:29.200 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:29.201 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:29.201 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:29.215 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:29.301 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:29.302+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:29.376 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:29.378+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:29.381 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:29.381 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:29.381 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:29.381 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:29.381 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:29.395 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:29.478 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:29.478+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:29.562 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:8976 3.10 3:0f1f7ceb:::rbd_data.11403f2d9bbd.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-05T17:31:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.064265266, 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043813337000000001, 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 8976 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498241+0000", 2024-09-05T17:31:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6529999999999998e-06 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498253+0000", 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1681999999999999e-05 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498283+0000", 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0097999999999999e-05 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498299+0000", 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5498999999999998e-05 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498406+0000", 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010711 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498540+0000", 2024-09-05T17:31:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134461 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.506438+0000", 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078981060000000002 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541694+0000", 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.035255701 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541815+0000", 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541919+0000", 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010451299999999999 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.542052+0000", 2024-09-05T17:31:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132745 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28575 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.885306135, 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041664701999999998, 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28575 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677199+0000", 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0699999999999996e-07 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677203+0000", 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1869999999999999e-06 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677219+0000", 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5724999999999999e-05 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677230+0000", 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1902999999999999e-05 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717588+0000", 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040357993000000002 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717758+0000", 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016953399999999999 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718863+0000", 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011046529999999999 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28576 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.885260584000001, 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042556272999999999, 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28576 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677245+0000", 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.494e-06 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677250+0000", 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.276e-06 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677280+0000", 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9451999999999999e-05 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677288+0000", 2024-09-05T17:31:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5990000000000002e-06 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718928+0000", 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041639279000000001 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719099+0000", 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000171151 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719800+0000", 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00070102200000000004 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28577 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 69632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.884875033, 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04307043, 2024-09-05T17:31:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28577 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677631+0000", 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0760000000000001e-06 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677640+0000", 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1560000000000001e-06 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677666+0000", 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6156000000000002e-05 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677686+0000", 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9321999999999999e-05 2024-09-05T17:31:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719867+0000", 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042181070000000001 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720043+0000", 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176496 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720699+0000", 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065615400000000005 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28578 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.884789307999998, 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043977430999999997, 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.584 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28578 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677716+0000", 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.533e-06 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677723+0000", 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.613e-06 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677742+0000", 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8629000000000001e-05 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677756+0000", 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4566000000000001e-05 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720766+0000", 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043009798000000002 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721003+0000", 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721692+0000", 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068963399999999995 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28579 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.884727480999999, 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044067576999999997, 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28579 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677778+0000", 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.043e-06 2024-09-05T17:31:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677783+0000", 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-06 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677801+0000", 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7825999999999998e-05 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677815+0000", 2024-09-05T17:31:29.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3532e-05 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721827+0000", 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044012451000000001 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721844+0000", 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7144999999999999e-05 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28580 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.884668241, 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044087135, 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28580 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677837+0000", 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2130000000000001e-06 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677843+0000", 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1e-06 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677862+0000", 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8719000000000002e-05 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677876+0000", 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4079e-05 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721907+0000", 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044030712999999999 2024-09-05T17:31:29.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721923+0000", 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6311e-05 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28581 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.884603757000001, 2024-09-05T17:31:29.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044089852999999998, 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28581 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:29.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677902+0000", 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.28e-06 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677907+0000", 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6019999999999999e-06 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677926+0000", 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8346e-05 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677939+0000", 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3796e-05 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721974+0000", 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044035004000000003 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721990+0000", 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5824999999999998e-05 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.601 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28662 3.a 3.10099d2a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.882606918, 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042160502000000002, 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28662 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679900+0000", 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.407e-06 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679912+0000", 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.219e-05 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679937+0000", 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5525e-05 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679958+0000", 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0268e-05 2024-09-05T17:31:29.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722042+0000", 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042084253000000002 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722058+0000", 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5858999999999998e-05 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28700 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880476191, 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040505403000000002, 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28700 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682029+0000", 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682035+0000", 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5999999999999997e-06 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682052+0000", 2024-09-05T17:31:29.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6833e-05 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682064+0000", 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2795e-05 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722517+0000", 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040453000000000003 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722533+0000", 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5798999999999999e-05 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28701 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880423174000001, 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040534632000000001, 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28701 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:29.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682082+0000", 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0729999999999999e-06 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682087+0000", 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8829999999999997e-06 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682103+0000", 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6049000000000002e-05 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682117+0000", 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3740000000000001e-05 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722583+0000", 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040466323999999998 2024-09-05T17:31:29.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722616+0000", 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2563e-05 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28702 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880368730000001, 2024-09-05T17:31:29.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040547896999999999, 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28702 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682137+0000", 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2899999999999999e-06 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682143+0000", 2024-09-05T17:31:29.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0159999999999997e-06 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682160+0000", 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7655999999999998e-05 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682175+0000", 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4836e-05 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722665+0000", 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040490155999999999 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722683+0000", 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7943000000000001e-05 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28703 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.618 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880310213000001, 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040556400999999999, 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28703 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:29.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682195+0000", 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682201+0000", 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5729999999999998e-06 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682218+0000", 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7915999999999999e-05 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682232+0000", 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3576e-05 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722734+0000", 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040502437000000002 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722750+0000", 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5756e-05 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.622 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28704 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880252342999999, 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040560355999999999, 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28704 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682253+0000", 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.153e-06 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682258+0000", 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5629999999999999e-06 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682275+0000", 2024-09-05T17:31:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6983e-05 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682290+0000", 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4158999999999999e-05 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722798+0000", 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040508294 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722812+0000", 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4204e-05 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28705 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880194476, 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040566735, 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.627 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28705 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682311+0000", 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.187e-06 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682316+0000", 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4929999999999998e-06 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682334+0000", 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7305000000000001e-05 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682347+0000", 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.328e-05 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722861+0000", 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040513999000000002 2024-09-05T17:31:29.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722876+0000", 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5471000000000001e-05 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28706 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880138592000002, 2024-09-05T17:31:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040580441000000002, 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28706 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682367+0000", 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682385+0000", 2024-09-05T17:31:29.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8352e-05 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682403+0000", 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7940000000000001e-05 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682417+0000", 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4285e-05 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722930+0000", 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040512907000000001 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722946+0000", 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5537e-05 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28707 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:29.635 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880065556000002, 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040576270999999997, 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28707 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682440+0000", 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1200000000000001e-06 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682445+0000", 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6899999999999997e-06 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682463+0000", 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7765999999999999e-05 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682477+0000", 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3465999999999999e-05 2024-09-05T17:31:29.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722998+0000", 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040521807 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723015+0000", 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6422e-05 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28708 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.880005704999999, 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040582981999999997, 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28708 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682500+0000", 2024-09-05T17:31:29.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.26e-06 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682505+0000", 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6489999999999996e-06 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682523+0000", 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682535+0000", 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2313000000000001e-05 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723066+0000", 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040530432999999998 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723081+0000", 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5784999999999999e-05 2024-09-05T17:31:29.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28709 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.879949287999999, 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040593911000000003, 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28709 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682556+0000", 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.19e-06 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682561+0000", 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4820000000000002e-06 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682579+0000", 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7430000000000001e-05 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682593+0000", 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799e-05 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723133+0000", 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040540208000000001 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723149+0000", 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5801999999999999e-05 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28710 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.879871512000001, 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040581488999999998, 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:29.648 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28710 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682634+0000", 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.483e-06 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682640+0000", 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.319e-06 2024-09-05T17:31:29.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682659+0000", 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8266000000000001e-05 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682673+0000", 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.431e-05 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723198+0000", 2024-09-05T17:31:29.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040525383999999998 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723214+0000", 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5727e-05 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:29.652 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:29.654 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:29.654 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:29.653+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:29.695 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:31:29.731 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:29.754 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:29.753+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:29.817 INFO:teuthology.orchestra.run.smithi050.stdout:leaving image image_client.0-clone14 intact 2024-09-05T17:31:29.826 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:29.826 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:29.826 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:29.826 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:29.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:29.855 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:29.858+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:29.909 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:29.910 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:29.928 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:30.006 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:30.006 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:30.006 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:30.007 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:30.007 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:30.007 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:30.008 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:30.008 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:30.008 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:30.009 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:30.010+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:30.011 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:30.011 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:30.011 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:30.012 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:30.012 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:30.014 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-05T17:31:30.016 INFO:teuthology.orchestra.run.smithi050.stdout:3068 read 0xbeee13a thru 0xbef9bb2 (0xba79 bytes) 2024-09-05T17:31:30.017 INFO:teuthology.orchestra.run.smithi050.stdout:3069 write 0x92ad23a thru 0x92ae33c (0x1103 bytes) 2024-09-05T17:31:30.019 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:30.019 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:30.019 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-05T17:31:30.019 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.273515 2024-09-05T17:31:30.020 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0.2735145111383084 2024-09-05T17:31:30.027 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:30.029 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:30.029 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:30.030 INFO:teuthology.orchestra.run.smithi050.stdout:3070 write 0x34f1f52 thru 0x34f7b49 (0x5bf8 bytes) 2024-09-05T17:31:30.067 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:30.067 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:30.077 INFO:teuthology.orchestra.run.smithi050.stdout:3071 read 0xab147b1 thru 0xab17111 (0x2961 bytes) 2024-09-05T17:31:30.078 INFO:teuthology.orchestra.run.smithi050.stdout:3074 read 0x775e802 thru 0x776bcde (0xd4dd bytes) 2024-09-05T17:31:30.078 INFO:teuthology.orchestra.run.smithi050.stdout:3075 write 0xc6358ec thru 0xc63f626 (0x9d3b bytes) 2024-09-05T17:31:30.091 INFO:teuthology.orchestra.run.smithi050.stdout:3077 write 0xecb17bb thru 0xecba4b0 (0x8cf6 bytes) 2024-09-05T17:31:30.099 INFO:teuthology.orchestra.run.smithi050.stdout:3080 trunc from 0xecba4b1 to 0xbc3c925 2024-09-05T17:31:30.111 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:30.109+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:30.118 INFO:teuthology.orchestra.run.smithi050.stdout:3081 trunc from 0xbc3c925 to 0xa722bf1 2024-09-05T17:31:30.131 INFO:teuthology.orchestra.run.smithi050.stdout:3082 writesame 0x99047d8 thru 0x990f1ff data_size 0x21(0xaa28 bytes) 2024-09-05T17:31:30.135 INFO:teuthology.orchestra.run.smithi050.stdout:3083 punch from 0x4ee7560 to 0x4ef54c7, (0xdf67 bytes) 2024-09-05T17:31:30.135 INFO:teuthology.orchestra.run.smithi050.stdout:3084 read 0x79f0014 thru 0x79f2ded (0x2dda bytes) 2024-09-05T17:31:30.136 INFO:teuthology.orchestra.run.smithi050.stdout:3085 writesame 0x8d3eb41 thru 0x8d4467a data_size 0x1(0x5b3a bytes) 2024-09-05T17:31:30.153 INFO:teuthology.orchestra.run.smithi050.stdout:3086 read 0x900b7c6 thru 0x9011eac (0x66e7 bytes) 2024-09-05T17:31:30.153 INFO:teuthology.orchestra.run.smithi050.stdout:3087 read 0x83e5cbd thru 0x83e6dee (0x1132 bytes) 2024-09-05T17:31:30.154 INFO:teuthology.orchestra.run.smithi050.stdout:3088 write 0x3f925a6 thru 0x3f9ff7f (0xd9da bytes) 2024-09-05T17:31:30.156 INFO:teuthology.orchestra.run.smithi050.stdout:3091 writesame 0x3974914 thru 0x3974ffd data_size 0x2(0x6ea bytes) 2024-09-05T17:31:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:30.169 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:30.173 INFO:teuthology.orchestra.run.smithi050.stdout:3092 trunc from 0xa722bf1 to 0x60e8da 2024-09-05T17:31:30.185 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:30.191 INFO:teuthology.orchestra.run.smithi050.stdout:3093 read 0x5bd7c0 thru 0x5c29af (0x51f0 bytes) 2024-09-05T17:31:30.192 INFO:teuthology.orchestra.run.smithi050.stdout:3095 punch from 0x371fbc to 0x373198, (0x11dc bytes) 2024-09-05T17:31:30.192 INFO:teuthology.orchestra.run.smithi050.stdout:3096 read 0x349738 thru 0x355ee5 (0xc7ae bytes) 2024-09-05T17:31:30.192 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:30.197 INFO:teuthology.orchestra.run.smithi050.stdout:3098 trunc from 0x60e8da to 0x3292768 2024-09-05T17:31:30.204 INFO:teuthology.orchestra.run.smithi050.stdout:3099 write 0x2b22b26 thru 0x2b2e4c6 (0xb9a1 bytes) 2024-09-05T17:31:30.208 INFO:teuthology.orchestra.run.smithi050.stdout:3100 read 0xd73b4d thru 0xd7ef6b (0xb41f bytes) 2024-09-05T17:31:30.209 INFO:teuthology.orchestra.run.smithi050.stdout:3101 read 0x2f652f3 thru 0x2f6ea89 (0x9797 bytes) 2024-09-05T17:31:30.209 INFO:teuthology.orchestra.run.smithi050.stdout:3102 read 0x18fd3e3 thru 0x1906532 (0x9150 bytes) 2024-09-05T17:31:30.209 INFO:teuthology.orchestra.run.smithi050.stdout:3103 read 0x2c9fb87 thru 0x2ca7ab5 (0x7f2f bytes) 2024-09-05T17:31:30.222 INFO:teuthology.orchestra.run.smithi050.stdout:3104 trunc from 0x3292768 to 0xc0b86ca 2024-09-05T17:31:30.228 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:30.229+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:30.229 INFO:teuthology.orchestra.run.smithi050.stdout:3106 read 0x4957f3c thru 0x4961ce4 (0x9da9 bytes) 2024-09-05T17:31:30.229 INFO:teuthology.orchestra.run.smithi050.stdout:3107 read 0x81c8d0c thru 0x81cf50d (0x6802 bytes) 2024-09-05T17:31:30.230 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:30.231 INFO:teuthology.orchestra.run.smithi050.stdout:3109 trunc from 0xc0b86ca to 0xd7069cf 2024-09-05T17:31:30.238 INFO:teuthology.orchestra.run.smithi050.stdout:3110 punch from 0xbbddcac to 0xbbdde41, (0x195 bytes) 2024-09-05T17:31:30.238 INFO:teuthology.orchestra.run.smithi050.stdout:3111 write 0x5b6045a thru 0x5b60834 (0x3db bytes) 2024-09-05T17:31:30.240 INFO:teuthology.orchestra.run.smithi050.stdout:3114 writesame 0xb0b17c7 thru 0xb0bd647 data_size 0x1(0xbe81 bytes) 2024-09-05T17:31:30.270 INFO:teuthology.orchestra.run.smithi050.stdout:3116 write 0xb8e2d77 thru 0xb8e5643 (0x28cd bytes) 2024-09-05T17:31:30.272 INFO:teuthology.orchestra.run.smithi050.stdout:3118 read 0xaabd7ee thru 0xaac8f95 (0xb7a8 bytes) 2024-09-05T17:31:30.272 INFO:teuthology.orchestra.run.smithi050.stdout:3119 read 0x570c487 thru 0x571bcc7 (0xf841 bytes) 2024-09-05T17:31:30.273 INFO:teuthology.orchestra.run.smithi050.stdout:3120 clone 16 order 24 su 4194304 sc 10 2024-09-05T17:31:30.309 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:30.309 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:30.313 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:30.313+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:30.323 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:30.414 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:30.413+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:30.495 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:30.510 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:30.555 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:30.558+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:30.616 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:30.613+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:30.629 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:30.630 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:30.644 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:30.681 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:31:30.682 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.4 primary-affinity to 0.273515 (8179252) 2024-09-05T17:31:30.717 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:30.717+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:30.805 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:30.805 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:30.818 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:30.817+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:30.820 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:30.919 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:30.922+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:30.949 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:30.949 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:30.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:31.024 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:31.025+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:31.121 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:31.121+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:31.139 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:31.139 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:31.153 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:31.222 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:31.221+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:31.283 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:31.284 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:31.298 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:31.323 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:31.321+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:31.419 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:31.419 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:31.424 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:31.426+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:31.434 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:31.525 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:31.525+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:31.595 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:31.595 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:31.610 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:31.655 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:31.658+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:31.727 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:31.725+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:31.745 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:31.745 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:31.760 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:31.840 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone15 from 0xd7069cf (overlap 0x60e8da) to 0x5737f7 2024-09-05T17:31:31.840 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:31.842+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:31.929 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:31.930+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:31.939 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:31.939 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:31.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:32.021 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-05T17:31:32.030 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:32.030+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:32.085 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:32.126 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:32.126 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:32.132 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:32.134+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:32.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:32.232 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:32.233+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:32.280 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:32.280 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:32.295 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:32.337 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:32.337+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:32.424 INFO:teuthology.orchestra.run.smithi050.stdout:3121 writesame 0x86feebc thru 0x8700059 data_size 0x16(0x119e bytes) 2024-09-05T17:31:32.434 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:32.433+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:32.441 INFO:teuthology.orchestra.run.smithi050.stdout:3122 read 0x469a4dd thru 0x469c4b5 (0x1fd9 bytes) 2024-09-05T17:31:32.441 INFO:teuthology.orchestra.run.smithi050.stdout:3123 write 0x4f4bb44 thru 0x4f5a3ad (0xe86a bytes) 2024-09-05T17:31:32.445 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:32.445 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:32.451 INFO:teuthology.orchestra.run.smithi050.stdout:3124 writesame 0x3f47119 thru 0x3f51f8f data_size 0x1(0xae77 bytes) 2024-09-05T17:31:32.456 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:32.456 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:32.470 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:32.471 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:32.471 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:32.495 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:32.496 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:32.501 INFO:teuthology.orchestra.run.smithi050.stdout:3126 read 0x7264aa thru 0x72904f (0x2ba6 bytes) 2024-09-05T17:31:32.515 INFO:teuthology.orchestra.run.smithi050.stdout:3127 trunc from 0xd7069cf to 0x6f39cff 2024-09-05T17:31:32.528 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:32.528 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:32.554 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:32.555 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:32.556 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:32.557+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:32.564 INFO:teuthology.orchestra.run.smithi050.stdout:3129 write 0xda84a2a thru 0xda87ee2 (0x34b9 bytes) 2024-09-05T17:31:32.569 INFO:teuthology.orchestra.run.smithi050.stdout:3130 read 0x3358326 thru 0x3365f9b (0xdc76 bytes) 2024-09-05T17:31:32.569 INFO:teuthology.orchestra.run.smithi050.stdout:3133 punch from 0x4d5f10a to 0x4d6c831, (0xd727 bytes) 2024-09-05T17:31:32.570 INFO:teuthology.orchestra.run.smithi050.stdout:3134 read 0xc88d7a2 thru 0xc890851 (0x30b0 bytes) 2024-09-05T17:31:32.570 INFO:teuthology.orchestra.run.smithi050.stdout:3135 write 0x1b0dec5 thru 0x1b14cd6 (0x6e12 bytes) 2024-09-05T17:31:32.571 INFO:teuthology.orchestra.run.smithi050.stdout:3136 read 0x11d9739 thru 0x11e751e (0xdde6 bytes) 2024-09-05T17:31:32.572 INFO:teuthology.orchestra.run.smithi050.stdout:3137 writesame 0x42e5d68 thru 0x42ef1cd data_size 0x1d(0x9466 bytes) 2024-09-05T17:31:32.573 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:32.574 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:32.575 INFO:teuthology.orchestra.run.smithi050.stdout:3138 punch from 0xcd571f3 to 0xcd5eebd, (0x7cca bytes) 2024-09-05T17:31:32.576 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:32.576 INFO:teuthology.orchestra.run.smithi050.stdout:3140 writesame 0x1d701ba thru 0x1d7b167 data_size 0x71(0xafae bytes) 2024-09-05T17:31:32.576 INFO:teuthology.orchestra.run.smithi050.stdout:3141 read 0xce8ec9c thru 0xce91004 (0x2369 bytes) 2024-09-05T17:31:32.576 INFO:teuthology.orchestra.run.smithi050.stdout:3142 writesame 0xbb0b56c thru 0xbb0d17d data_size 0x1(0x1c12 bytes) 2024-09-05T17:31:32.589 INFO:teuthology.orchestra.run.smithi050.stdout:3143 trunc from 0xda87ee3 to 0x8bb6e2e 2024-09-05T17:31:32.594 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:32.594 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:32.605 INFO:teuthology.orchestra.run.smithi050.stdout:3144 read 0x3b18333 thru 0x3b1b2d9 (0x2fa7 bytes) 2024-09-05T17:31:32.606 INFO:teuthology.orchestra.run.smithi050.stdout:3145 punch from 0x7c588c7 to 0x7c655d2, (0xcd0b bytes) 2024-09-05T17:31:32.606 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:32.606 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:32.606 INFO:teuthology.orchestra.run.smithi050.stdout:3148 read 0x8bacad6 thru 0x8bb6e2d (0xa358 bytes) 2024-09-05T17:31:32.606 INFO:teuthology.orchestra.run.smithi050.stdout:3149 write 0x62171e5 thru 0x621fad9 (0x88f5 bytes) 2024-09-05T17:31:32.610 INFO:teuthology.orchestra.run.smithi050.stdout:3150 punch from 0x8b71011 to 0x8b78785, (0x7774 bytes) 2024-09-05T17:31:32.610 INFO:teuthology.orchestra.run.smithi050.stdout:3151 writesame 0x2927596 thru 0x2934bf7 data_size 0x9(0xd662 bytes) 2024-09-05T17:31:32.616 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:32.616 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:32.629 INFO:teuthology.orchestra.run.smithi050.stdout:3152 write 0xdee48d3 thru 0xdef3ddb (0xf509 bytes) 2024-09-05T17:31:32.634 INFO:teuthology.orchestra.run.smithi050.stdout:3153 read 0x31bc908 thru 0x31c4bcb (0x82c4 bytes) 2024-09-05T17:31:32.635 INFO:teuthology.orchestra.run.smithi050.stdout:3154 punch from 0x2d9afb0 to 0x2d9f856, (0x48a6 bytes) 2024-09-05T17:31:32.636 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:32.633+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:32.636 INFO:teuthology.orchestra.run.smithi050.stdout:3155 trunc from 0xdef3ddc to 0xd38fef7 2024-09-05T17:31:32.646 INFO:teuthology.orchestra.run.smithi050.stdout:3156 write 0x55c282a thru 0x55c2e60 (0x637 bytes) 2024-09-05T17:31:32.647 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:32.647 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:32.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:32.647 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:32.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.647 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.647 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:32.647 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.942976621, 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:31:32.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:31:32.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.942929237000001, 2024-09-05T17:31:32.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:31:32.653 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.653 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.653 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.653 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:31:32.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.657 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.942884565, 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:31:32.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.942839223, 2024-09-05T17:31:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:31:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.663 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:31:32.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.667 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.942770212999999, 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:31:32.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:31:32.672 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.942721775999999, 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.673 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:31:32.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.677 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.942675418, 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:31:32.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.942012827999999, 2024-09-05T17:31:32.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:31:32.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.941921482000001, 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:31:32.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.691 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.941860001999999, 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:31:32.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.941803102000002, 2024-09-05T17:31:32.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:31:32.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.941709861, 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:31:32.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.705 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.941650332999998, 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:31:32.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.934494371, 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.710 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:31:32.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:31:32.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.934432904000001, 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:31:32.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:31:32.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.932564934999998, 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.720 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:31:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:31:32.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.932524425, 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:31:32.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.932485959000001, 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:31:32.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:31:32.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:32.734 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.932427852, 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:31:32.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.932370550999998, 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:32.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:32.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:31:32.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:31:32.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:31:32.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.744 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:32.744 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:32.744 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:32.744 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:31:32.747 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:32.747 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:32.745+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3157 write 0xab8c7ce thru 0xab917aa (0x4fdd bytes) 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3159 write 0xe66e74d thru 0xe673295 (0x4b49 bytes) 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3160 write 0x183ea98 thru 0x1843e22 (0x538b bytes) 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3163 trunc from 0xe673296 to 0xecdfc84 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3164 write 0xbb2e1fc thru 0xbb3c58b (0xe390 bytes) 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3165 write 0x6fb8c2c thru 0x6fbf8de (0x6cb3 bytes) 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3166 read 0xd2684f1 thru 0xd275b5d (0xd66d bytes) 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3167 read 0xae00e33 thru 0xae0795f (0x6b2d bytes) 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3168 trunc from 0xecdfc84 to 0x2e866b8 2024-09-05T17:31:32.748 INFO:teuthology.orchestra.run.smithi050.stdout:3169 writesame 0x2149089 thru 0x214abb7 data_size 0x1(0x1b2f bytes) 2024-09-05T17:31:32.763 INFO:teuthology.orchestra.run.smithi050.stdout:3170 writesame 0xb5c681a thru 0xb5cdbfd data_size 0x2(0x73e4 bytes) 2024-09-05T17:31:32.763 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:32.772 INFO:teuthology.orchestra.run.smithi050.stdout:3173 trunc from 0xb5cdbfe to 0x6efc633 2024-09-05T17:31:32.786 INFO:teuthology.orchestra.run.smithi050.stdout:3174 read 0x24dc1c4 thru 0x24dfd95 (0x3bd2 bytes) 2024-09-05T17:31:32.786 INFO:teuthology.orchestra.run.smithi050.stdout:3178 writesame 0x4f18944 thru 0x4f1c1e6 data_size 0x1b(0x38a3 bytes) 2024-09-05T17:31:32.789 INFO:teuthology.orchestra.run.smithi050.stdout:3179 punch from 0x200b0c5 to 0x2019023, (0xdf5e bytes) 2024-09-05T17:31:32.789 INFO:teuthology.orchestra.run.smithi050.stdout:3180 read 0x44a46d4 thru 0x44a9c1e (0x554b bytes) 2024-09-05T17:31:32.803 INFO:teuthology.orchestra.run.smithi050.stdout:3181 writesame 0x8794bf0 thru 0x87a235f data_size 0x48(0xd770 bytes) 2024-09-05T17:31:32.806 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:32.806 INFO:teuthology.orchestra.run.smithi050.stdout:3183 punch from 0x223bf16 to 0x224154b, (0x5635 bytes) 2024-09-05T17:31:32.815 INFO:teuthology.orchestra.run.smithi050.stdout:3184 trunc from 0x87a2360 to 0xd935395 2024-09-05T17:31:32.838 INFO:teuthology.orchestra.run.smithi050.stdout:3186 trunc from 0xd935395 to 0x51d69a9 2024-09-05T17:31:32.847 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:32.845+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:32.850 INFO:teuthology.orchestra.run.smithi050.stdout:3187 write 0x1a8cc5d thru 0x1a953bb (0x875f bytes) 2024-09-05T17:31:32.861 INFO:teuthology.orchestra.run.smithi050.stdout:3188 trunc from 0x51d69a9 to 0xa98e84d 2024-09-05T17:31:32.870 INFO:teuthology.orchestra.run.smithi050.stdout:3189 write 0x1f28fb9 thru 0x1f2a56e (0x15b6 bytes) 2024-09-05T17:31:32.872 INFO:teuthology.orchestra.run.smithi050.stdout:3190 punch from 0x250afa2 to 0x2517d1f, (0xcd7d bytes) 2024-09-05T17:31:32.872 INFO:teuthology.orchestra.run.smithi050.stdout:3191 read 0x1ce0d25 thru 0x1cefdcb (0xf0a7 bytes) 2024-09-05T17:31:32.872 INFO:teuthology.orchestra.run.smithi050.stdout:3193 read 0x926daca thru 0x9277c5e (0xa195 bytes) 2024-09-05T17:31:32.873 INFO:teuthology.orchestra.run.smithi050.stdout:3194 write 0x2a3f66d thru 0x2a4344d (0x3de1 bytes) 2024-09-05T17:31:32.875 INFO:teuthology.orchestra.run.smithi050.stdout:3195 read 0x54751cc thru 0x547ffaf (0xade4 bytes) 2024-09-05T17:31:32.877 INFO:teuthology.orchestra.run.smithi050.stdout:3196 trunc from 0xa98e84d to 0xa14d396 2024-09-05T17:31:32.889 INFO:teuthology.orchestra.run.smithi050.stdout:3197 punch from 0x802c10f to 0x802c16b, (0x5c bytes) 2024-09-05T17:31:32.889 INFO:teuthology.orchestra.run.smithi050.stdout:3198 writesame 0x2f690e4 thru 0x2f70999 data_size 0x1(0x78b6 bytes) 2024-09-05T17:31:32.911 INFO:teuthology.orchestra.run.smithi050.stdout:3199 clone 17 order 25 su 524288 sc 2 2024-09-05T17:31:32.922 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:32.922 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:32.922 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:32.922 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:32.937 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:32.981 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:32.981+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:33.049 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:33.049+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:33.102 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:33.102 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:33.102 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:33.102 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:33.102 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:33.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:33.151 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:33.154+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:33.252 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:33.249+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:33.287 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.543478280999999, 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:31:33.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.292 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.543420088000001, 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:31:33.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:31:33.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:33.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.297 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.543358770000001, 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:31:33.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:31:33.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.543292303000001, 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:33.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:31:33.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:33.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:31:33.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.543216145999999, 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.307 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:31:33.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:31:33.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.543153179000001, 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:31:33.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.543091447999998, 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.543008421, 2024-09-05T17:31:33.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:31:33.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.324 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542949747000002, 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:31:33.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542892800000001, 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:31:33.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:33.333 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542828324999999, 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:31:33.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.337 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542757672, 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542680682, 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:31:33.342 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542621920999999, 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:31:33.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:31:33.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.54255925, 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:33.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:31:33.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542497119, 2024-09-05T17:31:33.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:33.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542378043999999, 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:31:33.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.361 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:33.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:31:33.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.364 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542323592999999, 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:31:33.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:31:33.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.542161152999999, 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:31:33.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:33.373 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.540976766, 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:33.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:31:33.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.378 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:33.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:33.380 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:33.382+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:33.480 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:33.482+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:33.548 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:33.548 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:33.548 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:33.562 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:33.580 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:33.582+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:33.682 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:33.681+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:33.685 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:33.685 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:33.685 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:33.685 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:33.685 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:33.699 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:33.722 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:31:33.795 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:33.798+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:8976 3.10 3:0f1f7ceb:::rbd_data.11403f2d9bbd.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.377398388000003, 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043813337000000001, 2024-09-05T17:31:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 8976 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498241+0000", 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6529999999999998e-06 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498253+0000", 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1681999999999999e-05 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498283+0000", 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0097999999999999e-05 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498299+0000", 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5498999999999998e-05 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498406+0000", 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010711 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498540+0000", 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134461 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.506438+0000", 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078981060000000002 2024-09-05T17:31:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541694+0000", 2024-09-05T17:31:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.035255701 2024-09-05T17:31:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541815+0000", 2024-09-05T17:31:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-05T17:31:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541919+0000", 2024-09-05T17:31:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010451299999999999 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.542052+0000", 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132745 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28575 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.198439257, 2024-09-05T17:31:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041664701999999998, 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28575 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677199+0000", 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0699999999999996e-07 2024-09-05T17:31:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677203+0000", 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1869999999999999e-06 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677219+0000", 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5724999999999999e-05 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677230+0000", 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1902999999999999e-05 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717588+0000", 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040357993000000002 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717758+0000", 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016953399999999999 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718863+0000", 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011046529999999999 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28576 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.198393706000001, 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042556272999999999, 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.890 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28576 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677245+0000", 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.494e-06 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677250+0000", 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.276e-06 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677280+0000", 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9451999999999999e-05 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677288+0000", 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5990000000000002e-06 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718928+0000", 2024-09-05T17:31:33.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041639279000000001 2024-09-05T17:31:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:33.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719099+0000", 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000171151 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719800+0000", 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00070102200000000004 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28577 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 69632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.198008155, 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04307043, 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28577 2024-09-05T17:31:33.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677631+0000", 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0760000000000001e-06 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677640+0000", 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1560000000000001e-06 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677666+0000", 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6156000000000002e-05 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677686+0000", 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9321999999999999e-05 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719867+0000", 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042181070000000001 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720043+0000", 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176496 2024-09-05T17:31:33.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720699+0000", 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065615400000000005 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28578 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.197922429999998, 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043977430999999997, 2024-09-05T17:31:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28578 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677716+0000", 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.533e-06 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677723+0000", 2024-09-05T17:31:33.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.613e-06 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677742+0000", 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8629000000000001e-05 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677756+0000", 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4566000000000001e-05 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720766+0000", 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043009798000000002 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721003+0000", 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721692+0000", 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068963399999999995 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28579 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.197860602999999, 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044067576999999997, 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.905 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28579 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677778+0000", 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.043e-06 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677783+0000", 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-06 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677801+0000", 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7825999999999998e-05 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677815+0000", 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3532e-05 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721827+0000", 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044012451000000001 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721844+0000", 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7144999999999999e-05 2024-09-05T17:31:33.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28580 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.197801363, 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044087135, 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28580 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677837+0000", 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2130000000000001e-06 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677843+0000", 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1e-06 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677862+0000", 2024-09-05T17:31:33.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8719000000000002e-05 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677876+0000", 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4079e-05 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721907+0000", 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044030712999999999 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721923+0000", 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6311e-05 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28581 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.197736879000001, 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044089852999999998, 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28581 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677902+0000", 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.28e-06 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677907+0000", 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6019999999999999e-06 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677926+0000", 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8346e-05 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677939+0000", 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3796e-05 2024-09-05T17:31:33.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721974+0000", 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044035004000000003 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721990+0000", 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5824999999999998e-05 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28662 3.a 3.10099d2a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.19574004, 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042160502000000002, 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28662 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.918 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679900+0000", 2024-09-05T17:31:33.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.407e-06 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679912+0000", 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.219e-05 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679937+0000", 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5525e-05 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679958+0000", 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0268e-05 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722042+0000", 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042084253000000002 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722058+0000", 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5858999999999998e-05 2024-09-05T17:31:33.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28700 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193609313, 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040505403000000002, 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28700 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.923 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682029+0000", 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682035+0000", 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5999999999999997e-06 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682052+0000", 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6833e-05 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682064+0000", 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2795e-05 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722517+0000", 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040453000000000003 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722533+0000", 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5798999999999999e-05 2024-09-05T17:31:33.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28701 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193556296000001, 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040534632000000001, 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28701 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682082+0000", 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0729999999999999e-06 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682087+0000", 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8829999999999997e-06 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682103+0000", 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6049000000000002e-05 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682117+0000", 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3740000000000001e-05 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722583+0000", 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040466323999999998 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722616+0000", 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2563e-05 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28702 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193501852000001, 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040547896999999999, 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.931 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28702 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682137+0000", 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2899999999999999e-06 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682143+0000", 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0159999999999997e-06 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682160+0000", 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7655999999999998e-05 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682175+0000", 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4836e-05 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722665+0000", 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040490155999999999 2024-09-05T17:31:33.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722683+0000", 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7943000000000001e-05 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28703 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193443335000001, 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040556400999999999, 2024-09-05T17:31:33.935 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28703 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682195+0000", 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682201+0000", 2024-09-05T17:31:33.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5729999999999998e-06 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682218+0000", 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7915999999999999e-05 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682232+0000", 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3576e-05 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722734+0000", 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040502437000000002 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722750+0000", 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5756e-05 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.939 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28704 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193385464999999, 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040560355999999999, 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28704 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682253+0000", 2024-09-05T17:31:33.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.153e-06 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682258+0000", 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5629999999999999e-06 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682275+0000", 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6983e-05 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682290+0000", 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4158999999999999e-05 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722798+0000", 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040508294 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722812+0000", 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4204e-05 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.943 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28705 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193327598, 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040566735, 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.944 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28705 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682311+0000", 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.187e-06 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682316+0000", 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4929999999999998e-06 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682334+0000", 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7305000000000001e-05 2024-09-05T17:31:33.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682347+0000", 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.328e-05 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722861+0000", 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040513999000000002 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722876+0000", 2024-09-05T17:31:33.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5471000000000001e-05 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28706 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193271714000002, 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040580441000000002, 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.948 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28706 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682367+0000", 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682385+0000", 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8352e-05 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682403+0000", 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7940000000000001e-05 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682417+0000", 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4285e-05 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722930+0000", 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040512907000000001 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722946+0000", 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5537e-05 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.952 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28707 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193198678000002, 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040576270999999997, 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28707 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:33.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:33.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682440+0000", 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1200000000000001e-06 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682445+0000", 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6899999999999997e-06 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682463+0000", 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7765999999999999e-05 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682477+0000", 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3465999999999999e-05 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722998+0000", 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040521807 2024-09-05T17:31:33.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723015+0000", 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6422e-05 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28708 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193138826999999, 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040582981999999997, 2024-09-05T17:31:33.957 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28708 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682500+0000", 2024-09-05T17:31:33.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.26e-06 2024-09-05T17:31:33.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682505+0000", 2024-09-05T17:31:33.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6489999999999996e-06 2024-09-05T17:31:33.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682523+0000", 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682535+0000", 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2313000000000001e-05 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723066+0000", 2024-09-05T17:31:33.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040530432999999998 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723081+0000", 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5784999999999999e-05 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28709 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:33.962 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193082409999999, 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040593911000000003, 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28709 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:33.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682556+0000", 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.19e-06 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682561+0000", 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4820000000000002e-06 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682579+0000", 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7430000000000001e-05 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682593+0000", 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799e-05 2024-09-05T17:31:33.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723133+0000", 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040540208000000001 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723149+0000", 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5801999999999999e-05 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28710 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.193004634000001, 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040581488999999998, 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28710 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.967 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:33.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682634+0000", 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.483e-06 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682640+0000", 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.319e-06 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682659+0000", 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8266000000000001e-05 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682673+0000", 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.431e-05 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723198+0000", 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040525383999999998 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723214+0000", 2024-09-05T17:31:33.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5727e-05 2024-09-05T17:31:33.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.971 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:33.972 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:33.972 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:33.973 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone16 from 0xa14d396 (overlap 0x2e866b8) to 0x94e158 2024-09-05T17:31:33.974 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:33.974 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:33.974+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:34.075 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:34.073+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:34.104 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:34.104 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:34.104 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:34.105 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:34.119 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:34.176 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:34.178+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:34.180 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-05T17:31:34.211 INFO:teuthology.orchestra.run.smithi050.stdout:3200 writesame 0x2ebde5e thru 0x2eca897 data_size 0x3e(0xca3a bytes) 2024-09-05T17:31:34.276 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:34.277+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:34.279 INFO:teuthology.orchestra.run.smithi050.stdout:3202 writesame 0xe716ed2 thru 0xe71d113 data_size 0x1(0x6242 bytes) 2024-09-05T17:31:34.280 INFO:teuthology.orchestra.run.smithi050.stdout:3203 read 0x4853cbc thru 0x485da60 (0x9da5 bytes) 2024-09-05T17:31:34.281 INFO:teuthology.orchestra.run.smithi050.stdout:3204 read 0x8a9fab3 thru 0x8aa5173 (0x56c1 bytes) 2024-09-05T17:31:34.282 INFO:teuthology.orchestra.run.smithi050.stdout:3205 write 0x64ec655 thru 0x64f7b4d (0xb4f9 bytes) 2024-09-05T17:31:34.291 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:34.291 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:34.291 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:34.291 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:34.291 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:34.301 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.301 INFO:teuthology.orchestra.run.smithi050.stdout:3209 write 0xa32fbe3 thru 0xa33c448 (0xc866 bytes) 2024-09-05T17:31:34.308 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:34.313 INFO:teuthology.orchestra.run.smithi050.stdout:3210 read 0xae291a8 thru 0xae30f8e (0x7de7 bytes) 2024-09-05T17:31:34.313 INFO:teuthology.orchestra.run.smithi050.stdout:3211 read 0x91ad9b1 thru 0x91b080b (0x2e5b bytes) 2024-09-05T17:31:34.315 INFO:teuthology.orchestra.run.smithi050.stdout:3213 write 0x2b8de14 thru 0x2b966de (0x88cb bytes) 2024-09-05T17:31:34.319 INFO:teuthology.orchestra.run.smithi050.stdout:3214 read 0x77279d thru 0x7825fa (0xfe5e bytes) 2024-09-05T17:31:34.320 INFO:teuthology.orchestra.run.smithi050.stdout:3216 read 0x480000d thru 0x480098f (0x983 bytes) 2024-09-05T17:31:34.321 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.321 INFO:teuthology.orchestra.run.smithi050.stdout:3219 writesame 0x74aee97 thru 0x74b1d86 data_size 0x8(0x2ef0 bytes) 2024-09-05T17:31:34.325 INFO:teuthology.orchestra.run.smithi050.stdout:3220 write 0xde4e3b0 thru 0xde58c76 (0xa8c7 bytes) 2024-09-05T17:31:34.333 INFO:teuthology.orchestra.run.smithi050.stdout:3221 write 0x27ff321 thru 0x280f2b5 (0xff95 bytes) 2024-09-05T17:31:34.376 INFO:teuthology.orchestra.run.smithi050.stdout:3222 read 0x4ce5250 thru 0x4cf4f4b (0xfcfc bytes) 2024-09-05T17:31:34.377 INFO:teuthology.orchestra.run.smithi050.stdout:3223 read 0x1b6376d thru 0x1b6402e (0x8c2 bytes) 2024-09-05T17:31:34.378 INFO:teuthology.orchestra.run.smithi050.stdout:3224 writesame 0x785bc38 thru 0x7860e91 data_size 0x53(0x525a bytes) 2024-09-05T17:31:34.393 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:34.393+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:34.398 INFO:teuthology.orchestra.run.smithi050.stdout:3225 write 0x25e026f thru 0x25e4738 (0x44ca bytes) 2024-09-05T17:31:34.401 INFO:teuthology.orchestra.run.smithi050.stdout:3227 read 0x1af2727 thru 0x1af836a (0x5c44 bytes) 2024-09-05T17:31:34.402 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.402 INFO:teuthology.orchestra.run.smithi050.stdout:3229 punch from 0x7b27223 to 0x7b305f7, (0x93d4 bytes) 2024-09-05T17:31:34.402 INFO:teuthology.orchestra.run.smithi050.stdout:3230 read 0x8b9ff3b thru 0x8ba3860 (0x3926 bytes) 2024-09-05T17:31:34.403 INFO:teuthology.orchestra.run.smithi050.stdout:3231 punch from 0x9313853 to 0x9319cce, (0x647b bytes) 2024-09-05T17:31:34.403 INFO:teuthology.orchestra.run.smithi050.stdout:3232 read 0x6ef5d7f thru 0x6efb9e2 (0x5c64 bytes) 2024-09-05T17:31:34.404 INFO:teuthology.orchestra.run.smithi050.stdout:3234 write 0x762d898 thru 0x7637321 (0x9a8a bytes) 2024-09-05T17:31:34.408 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.408 INFO:teuthology.orchestra.run.smithi050.stdout:3237 write 0xb309a70 thru 0xb30bfbf (0x2550 bytes) 2024-09-05T17:31:34.411 INFO:teuthology.orchestra.run.smithi050.stdout:3238 read 0xae918e9 thru 0xae9dbc7 (0xc2df bytes) 2024-09-05T17:31:34.444 INFO:teuthology.orchestra.run.smithi050.stdout:3241 trunc from 0xe71d114 to 0x25ff6e8 2024-09-05T17:31:34.472 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.455220675000007, 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:31:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:31:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:31:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:31:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:31:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38987 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 253952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722791542, 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074851697999999994, 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38987 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749281+0000", 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.023e-06 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749286+0000", 2024-09-05T17:31:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999996e-06 2024-09-05T17:31:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749308+0000", 2024-09-05T17:31:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1141999999999998e-05 2024-09-05T17:31:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749321+0000", 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3653e-05 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.823944+0000", 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074623192000000005 2024-09-05T17:31:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824027+0000", 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.297e-05 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824132+0000", 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104548 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38988 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 268288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722733645000002, 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075009180999999994, 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38988 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749339+0000", 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0330000000000001e-06 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749344+0000", 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7230000000000004e-06 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749359+0000", 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5427e-05 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749385+0000", 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5469e-05 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824164+0000", 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074779258000000001 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824251+0000", 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6620999999999996e-05 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824347+0000", 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6650000000000005e-05 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38989 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 282624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722666254, 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075156843000000001, 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38989 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749407+0000", 2024-09-05T17:31:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749412+0000", 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8000000000000004e-06 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749430+0000", 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7816e-05 2024-09-05T17:31:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749444+0000", 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3919e-05 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824381+0000", 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074936661000000002 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824462+0000", 2024-09-05T17:31:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1176999999999999e-05 2024-09-05T17:31:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824562+0000", 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010029700000000001 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38990 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 296960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722609157000001, 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075320143000000006, 2024-09-05T17:31:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38990 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749464+0000", 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1769999999999999e-06 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749480+0000", 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5886e-05 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749498+0000", 2024-09-05T17:31:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8238999999999999e-05 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749512+0000", 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3876000000000001e-05 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824587+0000", 2024-09-05T17:31:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075075107000000002 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824657+0000", 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9859999999999999e-05 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824783+0000", 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125998 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38991 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722540723000002, 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075469580999999994, 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38991 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749532+0000", 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749538+0000", 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4469999999999997e-06 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749555+0000", 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749569+0000", 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3397000000000001e-05 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824814+0000", 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075245765000000006 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824900+0000", 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700999999999998e-05 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825001+0000", 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100556 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38992 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 325632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722486114999999, 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075625943000000001, 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38992 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:34.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749587+0000", 2024-09-05T17:31:34.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749591+0000", 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6970000000000001e-06 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749608+0000", 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6569e-05 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749621+0000", 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3457e-05 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825030+0000", 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075408915000000007 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825109+0000", 2024-09-05T17:31:34.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825212+0000", 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102644 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38993 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722433547000001, 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075788663000000006, 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38993 2024-09-05T17:31:34.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749639+0000", 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749659+0000", 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0092e-05 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749678+0000", 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8450000000000001e-05 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749693+0000", 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4583000000000001e-05 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825241+0000", 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075548134000000003 2024-09-05T17:31:34.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825323+0000", 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2410000000000005e-05 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825427+0000", 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103831 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.520 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38994 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 354304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722360154, 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075917854000000007, 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.521 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38994 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:34.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749713+0000", 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.097e-06 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749718+0000", 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3569999999999997e-06 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749735+0000", 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6969e-05 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749748+0000", 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825456+0000", 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075707846999999995 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825532+0000", 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5480000000000002e-05 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825629+0000", 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7785e-05 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38995 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 368640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722306609, 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076074345000000002, 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38995 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749766+0000", 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0470000000000001e-06 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749771+0000", 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8720000000000001e-06 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749788+0000", 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6762999999999999e-05 2024-09-05T17:31:34.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749819+0000", 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1056000000000002e-05 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825659+0000", 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075840487999999998 2024-09-05T17:31:34.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825738+0000", 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8862000000000005e-05 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825839+0000", 2024-09-05T17:31:34.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101257 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38996 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 382976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722234702000002, 2024-09-05T17:31:34.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076198058999999999, 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38996 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749838+0000", 2024-09-05T17:31:34.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8700000000000004e-07 2024-09-05T17:31:34.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749843+0000", 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.339e-06 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749860+0000", 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7059999999999999e-05 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749874+0000", 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3769e-05 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825869+0000", 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075995094999999999 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825945+0000", 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5661000000000006e-05 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826035+0000", 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0148000000000005e-05 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38997 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722180791, 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076361818999999997, 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.540 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.540 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38997 2024-09-05T17:31:34.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.540 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:34.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:34.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749892+0000", 2024-09-05T17:31:34.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0130000000000001e-06 2024-09-05T17:31:34.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749897+0000", 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6859999999999997e-06 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749913+0000", 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6637e-05 2024-09-05T17:31:34.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749927+0000", 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3396e-05 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826068+0000", 2024-09-05T17:31:34.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076140883000000006 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826148+0000", 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0698000000000006e-05 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826253+0000", 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010450600000000001 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38998 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 411648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722128250000001, 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076522440999999997, 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38998 2024-09-05T17:31:34.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749945+0000", 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9999999999999995e-07 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749949+0000", 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6500000000000004e-06 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749966+0000", 2024-09-05T17:31:34.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6756e-05 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749980+0000", 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3746e-05 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826284+0000", 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076304300000000005 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826364+0000", 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689000000000002e-05 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826466+0000", 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010230000000000001 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38999 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 425984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:34.550 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722073775999998, 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076686775999999998, 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38999 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749999+0000", 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.054e-06 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750004+0000", 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8459999999999999e-06 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750025+0000", 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750039+0000", 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4141999999999999e-05 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826498+0000", 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076458700000000004 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826584+0000", 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6123000000000002e-05 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826685+0000", 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010075499999999999 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39000 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 440320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.722014694999999, 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076822304999999994, 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39000 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750058+0000", 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1739999999999999e-06 2024-09-05T17:31:34.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750076+0000", 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7309e-05 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750097+0000", 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1345999999999999e-05 2024-09-05T17:31:34.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750111+0000", 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4205e-05 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826715+0000", 2024-09-05T17:31:34.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076604277999999998 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826792+0000", 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6561000000000001e-05 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826879+0000", 2024-09-05T17:31:34.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7431999999999999e-05 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39001 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.721942733999999, 2024-09-05T17:31:34.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076972354000000007, 2024-09-05T17:31:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39001 2024-09-05T17:31:34.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750130+0000", 2024-09-05T17:31:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1459999999999999e-06 2024-09-05T17:31:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750135+0000", 2024-09-05T17:31:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8169999999999998e-06 2024-09-05T17:31:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750155+0000", 2024-09-05T17:31:34.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0409000000000001e-05 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750169+0000", 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3786e-05 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826909+0000", 2024-09-05T17:31:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076740082000000001 2024-09-05T17:31:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827000+0000", 2024-09-05T17:31:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0956000000000001e-05 2024-09-05T17:31:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827101+0000", 2024-09-05T17:31:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101158 2024-09-05T17:31:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39002 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.721875674, 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077117667000000001, 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39002 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750197+0000", 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1599999999999999e-06 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750203+0000", 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6699999999999999e-06 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750228+0000", 2024-09-05T17:31:34.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5131999999999999e-05 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750243+0000", 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4610000000000001e-05 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827135+0000", 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076891994000000005 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827217+0000", 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2766e-05 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827314+0000", 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6335000000000005e-05 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39003 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.721809716999999, 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077268069999999994, 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39003 2024-09-05T17:31:34.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750263+0000", 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750269+0000", 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.48e-06 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750294+0000", 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4981999999999999e-05 2024-09-05T17:31:34.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750308+0000", 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4266e-05 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827344+0000", 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077036358999999999 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827428+0000", 2024-09-05T17:31:34.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3332999999999996e-05 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827530+0000", 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102396 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39004 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 497664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.721744962999999, 2024-09-05T17:31:34.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077374380000000006, 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39004 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750328+0000", 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750346+0000", 2024-09-05T17:31:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7929999999999999e-05 2024-09-05T17:31:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750367+0000", 2024-09-05T17:31:34.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750391+0000", 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4009e-05 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827549+0000", 2024-09-05T17:31:34.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077158103000000006 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827618+0000", 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8660999999999999e-05 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827701+0000", 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3341e-05 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39005 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.721656409000001, 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077409180999999994, 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:34.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39005 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:34.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750416+0000", 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:34.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750422+0000", 2024-09-05T17:31:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4029999999999998e-06 2024-09-05T17:31:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:34.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750442+0000", 2024-09-05T17:31:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0162000000000001e-05 2024-09-05T17:31:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750456+0000", 2024-09-05T17:31:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3699999999999999e-05 2024-09-05T17:31:34.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827719+0000", 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077263407000000006 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827767+0000", 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8174999999999999e-05 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827825+0000", 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7191000000000002e-05 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:34.594 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:34.597 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:34.598 INFO:teuthology.orchestra.run.smithi050.stdout:3242 read 0x16ae9e thru 0x16d6d3 (0x2836 bytes) 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3247 punch from 0x180ae03 to 0x18161da, (0xb3d7 bytes) 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3249 write 0xa64bcd6 thru 0xa6554e5 (0x9810 bytes) 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3250 read 0x3b62884 thru 0x3b6c017 (0x9794 bytes) 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3252 trunc from 0xa6554e6 to 0x6d49660 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3254 read 0x64cf39b thru 0x64d30f3 (0x3d59 bytes) 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3255 punch from 0x672e61a to 0x6734902, (0x62e8 bytes) 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3257 write 0x6de44a thru 0x6e62e5 (0x7e9c bytes) 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3259 write 0x61ceac9 thru 0x61d73de (0x8916 bytes) 2024-09-05T17:31:34.599 INFO:teuthology.orchestra.run.smithi050.stdout:3261 write 0x1cd7e82 thru 0x1ce09bb (0x8b3a bytes) 2024-09-05T17:31:34.600 INFO:teuthology.orchestra.run.smithi050.stdout:3262 trunc from 0x6d49660 to 0x4038002 2024-09-05T17:31:34.600 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:34.598+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:34.602 INFO:teuthology.orchestra.run.smithi050.stdout:3263 read 0x1483338 thru 0x1484cb9 (0x1982 bytes) 2024-09-05T17:31:34.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:34.639 INFO:teuthology.orchestra.run.smithi050.stdout:3264 write 0xc13893c thru 0xc13c839 (0x3efe bytes) 2024-09-05T17:31:34.644 INFO:teuthology.orchestra.run.smithi050.stdout:3265 read 0x2c62c33 thru 0x2c72247 (0xf615 bytes) 2024-09-05T17:31:34.648 INFO:teuthology.orchestra.run.smithi050.stdout:3266 trunc from 0xc13c83a to 0xaea0315 2024-09-05T17:31:34.668 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.669 INFO:teuthology.orchestra.run.smithi050.stdout:3268 write 0x1e4603f thru 0x1e463ff (0x3c1 bytes) 2024-09-05T17:31:34.671 INFO:teuthology.orchestra.run.smithi050.stdout:3269 writesame 0x9c2892f thru 0x9c363cd data_size 0x1(0xda9f bytes) 2024-09-05T17:31:34.697 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:34.697+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:34.706 INFO:teuthology.orchestra.run.smithi050.stdout:3270 trunc from 0xaea0315 to 0xa7949f0 2024-09-05T17:31:34.737 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:34.737 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:34.738 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:34.738 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:34.738 INFO:teuthology.orchestra.run.smithi050.stdout:3272 writesame 0xede4d08 thru 0xede5335 data_size 0x7(0x62e bytes) 2024-09-05T17:31:34.738 INFO:teuthology.orchestra.run.smithi050.stdout:3273 write 0x45cc880 thru 0x45d04d2 (0x3c53 bytes) 2024-09-05T17:31:34.744 INFO:teuthology.orchestra.run.smithi050.stdout:3274 writesame 0x67bd6bd thru 0x67cb422 data_size 0x11(0xdd66 bytes) 2024-09-05T17:31:34.749 INFO:teuthology.orchestra.run.smithi050.stdout:3275 write 0x8927c60 thru 0x89363e4 (0xe785 bytes) 2024-09-05T17:31:34.753 INFO:teuthology.orchestra.run.smithi050.stdout:3277 read 0x29a3044 thru 0x29b218a (0xf147 bytes) 2024-09-05T17:31:34.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:34.763 INFO:teuthology.orchestra.run.smithi050.stdout:3278 trunc from 0xede5336 to 0x8775785 2024-09-05T17:31:34.792 INFO:teuthology.orchestra.run.smithi050.stdout:3279 write 0xc8a0914 thru 0xc8a6ac7 (0x61b4 bytes) 2024-09-05T17:31:34.798 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:34.797+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:3280 write 0x3f5dcac thru 0x3f6cb44 (0xee99 bytes) 2024-09-05T17:31:34.801 INFO:teuthology.orchestra.run.smithi050.stdout:3282 read 0x4b0db67 thru 0x4b0f207 (0x16a1 bytes) 2024-09-05T17:31:34.801 INFO:teuthology.orchestra.run.smithi050.stdout:3283 writesame 0xac9b1a0 thru 0xaca361c data_size 0x1(0x847d bytes) 2024-09-05T17:31:34.812 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:34.812 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:34.833 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:34.834 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:34.834 INFO:teuthology.orchestra.run.smithi050.stdout:3284 write 0xeb40c13 thru 0xeb430d1 (0x24bf bytes) 2024-09-05T17:31:34.839 INFO:teuthology.orchestra.run.smithi050.stdout:3285 write 0x18b994a thru 0x18c1b4e (0x8205 bytes) 2024-09-05T17:31:34.841 INFO:teuthology.orchestra.run.smithi050.stdout:3287 write 0x8fd9fa5 thru 0x8fdc835 (0x2891 bytes) 2024-09-05T17:31:34.853 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:34.853 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:34.855 INFO:teuthology.orchestra.run.smithi050.stdout:3288 trunc from 0xeb430d2 to 0x685b630 2024-09-05T17:31:34.872 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:34.873 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:34.894 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:34.895 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:34.895 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:34.895 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:34.898 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:34.898+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:34.899 INFO:teuthology.orchestra.run.smithi050.stdout:3289 writesame 0xc41ee6e thru 0xc428f9c data_size 0x1(0xa12f bytes) 2024-09-05T17:31:34.899 INFO:teuthology.orchestra.run.smithi050.stdout:3290 writesame 0x8f15dec thru 0x8f1d48d data_size 0xa(0x76a2 bytes) 2024-09-05T17:31:34.905 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.905 INFO:teuthology.orchestra.run.smithi050.stdout:3294 write 0x6e57f85 thru 0x6e663b4 (0xe430 bytes) 2024-09-05T17:31:34.911 INFO:teuthology.orchestra.run.smithi050.stdout:3295 writesame 0x5390664 thru 0x539e841 data_size 0x45(0xe1de bytes) 2024-09-05T17:31:34.912 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:34.913 INFO:teuthology.orchestra.run.smithi050.stdout:3296 write 0xb09bcd9 thru 0xb09c331 (0x659 bytes) 2024-09-05T17:31:34.919 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:34.919 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:34.920 INFO:teuthology.orchestra.run.smithi050.stdout:3297 writesame 0x62d54ee thru 0x62e2079 data_size 0xe(0xcb8c bytes) 2024-09-05T17:31:34.926 INFO:teuthology.orchestra.run.smithi050.stdout:3298 punch from 0x3498f9b to 0x3499c19, (0xc7e bytes) 2024-09-05T17:31:34.926 INFO:teuthology.orchestra.run.smithi050.stdout:3299 write 0x738ad5a thru 0x739721d (0xc4c4 bytes) 2024-09-05T17:31:34.929 INFO:teuthology.orchestra.run.smithi050.stdout:3300 read 0x98c2b3d thru 0x98cc650 (0x9b14 bytes) 2024-09-05T17:31:34.930 INFO:teuthology.orchestra.run.smithi050.stdout:3301 writesame 0x8824fa4 thru 0x8829664 data_size 0x1(0x46c1 bytes) 2024-09-05T17:31:34.940 INFO:teuthology.orchestra.run.smithi050.stdout:3302 read 0x9a9676e thru 0x9aa4802 (0xe095 bytes) 2024-09-05T17:31:34.940 INFO:teuthology.orchestra.run.smithi050.stdout:3303 writesame 0x96b18c3 thru 0x96b3848 data_size 0xa(0x1f86 bytes) 2024-09-05T17:31:34.943 INFO:teuthology.orchestra.run.smithi050.stdout:3304 writesame 0xb586124 thru 0xb592cee data_size 0x1d(0xcbcb bytes) 2024-09-05T17:31:34.944 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:34.944 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:34.946 INFO:teuthology.orchestra.run.smithi050.stdout:3305 read 0x3e375e thru 0x3f2dc4 (0xf667 bytes) 2024-09-05T17:31:34.947 INFO:teuthology.orchestra.run.smithi050.stdout:3306 write 0x232fdc6 thru 0x2333acf (0x3d0a bytes) 2024-09-05T17:31:34.949 INFO:teuthology.orchestra.run.smithi050.stdout:3307 write 0x7030ae thru 0x705667 (0x25ba bytes) 2024-09-05T17:31:34.950 INFO:teuthology.orchestra.run.smithi050.stdout:3308 read 0x7305af7 thru 0x73064fb (0xa05 bytes) 2024-09-05T17:31:34.951 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.951 INFO:teuthology.orchestra.run.smithi050.stdout:3311 punch from 0xa919e25 to 0xa91aad6, (0xcb1 bytes) 2024-09-05T17:31:34.951 INFO:teuthology.orchestra.run.smithi050.stdout:3312 punch from 0x3714150 to 0x3719456, (0x5306 bytes) 2024-09-05T17:31:34.951 INFO:teuthology.orchestra.run.smithi050.stdout:3313 writesame 0xfcfa2f thru 0xfd2e18 data_size 0xf(0x33ea bytes) 2024-09-05T17:31:34.953 INFO:teuthology.orchestra.run.smithi050.stdout:3314 write 0xbec3f60 thru 0xbed11f5 (0xd296 bytes) 2024-09-05T17:31:34.956 INFO:teuthology.orchestra.run.smithi050.stdout:3315 read 0xa034701 thru 0xa036431 (0x1d31 bytes) 2024-09-05T17:31:34.956 INFO:teuthology.orchestra.run.smithi050.stdout:3316 writesame 0xc359b63 thru 0xc35cc94 data_size 0x3(0x3132 bytes) 2024-09-05T17:31:34.962 INFO:teuthology.orchestra.run.smithi050.stdout:3318 write 0x23b7ab0 thru 0x23c137c (0x98cd bytes) 2024-09-05T17:31:34.964 INFO:teuthology.orchestra.run.smithi050.stdout:3319 write 0xb380ba4 thru 0xb38aa41 (0x9e9e bytes) 2024-09-05T17:31:34.967 INFO:teuthology.orchestra.run.smithi050.stdout:3320 read 0x5355e99 thru 0x5357258 (0x13c0 bytes) 2024-09-05T17:31:34.969 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:34.969 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:34.982 INFO:teuthology.orchestra.run.smithi050.stdout:3321 write 0xece7149 thru 0xece932d (0x21e5 bytes) 2024-09-05T17:31:34.987 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.987 INFO:teuthology.orchestra.run.smithi050.stdout:3323 writesame 0xb1176a4 thru 0xb11b59a data_size 0x1b(0x3ef7 bytes) 2024-09-05T17:31:34.990 INFO:teuthology.orchestra.run.smithi050.stdout:3324 write 0xca1b4b thru 0xca8e44 (0x72fa bytes) 2024-09-05T17:31:34.992 INFO:teuthology.orchestra.run.smithi050.stdout:3325 write 0x18a88bb thru 0x18b5f9d (0xd6e3 bytes) 2024-09-05T17:31:34.994 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:34.994 INFO:teuthology.orchestra.run.smithi050.stdout:3327 writesame 0x806efff thru 0x807474d data_size 0x1f(0x574f bytes) 2024-09-05T17:31:34.997 INFO:teuthology.orchestra.run.smithi050.stdout:3328 read 0x78bfa47 thru 0x78c0af8 (0x10b2 bytes) 2024-09-05T17:31:34.998 INFO:teuthology.orchestra.run.smithi050.stdout:3329 write 0xcd24ec2 thru 0xcd259f8 (0xb37 bytes) 2024-09-05T17:31:34.999 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:34.997+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:34.999 INFO:teuthology.orchestra.run.smithi050.stdout:3330 write 0xbdadf72 thru 0xbdbcb44 (0xebd3 bytes) 2024-09-05T17:31:35.012 INFO:teuthology.orchestra.run.smithi050.stdout:3332 trunc from 0xece932e to 0x86a1830 2024-09-05T17:31:35.032 INFO:teuthology.orchestra.run.smithi050.stdout:3333 read 0x82e60e2 thru 0x82ec973 (0x6892 bytes) 2024-09-05T17:31:35.032 INFO:teuthology.orchestra.run.smithi050.stdout:3334 read 0xb5ab35 thru 0xb66a27 (0xbef3 bytes) 2024-09-05T17:31:35.032 INFO:teuthology.orchestra.run.smithi050.stdout:3335 read 0x4203983 thru 0x42122b0 (0xe92e bytes) 2024-09-05T17:31:35.036 INFO:teuthology.orchestra.run.smithi050.stdout:3337 trunc from 0x86a1830 to 0x65837a4 2024-09-05T17:31:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:35.042 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:35.056 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.057 INFO:teuthology.orchestra.run.smithi050.stdout:3340 trunc from 0x65837a4 to 0x5997ecb 2024-09-05T17:31:35.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:35.070 INFO:teuthology.orchestra.run.smithi050.stdout:3341 writesame 0x52f98bf thru 0x5301711 data_size 0x1(0x7e53 bytes) 2024-09-05T17:31:35.106 INFO:teuthology.orchestra.run.smithi050.stdout:3342 read 0x1c80cff thru 0x1c8bf62 (0xb264 bytes) 2024-09-05T17:31:35.106 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:35.106+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:35.120 INFO:teuthology.orchestra.run.smithi050.stdout:3343 write 0x7ee05f7 thru 0x7ee69a8 (0x63b2 bytes) 2024-09-05T17:31:35.123 INFO:teuthology.orchestra.run.smithi050.stdout:3345 read 0x686075e thru 0x686e69a (0xdf3d bytes) 2024-09-05T17:31:35.124 INFO:teuthology.orchestra.run.smithi050.stdout:3347 punch from 0x804b26 to 0x8141a1, (0xf67b bytes) 2024-09-05T17:31:35.124 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.124 INFO:teuthology.orchestra.run.smithi050.stdout:3350 punch from 0x1cf9c11 to 0x1cfdccd, (0x40bc bytes) 2024-09-05T17:31:35.130 INFO:teuthology.orchestra.run.smithi050.stdout:3351 trunc from 0x7ee69a9 to 0xbdf442d 2024-09-05T17:31:35.144 INFO:teuthology.orchestra.run.smithi050.stdout:3352 trunc from 0xbdf442d to 0xe8f5ab2 2024-09-05T17:31:35.155 INFO:teuthology.orchestra.run.smithi050.stdout:3353 writesame 0x4727eeb thru 0x472c70d data_size 0x1(0x4823 bytes) 2024-09-05T17:31:35.189 INFO:teuthology.orchestra.run.smithi050.stdout:3354 trunc from 0xe8f5ab2 to 0x8778edf 2024-09-05T17:31:35.193 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:35.193 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:35.201 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:35.202+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:35.211 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:35.220 INFO:teuthology.orchestra.run.smithi050.stdout:3355 trunc from 0x8778edf to 0x243751 2024-09-05T17:31:35.263 INFO:teuthology.orchestra.run.smithi050.stdout:3356 writesame 0x453f357 thru 0x454732b data_size 0x37(0x7fd5 bytes) 2024-09-05T17:31:35.268 INFO:teuthology.orchestra.run.smithi050.stdout:3357 trunc from 0x454732c to 0x10b61d2 2024-09-05T17:31:35.281 INFO:teuthology.orchestra.run.smithi050.stdout:3358 read 0x67741f thru 0x677b53 (0x735 bytes) 2024-09-05T17:31:35.285 INFO:teuthology.orchestra.run.smithi050.stdout:3359 trunc from 0x10b61d2 to 0x3cd069a 2024-09-05T17:31:35.302 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:35.301+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:35.317 INFO:teuthology.orchestra.run.smithi050.stdout:3361 write 0x8ee0f7d thru 0x8eee308 (0xd38c bytes) 2024-09-05T17:31:35.335 INFO:teuthology.orchestra.run.smithi050.stdout:3362 trunc from 0x8eee309 to 0x35d736a 2024-09-05T17:31:35.350 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:35.351 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:35.361 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.367 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:35.367 INFO:teuthology.orchestra.run.smithi050.stdout:3364 trunc from 0x35d736a to 0x6aeabe8 2024-09-05T17:31:35.399 INFO:teuthology.orchestra.run.smithi050.stdout:3365 write 0xbf0f63d thru 0xbf1018d (0xb51 bytes) 2024-09-05T17:31:35.403 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:35.401+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:35.405 INFO:teuthology.orchestra.run.smithi050.stdout:3366 write 0x97a4ae4 thru 0x97a5ba2 (0x10bf bytes) 2024-09-05T17:31:35.411 INFO:teuthology.orchestra.run.smithi050.stdout:3367 write 0x9de681 thru 0x9e93c6 (0xad46 bytes) 2024-09-05T17:31:35.428 INFO:teuthology.orchestra.run.smithi050.stdout:3368 write 0xd78e8b9 thru 0xd79510a (0x6852 bytes) 2024-09-05T17:31:35.435 INFO:teuthology.orchestra.run.smithi050.stdout:3369 write 0xbd8d617 thru 0xbd9a2f8 (0xcce2 bytes) 2024-09-05T17:31:35.439 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.439 INFO:teuthology.orchestra.run.smithi050.stdout:3371 read 0x2cd34e8 thru 0x2cda17f (0x6c98 bytes) 2024-09-05T17:31:35.447 INFO:teuthology.orchestra.run.smithi050.stdout:3373 trunc from 0xd79510b to 0xa1f8c49 2024-09-05T17:31:35.473 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.473 INFO:teuthology.orchestra.run.smithi050.stdout:3377 write 0x2bcaad2 thru 0x2bd4a38 (0x9f67 bytes) 2024-09-05T17:31:35.477 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.477 INFO:teuthology.orchestra.run.smithi050.stdout:3379 write 0x3414fb6 thru 0x3417390 (0x23db bytes) 2024-09-05T17:31:35.480 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.480 INFO:teuthology.orchestra.run.smithi050.stdout:3381 read 0x5d62da7 thru 0x5d6ebca (0xbe24 bytes) 2024-09-05T17:31:35.495 INFO:teuthology.orchestra.run.smithi050.stdout:3382 write 0xb81aa44 thru 0xb81f3d4 (0x4991 bytes) 2024-09-05T17:31:35.499 INFO:teuthology.orchestra.run.smithi050.stdout:3385 punch from 0x372a92c to 0x3732c07, (0x82db bytes) 2024-09-05T17:31:35.499 INFO:teuthology.orchestra.run.smithi050.stdout:3387 read 0xc8c483 thru 0xc9028e (0x3e0c bytes) 2024-09-05T17:31:35.500 INFO:teuthology.orchestra.run.smithi050.stdout:3388 punch from 0x646b86f to 0x6472856, (0x6fe7 bytes) 2024-09-05T17:31:35.500 INFO:teuthology.orchestra.run.smithi050.stdout:3389 read 0x1e30bf9 thru 0x1e36617 (0x5a1f bytes) 2024-09-05T17:31:35.500 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.504 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:35.501+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:35.513 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:35.514 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:35.514 INFO:teuthology.orchestra.run.smithi050.stdout:3394 trunc from 0xb81f3d5 to 0x5216d5a 2024-09-05T17:31:35.530 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:35.566 INFO:teuthology.orchestra.run.smithi050.stdout:3395 write 0xc878d07 thru 0xc87d9d3 (0x4ccd bytes) 2024-09-05T17:31:35.589 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.589 INFO:teuthology.orchestra.run.smithi050.stdout:3398 write 0x2ec0efc thru 0x2ecad8d (0x9e92 bytes) 2024-09-05T17:31:35.589 INFO:teuthology.orchestra.run.smithi050.stdout:3399 writesame 0x9a69247 thru 0x9a6e6fd data_size 0x1(0x54b7 bytes) 2024-09-05T17:31:35.596 INFO:teuthology.orchestra.run.smithi050.stdout:3400 punch from 0x339fa4d to 0x33af34a, (0xf8fd bytes) 2024-09-05T17:31:35.596 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.596 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.596 INFO:teuthology.orchestra.run.smithi050.stdout:3403 writesame 0x5ac8251 thru 0x5acde77 data_size 0x1(0x5c27 bytes) 2024-09-05T17:31:35.606 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:35.606+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:35.629 INFO:teuthology.orchestra.run.smithi050.stdout:3404 write 0x2f443c0 thru 0x2f49026 (0x4c67 bytes) 2024-09-05T17:31:35.631 INFO:teuthology.orchestra.run.smithi050.stdout:3405 read 0x34c55cd thru 0x34ca021 (0x4a55 bytes) 2024-09-05T17:31:35.631 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.631 INFO:teuthology.orchestra.run.smithi050.stdout:3408 read 0x44c43b0 thru 0x44ce12f (0x9d80 bytes) 2024-09-05T17:31:35.633 INFO:teuthology.orchestra.run.smithi050.stdout:3410 write 0x117a32 thru 0x125b45 (0xe114 bytes) 2024-09-05T17:31:35.635 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:35.635 INFO:teuthology.orchestra.run.smithi050.stdout:3413 read 0x2a58442 thru 0x2a612a3 (0x8e62 bytes) 2024-09-05T17:31:35.635 INFO:teuthology.orchestra.run.smithi050.stdout:3414 punch from 0x359def5 to 0x35a98ec, (0xb9f7 bytes) 2024-09-05T17:31:35.636 INFO:teuthology.orchestra.run.smithi050.stdout:3415 clone 18 order 21 su 262144 sc 13 2024-09-05T17:31:35.706 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:35.705+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:35.711 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:35.712 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:35.712 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:35.712 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 0 2024-09-05T17:31:35.718 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:35.718 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:35.738 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:35.752 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:31:35.823 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:35.825+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:35.905 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone17 from 0xc87d9d4 (overlap 0x243751) to 0x0 2024-09-05T17:31:35.908 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:35.905+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:35.909 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:35.909 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:35.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:36.015 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:36.017+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:36.083 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-05T17:31:36.081+0000 7fc56f901640 -1 mon.a@0(leader).osd e59 definitely_dead 0 2024-09-05T17:31:36.093 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-05T17:31:36.097 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:36.097 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:36.110 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:36.109+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:36.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:36.116 INFO:teuthology.orchestra.run.smithi050.stdout:3417 write 0xb52f476 thru 0xb53ebec (0xf777 bytes) 2024-09-05T17:31:36.131 INFO:teuthology.orchestra.run.smithi050.stdout:3418 read 0x9a7d0a9 thru 0x9a822b1 (0x5209 bytes) 2024-09-05T17:31:36.131 INFO:teuthology.orchestra.run.smithi050.stdout:3420 read 0x64ec0eb thru 0x64f8fa2 (0xceb8 bytes) 2024-09-05T17:31:36.132 INFO:teuthology.orchestra.run.smithi050.stdout:3421 punch from 0x1bc1a15 to 0x1bcd4a7, (0xba92 bytes) 2024-09-05T17:31:36.144 INFO:teuthology.orchestra.run.smithi050.stdout:3422 write 0xdf7d68d thru 0xdf8d49b (0xfe0f bytes) 2024-09-05T17:31:36.151 INFO:teuthology.orchestra.run.smithi050.stdout:3423 read 0x82d3aed thru 0x82dc5c5 (0x8ad9 bytes) 2024-09-05T17:31:36.151 INFO:teuthology.orchestra.run.smithi050.stdout:3426 writesame 0xbd7d47f thru 0xbd809ed data_size 0x1(0x356f bytes) 2024-09-05T17:31:36.160 INFO:teuthology.orchestra.run.smithi050.stdout:3427 write 0x10b8731 thru 0x10c2d1b (0xa5eb bytes) 2024-09-05T17:31:36.170 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.171 INFO:teuthology.orchestra.run.smithi050.stdout:3429 read 0x669be69 thru 0x66a4796 (0x892e bytes) 2024-09-05T17:31:36.171 INFO:teuthology.orchestra.run.smithi050.stdout:3430 write 0xd86124f thru 0xd867591 (0x6343 bytes) 2024-09-05T17:31:36.177 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.177 INFO:teuthology.orchestra.run.smithi050.stdout:3433 write 0x31f721e thru 0x32002bc (0x909f bytes) 2024-09-05T17:31:36.195 INFO:teuthology.orchestra.run.smithi050.stdout:3435 trunc from 0xdf8d49c to 0x8d227c0 2024-09-05T17:31:36.211 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:36.209+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:36.252 INFO:teuthology.orchestra.run.smithi050.stdout:3436 trunc from 0x8d227c0 to 0x5bf7e1f 2024-09-05T17:31:36.261 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:36.261 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:36.279 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:36.305 INFO:teuthology.orchestra.run.smithi050.stdout:3437 read 0x5ba6bed thru 0x5badd53 (0x7167 bytes) 2024-09-05T17:31:36.307 INFO:teuthology.orchestra.run.smithi050.stdout:3440 punch from 0x1f75d7d to 0x1f7cf78, (0x71fb bytes) 2024-09-05T17:31:36.307 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.311 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:36.309+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:36.319 INFO:teuthology.orchestra.run.smithi050.stdout:3442 trunc from 0x5bf7e1f to 0xcc322e3 2024-09-05T17:31:36.329 INFO:teuthology.orchestra.run.smithi050.stdout:3443 write 0x5ba9db4 thru 0x5bad775 (0x39c2 bytes) 2024-09-05T17:31:36.332 INFO:teuthology.orchestra.run.smithi050.stdout:3445 write 0xad4cd20 thru 0xad55468 (0x8749 bytes) 2024-09-05T17:31:36.343 INFO:teuthology.orchestra.run.smithi050.stdout:3447 trunc from 0xcc322e3 to 0x9d2c80c 2024-09-05T17:31:36.356 INFO:teuthology.orchestra.run.smithi050.stdout:3450 punch from 0x8d6c53a to 0x8d6d0a3, (0xb69 bytes) 2024-09-05T17:31:36.371 INFO:teuthology.orchestra.run.smithi050.stdout:3451 write 0xbb90d8d thru 0xbb93c95 (0x2f09 bytes) 2024-09-05T17:31:36.377 INFO:teuthology.orchestra.run.smithi050.stdout:3452 punch from 0x248f9bd to 0x249670e, (0x6d51 bytes) 2024-09-05T17:31:36.377 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.377 INFO:teuthology.orchestra.run.smithi050.stdout:3457 read 0xa7d0fd0 thru 0xa7d4735 (0x3766 bytes) 2024-09-05T17:31:36.392 INFO:teuthology.orchestra.run.smithi050.stdout:3458 write 0xdcc08d2 thru 0xdccf0fa (0xe829 bytes) 2024-09-05T17:31:36.397 INFO:teuthology.orchestra.run.smithi050.stdout:3459 write 0x5fd4365 thru 0x5fdf214 (0xaeb0 bytes) 2024-09-05T17:31:36.401 INFO:teuthology.orchestra.run.smithi050.stdout:3460 punch from 0x895bdab to 0x895d9e4, (0x1c39 bytes) 2024-09-05T17:31:36.401 INFO:teuthology.orchestra.run.smithi050.stdout:3461 write 0x1805493 thru 0x180a629 (0x5197 bytes) 2024-09-05T17:31:36.411 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.411 INFO:teuthology.orchestra.run.smithi050.stdout:3464 writesame 0x6b42182 thru 0x6b455a0 data_size 0x1(0x341f bytes) 2024-09-05T17:31:36.412 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:36.409+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:36.428 INFO:teuthology.orchestra.run.smithi050.stdout:3466 writesame 0xf7307f thru 0xf8236a data_size 0xe(0xf2ec bytes) 2024-09-05T17:31:36.430 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:36.431 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:36.444 INFO:teuthology.orchestra.run.smithi050.stdout:3469 read 0xaec571d thru 0xaed5023 (0xf907 bytes) 2024-09-05T17:31:36.445 INFO:teuthology.orchestra.run.smithi050.stdout:3471 read 0x2d88de5 thru 0x2d9109e (0x82ba bytes) 2024-09-05T17:31:36.446 INFO:teuthology.orchestra.run.smithi050.stdout:3472 read 0x909e527 thru 0x90ac212 (0xdcec bytes) 2024-09-05T17:31:36.446 INFO:teuthology.orchestra.run.smithi050.stdout:3473 read 0xae705d2 thru 0xae7e1c0 (0xdbef bytes) 2024-09-05T17:31:36.446 INFO:teuthology.orchestra.run.smithi050.stdout:3474 writesame 0x21d35a8 thru 0x21d5d5e data_size 0x1(0x27b7 bytes) 2024-09-05T17:31:36.448 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:36.459 INFO:teuthology.orchestra.run.smithi050.stdout:3475 write 0x99205b9 thru 0x992cb8e (0xc5d6 bytes) 2024-09-05T17:31:36.466 INFO:teuthology.orchestra.run.smithi050.stdout:3477 read 0xc582eb9 thru 0xc589d34 (0x6e7c bytes) 2024-09-05T17:31:36.467 INFO:teuthology.orchestra.run.smithi050.stdout:3479 writesame 0x7ce9322 thru 0x7cee527 data_size 0x1(0x5206 bytes) 2024-09-05T17:31:36.496 INFO:teuthology.orchestra.run.smithi050.stdout:3481 writesame 0xc87eaab thru 0xc88c87a data_size 0x70(0xddd0 bytes) 2024-09-05T17:31:36.513 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:36.513+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:36.524 INFO:teuthology.orchestra.run.smithi050.stdout:3483 trunc from 0xdccf0fb to 0xefb55d 2024-09-05T17:31:36.606 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:36.606 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:36.607 INFO:teuthology.orchestra.run.smithi050.stdout:3484 writesame 0x6a7bce4 thru 0x6a81fea data_size 0x1(0x6307 bytes) 2024-09-05T17:31:36.613 INFO:teuthology.orchestra.run.smithi050.stdout:3485 trunc from 0x6a81feb to 0x9ebcfaf 2024-09-05T17:31:36.613 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:36.613+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:36.624 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:36.625 INFO:teuthology.orchestra.run.smithi050.stdout:3486 read 0x8ccffb4 thru 0x8cd0fea (0x1037 bytes) 2024-09-05T17:31:36.625 INFO:teuthology.orchestra.run.smithi050.stdout:3487 read 0x362c09b thru 0x3638c60 (0xcbc6 bytes) 2024-09-05T17:31:36.625 INFO:teuthology.orchestra.run.smithi050.stdout:3489 write 0x5ebae68 thru 0x5ebd1a7 (0x2340 bytes) 2024-09-05T17:31:36.631 INFO:teuthology.orchestra.run.smithi050.stdout:3490 write 0x425e576 thru 0x426aa71 (0xc4fc bytes) 2024-09-05T17:31:36.650 INFO:teuthology.orchestra.run.smithi050.stdout:3491 write 0xbb9351b thru 0xbb96532 (0x3018 bytes) 2024-09-05T17:31:36.655 INFO:teuthology.orchestra.run.smithi050.stdout:3492 punch from 0x85019aa to 0x850544b, (0x3aa1 bytes) 2024-09-05T17:31:36.671 INFO:teuthology.orchestra.run.smithi050.stdout:3493 write 0xec21da5 thru 0xec30976 (0xebd2 bytes) 2024-09-05T17:31:36.676 INFO:teuthology.orchestra.run.smithi050.stdout:3494 read 0xb3a58dd thru 0xb3b4e9b (0xf5bf bytes) 2024-09-05T17:31:36.677 INFO:teuthology.orchestra.run.smithi050.stdout:3495 writesame 0xb90d9da thru 0xb910cb1 data_size 0x1(0x32d8 bytes) 2024-09-05T17:31:36.688 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.689 INFO:teuthology.orchestra.run.smithi050.stdout:3499 read 0x7033f thru 0x7bd1c (0xb9de bytes) 2024-09-05T17:31:36.689 INFO:teuthology.orchestra.run.smithi050.stdout:3500 write 0x5577479 thru 0x5585b42 (0xe6ca bytes) 2024-09-05T17:31:36.696 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.696 INFO:teuthology.orchestra.run.smithi050.stdout:3506 read 0x51370d2 thru 0x51468e9 (0xf818 bytes) 2024-09-05T17:31:36.696 INFO:teuthology.orchestra.run.smithi050.stdout:3511 punch from 0xe23d87 to 0xe283d0, (0x4649 bytes) 2024-09-05T17:31:36.697 INFO:teuthology.orchestra.run.smithi050.stdout:3512 read 0x70390a6 thru 0x703af71 (0x1ecc bytes) 2024-09-05T17:31:36.697 INFO:teuthology.orchestra.run.smithi050.stdout:3513 write 0x4b3568b thru 0x4b44a70 (0xf3e6 bytes) 2024-09-05T17:31:36.703 INFO:teuthology.orchestra.run.smithi050.stdout:3516 writesame 0x157903e thru 0x1586221 data_size 0x85(0xd1e4 bytes) 2024-09-05T17:31:36.707 INFO:teuthology.orchestra.run.smithi050.stdout:3517 read 0x36b1ad4 thru 0x36b6507 (0x4a34 bytes) 2024-09-05T17:31:36.707 INFO:teuthology.orchestra.run.smithi050.stdout:3518 punch from 0xc6f6889 to 0xc6f762b, (0xda2 bytes) 2024-09-05T17:31:36.707 INFO:teuthology.orchestra.run.smithi050.stdout:3519 writesame 0x4d4a75c thru 0x4d4a7e1 data_size 0x1(0x86 bytes) 2024-09-05T17:31:36.712 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.712 INFO:teuthology.orchestra.run.smithi050.stdout:3521 write 0x163e263 thru 0x16431d5 (0x4f73 bytes) 2024-09-05T17:31:36.714 INFO:teuthology.orchestra.run.smithi050.stdout:3522 write 0x7e16fa5 thru 0x7e1f280 (0x82dc bytes) 2024-09-05T17:31:36.714 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:36.713+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:36.719 INFO:teuthology.orchestra.run.smithi050.stdout:3523 punch from 0x2583402 to 0x258fddc, (0xc9da bytes) 2024-09-05T17:31:36.719 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.719 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.719 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.719 INFO:teuthology.orchestra.run.smithi050.stdout:3529 writesame 0x27b418 thru 0x28034a data_size 0x1(0x4f33 bytes) 2024-09-05T17:31:36.733 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:36.740 INFO:teuthology.orchestra.run.smithi050.stderr:marked out osd.0. 2024-09-05T17:31:36.740 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:31:36.763 INFO:teuthology.orchestra.run.smithi050.stdout:3531 trunc from 0xec30977 to 0x1949dc 2024-09-05T17:31:36.768 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:36.769 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:36.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:36.836 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:36.833+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:36.907 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:36.907 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:36.918 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:36.917+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:36.923 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:36.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:37.039 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:37.041+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:37.090 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:37.090 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:37.106 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:37.156 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:37.156 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:37.156 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:37.157+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:37.175 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:37.175 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:37.194 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:37.195 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:37.214 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:37.215 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:37.219 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:37.217+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:37.230 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:37.231 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:37.234 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:37.235 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:37.245 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:37.256 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:37.256 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:37.276 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:37.277 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:37.297 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:37.297 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:37.333 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:37.333+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:37.407 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:37.407 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:37.407 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:37.407 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:37.407 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:37.420 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:37.417+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:37.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:37.521 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:37.521+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.854195213000001, 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.599 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:31:37.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:31:37.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.85413702, 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:37.604 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:37.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:31:37.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.854075701999999, 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:31:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:31:37.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.854009234999999, 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:31:37.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:31:37.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:37.618 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853933078000001, 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:31:37.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:31:37.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853870110999999, 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:31:37.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.627 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.85380838, 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:31:37.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853725353000002, 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:31:37.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.636 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853666679, 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.637 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853609731999999, 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:31:37.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853545257, 2024-09-05T17:31:37.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:37.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:31:37.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853474603999999, 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:31:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:31:37.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853397613999999, 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:31:37.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:37.658 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853338853, 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:31:37.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:31:37.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853276181999998, 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:31:37.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853214050999998, 2024-09-05T17:31:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:37.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:31:37.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853094976000001, 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:31:37.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.853040525000001, 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.852878085, 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:31:37.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:37.684 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.851693697999998, 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:37.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:31:37.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:37.689 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:37.689 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:37.690 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:37.691 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:37.689+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:37.792 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:37.793+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:37.815 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:37.815 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:37.815 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:37.815 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:37.830 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:37.892 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:37.893+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:37.952 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:37.953 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:37.953 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:37.953 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:37.953 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:37.967 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:37.993 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:37.993+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:38.094 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:8976 3.10 3:0f1f7ceb:::rbd_data.11403f2d9bbd.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.595499216999997, 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043813337000000001, 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 8976 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498241+0000", 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6529999999999998e-06 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498253+0000", 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1681999999999999e-05 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498283+0000", 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0097999999999999e-05 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498299+0000", 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5498999999999998e-05 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498406+0000", 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010711 2024-09-05T17:31:38.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498540+0000", 2024-09-05T17:31:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134461 2024-09-05T17:31:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:38.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.506438+0000", 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078981060000000002 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541694+0000", 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.035255701 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541815+0000", 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541919+0000", 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010451299999999999 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.542052+0000", 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132745 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28575 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.416540085999998, 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041664701999999998, 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28575 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677199+0000", 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0699999999999996e-07 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677203+0000", 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1869999999999999e-06 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677219+0000", 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5724999999999999e-05 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677230+0000", 2024-09-05T17:31:38.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1902999999999999e-05 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717588+0000", 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040357993000000002 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717758+0000", 2024-09-05T17:31:38.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016953399999999999 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718863+0000", 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011046529999999999 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28576 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:38.106 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.416494534999998, 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042556272999999999, 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28576 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677245+0000", 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.494e-06 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677250+0000", 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.276e-06 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677280+0000", 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9451999999999999e-05 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677288+0000", 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5990000000000002e-06 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718928+0000", 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041639279000000001 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719099+0000", 2024-09-05T17:31:38.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000171151 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719800+0000", 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00070102200000000004 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28577 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 69632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:38.111 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.416108983999997, 2024-09-05T17:31:38.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04307043, 2024-09-05T17:31:38.112 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.112 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.112 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28577 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677631+0000", 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0760000000000001e-06 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677640+0000", 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1560000000000001e-06 2024-09-05T17:31:38.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677666+0000", 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6156000000000002e-05 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677686+0000", 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9321999999999999e-05 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719867+0000", 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042181070000000001 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720043+0000", 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176496 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720699+0000", 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065615400000000005 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28578 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.416023258999999, 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043977430999999997, 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28578 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677716+0000", 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.533e-06 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677723+0000", 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.613e-06 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677742+0000", 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8629000000000001e-05 2024-09-05T17:31:38.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677756+0000", 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4566000000000001e-05 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720766+0000", 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043009798000000002 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721003+0000", 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721692+0000", 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068963399999999995 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28579 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:38.121 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.415961432000003, 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044067576999999997, 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28579 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677778+0000", 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.043e-06 2024-09-05T17:31:38.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677783+0000", 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-06 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677801+0000", 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7825999999999998e-05 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677815+0000", 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3532e-05 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721827+0000", 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044012451000000001 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721844+0000", 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7144999999999999e-05 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28580 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.415902191999997, 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044087135, 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.126 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28580 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677837+0000", 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2130000000000001e-06 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677843+0000", 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1e-06 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677862+0000", 2024-09-05T17:31:38.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8719000000000002e-05 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677876+0000", 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4079e-05 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721907+0000", 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044030712999999999 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721923+0000", 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6311e-05 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28581 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.415837707999998, 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044089852999999998, 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.130 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28581 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677902+0000", 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.28e-06 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677907+0000", 2024-09-05T17:31:38.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6019999999999999e-06 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677926+0000", 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8346e-05 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677939+0000", 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3796e-05 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721974+0000", 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044035004000000003 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721990+0000", 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5824999999999998e-05 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.134 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28662 3.a 3.10099d2a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.413840868999998, 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042160502000000002, 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28662 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679900+0000", 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.407e-06 2024-09-05T17:31:38.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679912+0000", 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.219e-05 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679937+0000", 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5525e-05 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679958+0000", 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0268e-05 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722042+0000", 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042084253000000002 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722058+0000", 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5858999999999998e-05 2024-09-05T17:31:38.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28700 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411710141999997, 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040505403000000002, 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28700 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:38.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682029+0000", 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682035+0000", 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5999999999999997e-06 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682052+0000", 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6833e-05 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682064+0000", 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2795e-05 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722517+0000", 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040453000000000003 2024-09-05T17:31:38.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722533+0000", 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5798999999999999e-05 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28701 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411657124999998, 2024-09-05T17:31:38.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040534632000000001, 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28701 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:38.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682082+0000", 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0729999999999999e-06 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682087+0000", 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8829999999999997e-06 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682103+0000", 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6049000000000002e-05 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682117+0000", 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3740000000000001e-05 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722583+0000", 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040466323999999998 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722616+0000", 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2563e-05 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.147 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28702 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411602680999998, 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040547896999999999, 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28702 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682137+0000", 2024-09-05T17:31:38.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2899999999999999e-06 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682143+0000", 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0159999999999997e-06 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682160+0000", 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7655999999999998e-05 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682175+0000", 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4836e-05 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722665+0000", 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040490155999999999 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722683+0000", 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7943000000000001e-05 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.151 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28703 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411544163999999, 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040556400999999999, 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28703 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682195+0000", 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682201+0000", 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5729999999999998e-06 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682218+0000", 2024-09-05T17:31:38.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7915999999999999e-05 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682232+0000", 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3576e-05 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722734+0000", 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040502437000000002 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722750+0000", 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5756e-05 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28704 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411486293999999, 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040560355999999999, 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28704 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682253+0000", 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.153e-06 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682258+0000", 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5629999999999999e-06 2024-09-05T17:31:38.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682275+0000", 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6983e-05 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682290+0000", 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4158999999999999e-05 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722798+0000", 2024-09-05T17:31:38.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040508294 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722812+0000", 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4204e-05 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28705 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411428426999997, 2024-09-05T17:31:38.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040566735, 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28705 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682311+0000", 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.187e-06 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682316+0000", 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4929999999999998e-06 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682334+0000", 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7305000000000001e-05 2024-09-05T17:31:38.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682347+0000", 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.328e-05 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722861+0000", 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040513999000000002 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722876+0000", 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5471000000000001e-05 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28706 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411372542999999, 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040580441000000002, 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.165 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28706 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682367+0000", 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682385+0000", 2024-09-05T17:31:38.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8352e-05 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682403+0000", 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7940000000000001e-05 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682417+0000", 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4285e-05 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722930+0000", 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040512907000000001 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722946+0000", 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5537e-05 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.169 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28707 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411299507000003, 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040576270999999997, 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28707 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682440+0000", 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1200000000000001e-06 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682445+0000", 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6899999999999997e-06 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682463+0000", 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7765999999999999e-05 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682477+0000", 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3465999999999999e-05 2024-09-05T17:31:38.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722998+0000", 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040521807 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723015+0000", 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6422e-05 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28708 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411239655999999, 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040582981999999997, 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.174 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28708 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682500+0000", 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.26e-06 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682505+0000", 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6489999999999996e-06 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682523+0000", 2024-09-05T17:31:38.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682535+0000", 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2313000000000001e-05 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723066+0000", 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040530432999999998 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723081+0000", 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5784999999999999e-05 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28709 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411183239000003, 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040593911000000003, 2024-09-05T17:31:38.178 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28709 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682556+0000", 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.19e-06 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682561+0000", 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4820000000000002e-06 2024-09-05T17:31:38.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682579+0000", 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7430000000000001e-05 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682593+0000", 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799e-05 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723133+0000", 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040540208000000001 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723149+0000", 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5801999999999999e-05 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28710 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.411105462999998, 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040581488999999998, 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28710 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682634+0000", 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.483e-06 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682640+0000", 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.319e-06 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682659+0000", 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8266000000000001e-05 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682673+0000", 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.431e-05 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723198+0000", 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040525383999999998 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723214+0000", 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5727e-05 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.188 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:38.188 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:38.093+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:38.189 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:38.195 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:38.197+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:38.296 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:38.297+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:38.359 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:38.359 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:38.359 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:38.359 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:38.373 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:38.421 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:38.421+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:38.491 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:38.491 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:38.491 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:38.491 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:38.491 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:38.497 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:38.497+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:38.513 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:38.583 INFO:teuthology.orchestra.run.smithi050.stdout:3533 read 0x8d26b thru 0x9220c (0x4fa2 bytes) 2024-09-05T17:31:38.604 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:38.605+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:38.609 INFO:teuthology.orchestra.run.smithi050.stdout:3534 write 0x7479532 thru 0x747a9ae (0x147d bytes) 2024-09-05T17:31:38.619 INFO:teuthology.orchestra.run.smithi050.stdout:3535 trunc from 0x747a9af to 0x5ad95c8 2024-09-05T17:31:38.634 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:38.634 INFO:teuthology.orchestra.run.smithi050.stdout:3537 writesame 0x2001d8d thru 0x200f364 data_size 0xc(0xd5d8 bytes) 2024-09-05T17:31:38.647 INFO:teuthology.orchestra.run.smithi050.stdout:3538 trunc from 0x5ad95c8 to 0x1e133b5 2024-09-05T17:31:38.677 INFO:teuthology.orchestra.run.smithi050.stdout:3539 writesame 0x99bbf5e thru 0x99bea84 data_size 0x1(0x2b27 bytes) 2024-09-05T17:31:38.677 INFO:teuthology.orchestra.run.smithi050.stdout:3540 read 0x507711a thru 0x507db75 (0x6a5c bytes) 2024-09-05T17:31:38.677 INFO:teuthology.orchestra.run.smithi050.stdout:3541 read 0x5f9437b thru 0x5f9a6ea (0x6370 bytes) 2024-09-05T17:31:38.677 INFO:teuthology.orchestra.run.smithi050.stdout:3543 read 0x6e9c5bf thru 0x6eaa8ff (0xe341 bytes) 2024-09-05T17:31:38.681 INFO:teuthology.orchestra.run.smithi050.stdout:3544 trunc from 0x99bea85 to 0xc91c10d 2024-09-05T17:31:38.694 INFO:teuthology.orchestra.run.smithi050.stdout:3545 write 0xca85293 thru 0xca8b369 (0x60d7 bytes) 2024-09-05T17:31:38.698 INFO:teuthology.orchestra.run.smithi050.stdout:3546 write 0xaafb709 thru 0xaaff315 (0x3c0d bytes) 2024-09-05T17:31:38.698 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:38.697+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:38.702 INFO:teuthology.orchestra.run.smithi050.stdout:3548 writesame 0x99dca8e thru 0x99e9c25 data_size 0x4c(0xd198 bytes) 2024-09-05T17:31:38.714 INFO:teuthology.orchestra.run.smithi050.stdout:3549 writesame 0xd37a244 thru 0xd380473 data_size 0x8(0x6230 bytes) 2024-09-05T17:31:38.714 INFO:teuthology.orchestra.run.smithi050.stdout:3550 read 0x14b268e thru 0x14bd8f4 (0xb267 bytes) 2024-09-05T17:31:38.714 INFO:teuthology.orchestra.run.smithi050.stdout:3551 read 0x429123e thru 0x429249a (0x125d bytes) 2024-09-05T17:31:38.715 INFO:teuthology.orchestra.run.smithi050.stdout:3552 read 0xb76c39f thru 0xb7716dc (0x533e bytes) 2024-09-05T17:31:38.717 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:31:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.700349693000007, 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:31:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:31:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:31:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:31:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38987 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 253952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.96792056, 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074851697999999994, 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38987 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749281+0000", 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.023e-06 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749286+0000", 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999996e-06 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749308+0000", 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1141999999999998e-05 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749321+0000", 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3653e-05 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.823944+0000", 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074623192000000005 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824027+0000", 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.297e-05 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824132+0000", 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104548 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38988 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 268288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967862662999998, 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075009180999999994, 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38988 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749339+0000", 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0330000000000001e-06 2024-09-05T17:31:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749344+0000", 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7230000000000004e-06 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749359+0000", 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5427e-05 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749385+0000", 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5469e-05 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824164+0000", 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074779258000000001 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824251+0000", 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6620999999999996e-05 2024-09-05T17:31:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824347+0000", 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6650000000000005e-05 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38989 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 282624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967795272, 2024-09-05T17:31:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075156843000000001, 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38989 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749407+0000", 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749412+0000", 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8000000000000004e-06 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749430+0000", 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7816e-05 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749444+0000", 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3919e-05 2024-09-05T17:31:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824381+0000", 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074936661000000002 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824462+0000", 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1176999999999999e-05 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824562+0000", 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010029700000000001 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38990 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 296960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967738175000001, 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075320143000000006, 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38990 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749464+0000", 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1769999999999999e-06 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749480+0000", 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5886e-05 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749498+0000", 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8238999999999999e-05 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749512+0000", 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3876000000000001e-05 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824587+0000", 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075075107000000002 2024-09-05T17:31:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824657+0000", 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9859999999999999e-05 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824783+0000", 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125998 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38991 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967669741000002, 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075469580999999994, 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38991 2024-09-05T17:31:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749532+0000", 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749538+0000", 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4469999999999997e-06 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749555+0000", 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749569+0000", 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3397000000000001e-05 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824814+0000", 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075245765000000006 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824900+0000", 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700999999999998e-05 2024-09-05T17:31:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825001+0000", 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100556 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38992 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 325632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967615132999999, 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075625943000000001, 2024-09-05T17:31:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38992 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749587+0000", 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749591+0000", 2024-09-05T17:31:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6970000000000001e-06 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749608+0000", 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6569e-05 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749621+0000", 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3457e-05 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825030+0000", 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075408915000000007 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825109+0000", 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825212+0000", 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102644 2024-09-05T17:31:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38993 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967562565000001, 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075788663000000006, 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38993 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749639+0000", 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749659+0000", 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0092e-05 2024-09-05T17:31:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749678+0000", 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8450000000000001e-05 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749693+0000", 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4583000000000001e-05 2024-09-05T17:31:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825241+0000", 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075548134000000003 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825323+0000", 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2410000000000005e-05 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825427+0000", 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103831 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38994 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 354304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967489172000001, 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075917854000000007, 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38994 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:38.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749713+0000", 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.097e-06 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749718+0000", 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3569999999999997e-06 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749735+0000", 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6969e-05 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749748+0000", 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825456+0000", 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075707846999999995 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825532+0000", 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5480000000000002e-05 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825629+0000", 2024-09-05T17:31:38.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7785e-05 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38995 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 368640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967435627, 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076074345000000002, 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38995 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749766+0000", 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0470000000000001e-06 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749771+0000", 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8720000000000001e-06 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749788+0000", 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6762999999999999e-05 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749819+0000", 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1056000000000002e-05 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825659+0000", 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075840487999999998 2024-09-05T17:31:38.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825738+0000", 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8862000000000005e-05 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825839+0000", 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101257 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38996 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 382976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967363720000002, 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076198058999999999, 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38996 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749838+0000", 2024-09-05T17:31:38.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8700000000000004e-07 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749843+0000", 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.339e-06 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749860+0000", 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7059999999999999e-05 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749874+0000", 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3769e-05 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825869+0000", 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075995094999999999 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825945+0000", 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5661000000000006e-05 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826035+0000", 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0148000000000005e-05 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38997 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967309809, 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076361818999999997, 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38997 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749892+0000", 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0130000000000001e-06 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749897+0000", 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6859999999999997e-06 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749913+0000", 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6637e-05 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749927+0000", 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3396e-05 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826068+0000", 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076140883000000006 2024-09-05T17:31:38.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826148+0000", 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0698000000000006e-05 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826253+0000", 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010450600000000001 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38998 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 411648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967257268000001, 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076522440999999997, 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38998 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.777 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749945+0000", 2024-09-05T17:31:38.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9999999999999995e-07 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749949+0000", 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6500000000000004e-06 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749966+0000", 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6756e-05 2024-09-05T17:31:38.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749980+0000", 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3746e-05 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826284+0000", 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076304300000000005 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826364+0000", 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689000000000002e-05 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826466+0000", 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010230000000000001 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38999 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 425984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967202793999999, 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076686775999999998, 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38999 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749999+0000", 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.054e-06 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750004+0000", 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8459999999999999e-06 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750025+0000", 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750039+0000", 2024-09-05T17:31:38.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4141999999999999e-05 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826498+0000", 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076458700000000004 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826584+0000", 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6123000000000002e-05 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826685+0000", 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010075499999999999 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39000 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 440320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967143712999999, 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076822304999999994, 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39000 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750058+0000", 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1739999999999999e-06 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750076+0000", 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7309e-05 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750097+0000", 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1345999999999999e-05 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750111+0000", 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4205e-05 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826715+0000", 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076604277999999998 2024-09-05T17:31:38.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826792+0000", 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6561000000000001e-05 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826879+0000", 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7431999999999999e-05 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39001 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967071751999999, 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076972354000000007, 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39001 2024-09-05T17:31:38.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750130+0000", 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1459999999999999e-06 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750135+0000", 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8169999999999998e-06 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750155+0000", 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0409000000000001e-05 2024-09-05T17:31:38.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750169+0000", 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3786e-05 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826909+0000", 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076740082000000001 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827000+0000", 2024-09-05T17:31:38.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0956000000000001e-05 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827101+0000", 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101158 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39002 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:38.795 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.967004692, 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077117667000000001, 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39002 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750197+0000", 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1599999999999999e-06 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750203+0000", 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6699999999999999e-06 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750228+0000", 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5131999999999999e-05 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750243+0000", 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4610000000000001e-05 2024-09-05T17:31:38.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827135+0000", 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076891994000000005 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827217+0000", 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2766e-05 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827314+0000", 2024-09-05T17:31:38.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6335000000000005e-05 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39003 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.966938734999999, 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077268069999999994, 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39003 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:38.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750263+0000", 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750269+0000", 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.48e-06 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750294+0000", 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4981999999999999e-05 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750308+0000", 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4266e-05 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827344+0000", 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077036358999999999 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827428+0000", 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3332999999999996e-05 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827530+0000", 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102396 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39004 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 497664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.966873980999999, 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077374380000000006, 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39004 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750328+0000", 2024-09-05T17:31:38.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750346+0000", 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7929999999999999e-05 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750367+0000", 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750391+0000", 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4009e-05 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827549+0000", 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077158103000000006 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827618+0000", 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8660999999999999e-05 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827701+0000", 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3341e-05 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39005 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.966785427000001, 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077409180999999994, 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39005 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:38.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750416+0000", 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:38.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750422+0000", 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4029999999999998e-06 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750442+0000", 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0162000000000001e-05 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750456+0000", 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3699999999999999e-05 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827719+0000", 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077263407000000006 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827767+0000", 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8174999999999999e-05 2024-09-05T17:31:38.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827825+0000", 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7191000000000002e-05 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:38.814 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:38.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:31:38.817 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:38.813+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:38.817 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:38.818 INFO:teuthology.orchestra.run.smithi050.stdout:3553 trunc from 0xd380474 to 0x86dc34b 2024-09-05T17:31:38.818 INFO:teuthology.orchestra.run.smithi050.stdout:3554 trunc from 0x86dc34b to 0x382dc67 2024-09-05T17:31:38.818 INFO:teuthology.orchestra.run.smithi050.stdout:3555 trunc from 0x382dc67 to 0x14eacc 2024-09-05T17:31:38.818 INFO:teuthology.orchestra.run.smithi050.stdout:3556 read 0xff8e4 thru 0x104d36 (0x5453 bytes) 2024-09-05T17:31:38.818 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:38.819 INFO:teuthology.orchestra.run.smithi050.stdout:3559 punch from 0x35e6b to 0x42d91, (0xcf26 bytes) 2024-09-05T17:31:38.819 INFO:teuthology.orchestra.run.smithi050.stdout:3560 trunc from 0x14eacc to 0xb4b1c80 2024-09-05T17:31:38.819 INFO:teuthology.orchestra.run.smithi050.stdout:3561 write 0xa4207a2 thru 0xa42d2d8 (0xcb37 bytes) 2024-09-05T17:31:38.819 INFO:teuthology.orchestra.run.smithi050.stdout:3562 read 0x8f84b8c thru 0x8f90957 (0xbdcc bytes) 2024-09-05T17:31:38.819 INFO:teuthology.orchestra.run.smithi050.stdout:3563 punch from 0x313cb61 to 0x31461cf, (0x966e bytes) 2024-09-05T17:31:38.819 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:38.819 INFO:teuthology.orchestra.run.smithi050.stdout:3565 write 0x5758777 thru 0x57593d2 (0xc5c bytes) 2024-09-05T17:31:38.819 INFO:teuthology.orchestra.run.smithi050.stdout:3567 writesame 0xbadd0c thru 0xbae11a data_size 0x1(0x40f bytes) 2024-09-05T17:31:38.824 INFO:teuthology.orchestra.run.smithi050.stdout:3569 write 0xceaa0f8 thru 0xceb0a09 (0x6912 bytes) 2024-09-05T17:31:38.829 INFO:teuthology.orchestra.run.smithi050.stdout:3571 read 0x27162c6 thru 0x2719e89 (0x3bc4 bytes) 2024-09-05T17:31:38.841 INFO:teuthology.orchestra.run.smithi050.stdout:3573 trunc from 0xceb0a0a to 0x581f537 2024-09-05T17:31:38.856 INFO:teuthology.orchestra.run.smithi050.stdout:3574 read 0x208aab4 thru 0x2092a5a (0x7fa7 bytes) 2024-09-05T17:31:38.876 INFO:teuthology.orchestra.run.smithi050.stdout:3575 write 0xd79bd11 thru 0xd79e75d (0x2a4d bytes) 2024-09-05T17:31:38.880 INFO:teuthology.orchestra.run.smithi050.stdout:3577 read 0xd658501 thru 0xd660566 (0x8066 bytes) 2024-09-05T17:31:38.880 INFO:teuthology.orchestra.run.smithi050.stdout:3578 punch from 0xa2dad32 to 0xa2e4728, (0x99f6 bytes) 2024-09-05T17:31:38.880 INFO:teuthology.orchestra.run.smithi050.stdout:3581 read 0x55211ba thru 0x55240ba (0x2f01 bytes) 2024-09-05T17:31:38.881 INFO:teuthology.orchestra.run.smithi050.stdout:3582 punch from 0x2270ed9 to 0x227ac3c, (0x9d63 bytes) 2024-09-05T17:31:38.889 INFO:teuthology.orchestra.run.smithi050.stdout:3583 write 0xea4864c thru 0xea54c00 (0xc5b5 bytes) 2024-09-05T17:31:38.893 INFO:teuthology.orchestra.run.smithi050.stdout:3585 punch from 0x326e78a to 0x327947b, (0xacf1 bytes) 2024-09-05T17:31:38.894 INFO:teuthology.orchestra.run.smithi050.stdout:3586 write 0x7325c50 thru 0x732fedf (0xa290 bytes) 2024-09-05T17:31:38.898 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:38.898 INFO:teuthology.orchestra.run.smithi050.stdout:3588 write 0xb48515c thru 0xb48bc74 (0x6b19 bytes) 2024-09-05T17:31:38.902 INFO:teuthology.orchestra.run.smithi050.stdout:3589 write 0x7e39624 thru 0x7e3aef5 (0x18d2 bytes) 2024-09-05T17:31:38.906 INFO:teuthology.orchestra.run.smithi050.stdout:3590 write 0x6785735 thru 0x678e526 (0x8df2 bytes) 2024-09-05T17:31:38.908 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:38.908 INFO:teuthology.orchestra.run.smithi050.stdout:3594 punch from 0xd0121c2 to 0xd01bad6, (0x9914 bytes) 2024-09-05T17:31:38.908 INFO:teuthology.orchestra.run.smithi050.stdout:3595 write 0xe890bdd thru 0xe8997d3 (0x8bf7 bytes) 2024-09-05T17:31:38.912 INFO:teuthology.orchestra.run.smithi050.stdout:3596 read 0xc1f4191 thru 0xc1f4e37 (0xca7 bytes) 2024-09-05T17:31:38.913 INFO:teuthology.orchestra.run.smithi050.stdout:3597 write 0xc34b092 thru 0xc34f34f (0x42be bytes) 2024-09-05T17:31:38.917 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:38.917+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:38.917 INFO:teuthology.orchestra.run.smithi050.stdout:3598 read 0x53ac22e thru 0x53b421c (0x7fef bytes) 2024-09-05T17:31:38.918 INFO:teuthology.orchestra.run.smithi050.stdout:3600 writesame 0xc40190c thru 0xc40f627 data_size 0x6a(0xdd1c bytes) 2024-09-05T17:31:38.922 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:38.922 INFO:teuthology.orchestra.run.smithi050.stdout:3602 punch from 0xbe6dde3 to 0xbe75239, (0x7456 bytes) 2024-09-05T17:31:38.922 INFO:teuthology.orchestra.run.smithi050.stdout:3603 writesame 0x9964a28 thru 0x9965d58 data_size 0x1(0x1331 bytes) 2024-09-05T17:31:38.927 INFO:teuthology.orchestra.run.smithi050.stdout:3604 writesame 0x2d2cc78 thru 0x2d3b201 data_size 0xb(0xe58a bytes) 2024-09-05T17:31:38.934 INFO:teuthology.orchestra.run.smithi050.stdout:3605 write 0x55bed2a thru 0x55cb96a (0xcc41 bytes) 2024-09-05T17:31:38.939 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:38.939 INFO:teuthology.orchestra.run.smithi050.stdout:3607 clone 19 order 24 su 4194304 sc 8 2024-09-05T17:31:38.959 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:38.959 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:38.959 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:38.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:39.023 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:39.025+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:39.119 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:39.121+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:39.158 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:39.158 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:39.159 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:39.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:39.220 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:39.221+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:39.318 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:39.321 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:39.321+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:39.343 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261777215999999, 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:31:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:31:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261748799999999, 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:31:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261726873999997, 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261705427000003, 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:31:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261667137000003, 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:31:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:31:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261652321, 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261641122, 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:31:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:31:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261630283000002, 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261619805999999, 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261608983999999, 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:31:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261598583999998, 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:31:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261580232, 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:31:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.261396607999998, 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:31:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:31:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.252737314000001, 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:31:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:31:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.252696772999997, 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:31:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.252656944000002, 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.252629468999999, 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:31:39.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:31:39.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.252590959999999, 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:31:39.423 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:31:39.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:31:39.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.252548220000001, 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:31:39.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.851270006, 2024-09-05T17:31:39.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:31:39.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:39.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:39.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:39.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:39.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:31:39.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:31:39.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.441 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:39.441 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:39.441 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:39.443 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:39.443 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:39.441+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:39.468 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:39.469 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:39.485 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:39.485 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:39.493 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:31:39.511 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:39.512 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:39.530 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:39.531 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:39.544 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:39.541+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:39.552 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:39.552 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:39.571 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:39.572 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:39.593 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:39.593 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:39.599 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:39.599 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:39.614 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:39.614 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:39.614 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:39.680 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:39.681+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:39.746 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:39.745+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:39.806 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:39.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:39.847 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:39.845+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:39.948 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:39.949+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:39.993 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:39.993 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:40.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:40.051 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:40.053+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:40.150 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:40.149+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:40.179 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:40.180 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:40.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:40.279 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:40.281+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:40.352 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:40.353+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:40.360 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:40.361 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:40.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:40.453 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:40.453+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:40.550 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:40.550 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:40.554 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:40.553+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:40.564 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:40.603 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone18 from 0xea54c01 (overlap 0x14eacc) to 0x64670 2024-09-05T17:31:40.655 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:40.657+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:40.741 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:40.741 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:40.756 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:40.753+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:40.758 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:40.819 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-05T17:31:40.823 INFO:teuthology.orchestra.run.smithi050.stdout:3609 write 0x9335a17 thru 0x9340aea (0xb0d4 bytes) 2024-09-05T17:31:40.841 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:40.841 INFO:teuthology.orchestra.run.smithi050.stdout:3612 read 0xcaee287 thru 0xcafbae0 (0xd85a bytes) 2024-09-05T17:31:40.841 INFO:teuthology.orchestra.run.smithi050.stdout:3613 read 0xc06797c thru 0xc06b24a (0x38cf bytes) 2024-09-05T17:31:40.841 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:40.841 INFO:teuthology.orchestra.run.smithi050.stdout:3615 write 0x3274d49 thru 0x328014e (0xb406 bytes) 2024-09-05T17:31:40.852 INFO:teuthology.orchestra.run.smithi050.stdout:3616 write 0x60891a5 thru 0x608fae8 (0x6944 bytes) 2024-09-05T17:31:40.857 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:40.857+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:40.866 INFO:teuthology.orchestra.run.smithi050.stdout:3617 read 0xb8f3524 thru 0xb8ffa71 (0xc54e bytes) 2024-09-05T17:31:40.866 INFO:teuthology.orchestra.run.smithi050.stdout:3618 write 0xdaec002 thru 0xdaf38fb (0x78fa bytes) 2024-09-05T17:31:40.874 INFO:teuthology.orchestra.run.smithi050.stdout:3619 writesame 0x5bd75bc thru 0x5bde5ed data_size 0x3(0x7032 bytes) 2024-09-05T17:31:40.891 INFO:teuthology.orchestra.run.smithi050.stdout:3622 write 0xa5eb195 thru 0xa5ebebc (0xd28 bytes) 2024-09-05T17:31:40.901 INFO:teuthology.orchestra.run.smithi050.stdout:3623 write 0x97c9aa4 thru 0x97d4f4f (0xb4ac bytes) 2024-09-05T17:31:40.912 INFO:teuthology.orchestra.run.smithi050.stdout:3624 read 0x74359a0 thru 0x7439d4d (0x43ae bytes) 2024-09-05T17:31:40.912 INFO:teuthology.orchestra.run.smithi050.stdout:3626 read 0xabc63fe thru 0xabd159e (0xb1a1 bytes) 2024-09-05T17:31:40.912 INFO:teuthology.orchestra.run.smithi050.stdout:3628 write 0x21dbf9c thru 0x21e4df6 (0x8e5b bytes) 2024-09-05T17:31:40.921 INFO:teuthology.orchestra.run.smithi050.stdout:3630 trunc from 0xea54c01 to 0xb90d55d 2024-09-05T17:31:40.936 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:40.936 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:40.952 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:40.952 INFO:teuthology.orchestra.run.smithi050.stdout:3631 write 0x4086bc0 thru 0x409261f (0xba60 bytes) 2024-09-05T17:31:40.956 INFO:teuthology.orchestra.run.smithi050.stdout:3633 punch from 0x732c975 to 0x733a5fb, (0xdc86 bytes) 2024-09-05T17:31:40.956 INFO:teuthology.orchestra.run.smithi050.stdout:3634 read 0x3201bb4 thru 0x3205680 (0x3acd bytes) 2024-09-05T17:31:40.957 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:40.957+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:40.957 INFO:teuthology.orchestra.run.smithi050.stdout:3635 read 0x11f2105 thru 0x11fb922 (0x981e bytes) 2024-09-05T17:31:40.957 INFO:teuthology.orchestra.run.smithi050.stdout:3636 read 0x5dde71c thru 0x5de2eb0 (0x4795 bytes) 2024-09-05T17:31:40.961 INFO:teuthology.orchestra.run.smithi050.stdout:3637 trunc from 0xb90d55d to 0xd7d857b 2024-09-05T17:31:40.973 INFO:teuthology.orchestra.run.smithi050.stdout:3640 read 0xcbf4b thru 0xd57df (0x9895 bytes) 2024-09-05T17:31:40.975 INFO:teuthology.orchestra.run.smithi050.stdout:3641 punch from 0xb4f7625 to 0xb5068c7, (0xf2a2 bytes) 2024-09-05T17:31:40.987 INFO:teuthology.orchestra.run.smithi050.stdout:3642 write 0xde475ec thru 0xde56d7f (0xf794 bytes) 2024-09-05T17:31:40.989 INFO:teuthology.orchestra.run.smithi050.stdout:3644 write 0x9fd9433 thru 0x9fdb4fb (0x20c9 bytes) 2024-09-05T17:31:40.991 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:40.991 INFO:teuthology.orchestra.run.smithi050.stdout:3648 write 0xa919224 thru 0xa91e755 (0x5532 bytes) 2024-09-05T17:31:40.993 INFO:teuthology.orchestra.run.smithi050.stdout:3649 write 0x37c3b46 thru 0x37c6826 (0x2ce1 bytes) 2024-09-05T17:31:41.005 INFO:teuthology.orchestra.run.smithi050.stdout:3650 read 0xc2a4c89 thru 0xc2ae362 (0x96da bytes) 2024-09-05T17:31:41.006 INFO:teuthology.orchestra.run.smithi050.stdout:3652 write 0x14c3fb9 thru 0x14c501f (0x1067 bytes) 2024-09-05T17:31:41.009 INFO:teuthology.orchestra.run.smithi050.stdout:3653 read 0x7607cd9 thru 0x7614ea5 (0xd1cd bytes) 2024-09-05T17:31:41.010 INFO:teuthology.orchestra.run.smithi050.stdout:3654 write 0x615a49c thru 0x6162c0f (0x8774 bytes) 2024-09-05T17:31:41.014 INFO:teuthology.orchestra.run.smithi050.stdout:3655 writesame 0x3912647 thru 0x391d4da data_size 0x2(0xae94 bytes) 2024-09-05T17:31:41.041 INFO:teuthology.orchestra.run.smithi050.stdout:3656 trunc from 0xde56d80 to 0xe23f976 2024-09-05T17:31:41.054 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.054 INFO:teuthology.orchestra.run.smithi050.stdout:3658 punch from 0x70ed176 to 0x70f48e1, (0x776b bytes) 2024-09-05T17:31:41.054 INFO:teuthology.orchestra.run.smithi050.stdout:3659 read 0x5c7da6a thru 0x5c84a94 (0x702b bytes) 2024-09-05T17:31:41.054 INFO:teuthology.orchestra.run.smithi050.stdout:3660 read 0x5f9a19 thru 0x608cde (0xf2c6 bytes) 2024-09-05T17:31:41.058 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:41.057+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:41.072 INFO:teuthology.orchestra.run.smithi050.stdout:3661 trunc from 0xe23f976 to 0x277b5b2 2024-09-05T17:31:41.075 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:41.075 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:41.093 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:41.116 INFO:teuthology.orchestra.run.smithi050.stdout:3662 punch from 0x142e1b2 to 0x143a79e, (0xc5ec bytes) 2024-09-05T17:31:41.116 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.116 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.116 INFO:teuthology.orchestra.run.smithi050.stdout:3666 read 0xf39cb9 thru 0xf3c6c4 (0x2a0c bytes) 2024-09-05T17:31:41.116 INFO:teuthology.orchestra.run.smithi050.stdout:3667 punch from 0x1ae44ac to 0x1aed0fe, (0x8c52 bytes) 2024-09-05T17:31:41.116 INFO:teuthology.orchestra.run.smithi050.stdout:3669 read 0x23e4fb2 thru 0x23e5b74 (0xbc3 bytes) 2024-09-05T17:31:41.120 INFO:teuthology.orchestra.run.smithi050.stdout:3670 trunc from 0x277b5b2 to 0x4d9cc0 2024-09-05T17:31:41.144 INFO:teuthology.orchestra.run.smithi050.stdout:3672 punch from 0x1304f2 to 0x137352, (0x6e60 bytes) 2024-09-05T17:31:41.158 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:41.157+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:41.165 INFO:teuthology.orchestra.run.smithi050.stdout:3673 write 0x70dd75d thru 0x70e6b5c (0x9400 bytes) 2024-09-05T17:31:41.171 INFO:teuthology.orchestra.run.smithi050.stdout:3674 punch from 0x60334eb to 0x603b339, (0x7e4e bytes) 2024-09-05T17:31:41.171 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.200 INFO:teuthology.orchestra.run.smithi050.stdout:3676 write 0xe8215aa thru 0xe82e7d5 (0xd22c bytes) 2024-09-05T17:31:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.205 INFO:teuthology.orchestra.run.smithi050.stdout:3679 punch from 0xce5d226 to 0xce5eb52, (0x192c bytes) 2024-09-05T17:31:41.233 INFO:teuthology.orchestra.run.smithi050.stdout:3680 trunc from 0xe82e7d6 to 0x2c8324a 2024-09-05T17:31:41.235 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:41.235 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:41.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:41.277 INFO:teuthology.orchestra.run.smithi050.stdout:3682 write 0x638739c thru 0x63955ed (0xe252 bytes) 2024-09-05T17:31:41.281 INFO:teuthology.orchestra.run.smithi050.stdout:3683 read 0x4889a27 thru 0x4897950 (0xdf2a bytes) 2024-09-05T17:31:41.281 INFO:teuthology.orchestra.run.smithi050.stdout:3684 punch from 0x25f7b04 to 0x25f95e1, (0x1add bytes) 2024-09-05T17:31:41.293 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:41.293+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:41.311 INFO:teuthology.orchestra.run.smithi050.stdout:3686 writesame 0xba28dfc thru 0xba31983 data_size 0x5f(0x8b88 bytes) 2024-09-05T17:31:41.311 INFO:teuthology.orchestra.run.smithi050.stdout:3688 writesame 0x1502234 thru 0x1504467 data_size 0x4(0x2234 bytes) 2024-09-05T17:31:41.317 INFO:teuthology.orchestra.run.smithi050.stdout:3689 write 0x58690f8 thru 0x5877aaf (0xe9b8 bytes) 2024-09-05T17:31:41.323 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.323 INFO:teuthology.orchestra.run.smithi050.stdout:3692 read 0x1a7ea44 thru 0x1a8943e (0xa9fb bytes) 2024-09-05T17:31:41.324 INFO:teuthology.orchestra.run.smithi050.stdout:3693 trunc from 0xba31984 to 0xbcc561a 2024-09-05T17:31:41.334 INFO:teuthology.orchestra.run.smithi050.stdout:3696 write 0x26a4da1 thru 0x26af685 (0xa8e5 bytes) 2024-09-05T17:31:41.339 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.339 INFO:teuthology.orchestra.run.smithi050.stdout:3698 read 0x922ad29 thru 0x922e39a (0x3672 bytes) 2024-09-05T17:31:41.339 INFO:teuthology.orchestra.run.smithi050.stdout:3699 punch from 0xa647fed to 0xa6565a1, (0xe5b4 bytes) 2024-09-05T17:31:41.339 INFO:teuthology.orchestra.run.smithi050.stdout:3702 writesame 0x4e65800 thru 0x4e67ef4 data_size 0x1(0x26f5 bytes) 2024-09-05T17:31:41.354 INFO:teuthology.orchestra.run.smithi050.stdout:3704 write 0x4a5c41 thru 0x4ae3df (0x879f bytes) 2024-09-05T17:31:41.360 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:41.361+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:41.376 INFO:teuthology.orchestra.run.smithi050.stdout:3705 writesame 0xdc624e9 thru 0xdc6cf70 data_size 0x44(0xaa88 bytes) 2024-09-05T17:31:41.376 INFO:teuthology.orchestra.run.smithi050.stdout:3707 punch from 0x3e95b57 to 0x3e9e9d6, (0x8e7f bytes) 2024-09-05T17:31:41.376 INFO:teuthology.orchestra.run.smithi050.stdout:3709 read 0x224ca75 thru 0x2250877 (0x3e03 bytes) 2024-09-05T17:31:41.377 INFO:teuthology.orchestra.run.smithi050.stdout:3711 read 0x9b8646b thru 0x9b903c4 (0x9f5a bytes) 2024-09-05T17:31:41.377 INFO:teuthology.orchestra.run.smithi050.stdout:3712 read 0x243d2d thru 0x24df4d (0xa221 bytes) 2024-09-05T17:31:41.378 INFO:teuthology.orchestra.run.smithi050.stdout:3713 read 0x6fe927b thru 0x6ff72af (0xe035 bytes) 2024-09-05T17:31:41.391 INFO:teuthology.orchestra.run.smithi050.stdout:3714 write 0xdd86fdf thru 0xdd89ebf (0x2ee1 bytes) 2024-09-05T17:31:41.417 INFO:teuthology.orchestra.run.smithi050.stdout:3715 trunc from 0xdd89ec0 to 0x6bab79a 2024-09-05T17:31:41.418 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:41.418 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:41.433 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:41.465 INFO:teuthology.orchestra.run.smithi050.stdout:3716 trunc from 0x6bab79a to 0xed55159 2024-09-05T17:31:41.484 INFO:teuthology.orchestra.run.smithi050.stdout:3720 trunc from 0xed55159 to 0xb24b5e0 2024-09-05T17:31:41.485 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:41.485+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:41.493 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.503 INFO:teuthology.orchestra.run.smithi050.stdout:3723 trunc from 0xb24b5e0 to 0x76ea395 2024-09-05T17:31:41.513 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.513 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:41.513 INFO:teuthology.orchestra.run.smithi050.stdout:3726 clone 20 order 24 su 8388608 sc 2 2024-09-05T17:31:41.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:31:41.560 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:41.560 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:41.571 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:41.573+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:41.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:41.631 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:41.675 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:41.677+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:41.743 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:41.743 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:41.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:41.761 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:41.761+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:41.781 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:41.781 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:41.781 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-05T17:31:41.782 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-05T17:31:41.783 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:41.784 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:41.801 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:41.801 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:41.823 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:41.823 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:41.842 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:41.842 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:41.863 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:41.865+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:41.867 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:41.868 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:41.881 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:41.881 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:41.891 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:41.891 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:41.897 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:41.911 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone19 from 0x76ea395 (overlap 0x4d9cc0) to 0x3e1700 2024-09-05T17:31:41.915 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:41.915 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:41.935 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:41.935 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:41.965 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:41.965+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:42.029 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:42.029 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:42.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284880757, 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.030 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:31:42.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.034 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284822563999999, 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:31:42.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284761245999999, 2024-09-05T17:31:42.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:31:42.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284694778999999, 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:31:42.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284618622, 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:31:42.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:31:42.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:31:42.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:31:42.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:31:42.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:42.054 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284555654999998, 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:42.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:31:42.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284493924, 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:31:42.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:31:42.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284410897000001, 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:31:42.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.065 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:42.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:31:42.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:31:42.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:31:42.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:31:42.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:31:42.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:31:42.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.069 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284352222999999, 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:31:42.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.073 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284295276000002, 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.074 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:31:42.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:31:42.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:31:42.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284230801, 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.081 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:31:42.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:31:42.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.085 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284160148000002, 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:31:42.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:31:42.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284083158000001, 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.090 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:31:42.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.284024397, 2024-09-05T17:31:42.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:42.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.098 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.283961726000001, 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.283899595000001, 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:31:42.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.283780520000001, 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:31:42.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.283726069, 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.112 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:31:42.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.283563629, 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:31:42.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:31:42.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.282379242000001, 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.121 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:31:42.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:31:42.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:31:42.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.125 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:42.127 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:31:42.127 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:42.127 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 65, 2024-09-05T17:31:42.127 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "229efc05-fdc4-4e1f-8246-413b49f3eeda", 2024-09-05T17:31:42.127 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2024-09-05T17:30:12.762369+0000", 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2024-09-05T17:31:41.759177+0000", 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2024-09-05T17:30:23.981355+0000", 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2024-09-05T17:31:36.736207+0000", 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5799936, 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:42.128 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 5, 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.94999998807907104, 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 3, 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "luminous", 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "squid", 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2024-09-05T17:31:42.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:25.818485+0000", 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:42.130 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:42.131 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "18", 2024-09-05T17:31:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:42.132 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:42.133 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:42.134 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:42.135 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.90918922424316406, 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.9100000262260437 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:30.943478+0000", 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:42.137 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:42.138 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "22", 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 2, 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 22, 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:42.139 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:42.140 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:42.141 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2024-09-05T17:31:42.142 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2024-09-05T17:31:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2024-09-05T17:31:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2024-09-05T17:31:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2024-09-05T17:31:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.90918922424316406, 2024-09-05T17:31:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-05T17:31:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.9100000262260437 2024-09-05T17:31:42.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "pool_client.0", 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:42.082168+0000", 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:31:42.144 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:31:42.145 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "65", 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 22, 2024-09-05T17:31:42.146 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 65, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:31:42.147 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:31:42.148 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2.2400000095367432, 2024-09-05T17:31:42.149 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2.2400000095367432, 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.9700000286102295, 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.9700000286102295, 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.90918922424316406, 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.9100000262260437 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:31:42.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "38dd1565-a37f-4055-acb3-aa82457cf9e7", 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 0, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 0, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 62, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:42.151 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:42.152 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:42.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2024-09-05T17:31:42.152 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2024-09-05T17:31:42.155 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6825/1446480840", 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6827/1446480840", 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/1446480840", 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6829/1446480840", 2024-09-05T17:31:42.156 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f5ef5f03-d714-4329-b14b-1881ad1e7358", 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:42.157 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 63, 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2024-09-05T17:31:42.161 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/3885625462", 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/3885625462", 2024-09-05T17:31:42.162 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/3885625462", 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/3885625462", 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "7b87b0cc-2484-4a66-be1b-232a7e36dc11", 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:42.163 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 19, 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:42.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2024-09-05T17:31:42.165 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:42.167 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.168 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2024-09-05T17:31:42.168 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:42.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.168 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.169 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2024-09-05T17:31:42.169 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:31:42.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.169 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.170 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/3027840955", 2024-09-05T17:31:42.170 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/3027840955", 2024-09-05T17:31:42.170 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/3027840955", 2024-09-05T17:31:42.170 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/3027840955", 2024-09-05T17:31:42.170 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:42.170 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:42.170 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:42.170 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f6d63b1e-2673-4542-a2e2-fbb0c4577864", 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 63, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:42.171 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.172 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:42.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/2889879466", 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6819/2889879466", 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6823/2889879466", 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6821/2889879466", 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:42.176 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "273ec4c6-0c2a-41d5-90c1-68b317365484", 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 0.2735137939453125, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:42.177 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 24, 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6808", 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6809", 2024-09-05T17:31:42.178 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6810", 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6811", 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.180 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6814", 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6815", 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6812", 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6813", 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6809/1774319792", 2024-09-05T17:31:42.182 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6811/1774319792", 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6815/1774319792", 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6813/1774319792", 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "5f6cf36b-2dd0-47de-97c4-42e98f849734", 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:42.183 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 63, 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6816", 2024-09-05T17:31:42.184 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6817", 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6818", 2024-09-05T17:31:42.185 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6819", 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6822", 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6823", 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:42.187 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6820", 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6821", 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.188 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6817/1348894681", 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6819/1348894681", 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6823/1348894681", 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6821/1348894681", 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "2d6ed4a6-3d83-4c9d-9e96-2dbab049448a", 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:42.189 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 63, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6824", 2024-09-05T17:31:42.190 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6825", 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.191 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6826", 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6827", 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6830", 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6831", 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.193 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6828", 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6829", 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.194 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6825/792585226", 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6827/792585226", 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6831/792585226", 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6829/792585226", 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "dbe1901b-5f78-419f-864a-89946452f4a6", 2024-09-05T17:31:42.195 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 63, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6800", 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6801", 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6802", 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6803", 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6806", 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6807", 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:31:42.199 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6804", 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6805", 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6801/2161010500", 2024-09-05T17:31:42.200 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6803/2161010500", 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2161010500", 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2161010500", 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:42.201 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 65536, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:22.246726+0000", 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:42.202 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.638940+0000", 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:42.203 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.694544+0000", 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.653253+0000", 2024-09-05T17:31:42.204 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.467561+0000", 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.205 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.797765+0000", 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:42.206 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.649372+0000", 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.242988+0000", 2024-09-05T17:31:42.207 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [ 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: "pgid": "3.7", 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: 6, 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: 7 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [ 2024-09-05T17:31:42.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "pgid": "2.0", 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "mappings": [ 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "from": 1, 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "to": 4 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2024-09-05T17:31:42.209 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2024-09-05T17:31:42.210 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:42.211 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:42.212 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-05T17:31:42.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:42.214 INFO:tasks.thrashosds.thrasher:j is {'epoch': 65, 'fsid': '229efc05-fdc4-4e1f-8246-413b49f3eeda', 'created': '2024-09-05T17:30:12.762369+0000', 'modified': '2024-09-05T17:31:41.759177+0000', 'last_up_change': '2024-09-05T17:30:23.981355+0000', 'last_in_change': '2024-09-05T17:31:36.736207+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T17:30:25.818485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9091892242431641, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.9100000262260437}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-05T17:30:30.943478+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9091892242431641, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.9100000262260437}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-05T17:30:42.082168+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 22, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.9700000286102295, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 0.9091892242431641, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.9100000262260437}}], 'osds': [{'osd': 0, 'uuid': '38dd1565-a37f-4055-acb3-aa82457cf9e7', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 62, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6824', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6825', 'nonce': 1446480840}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6826', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6827', 'nonce': 1446480840}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6830', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6831', 'nonce': 1446480840}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6828', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6829', 'nonce': 1446480840}]}, 'public_addr': '172.21.15.50:6825/1446480840', 'cluster_addr': '172.21.15.50:6827/1446480840', 'heartbeat_back_addr': '172.21.15.50:6831/1446480840', 'heartbeat_front_addr': '172.21.15.50:6829/1446480840', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f5ef5f03-d714-4329-b14b-1881ad1e7358', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6808', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6809', 'nonce': 3885625462}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6810', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6811', 'nonce': 3885625462}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6814', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6815', 'nonce': 3885625462}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6812', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6813', 'nonce': 3885625462}]}, 'public_addr': '172.21.15.50:6809/3885625462', 'cluster_addr': '172.21.15.50:6811/3885625462', 'heartbeat_back_addr': '172.21.15.50:6815/3885625462', 'heartbeat_front_addr': '172.21.15.50:6813/3885625462', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '7b87b0cc-2484-4a66-be1b-232a7e36dc11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6800', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6801', 'nonce': 3027840955}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6802', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6803', 'nonce': 3027840955}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6806', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6807', 'nonce': 3027840955}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6804', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6805', 'nonce': 3027840955}]}, 'public_addr': '172.21.15.50:6801/3027840955', 'cluster_addr': '172.21.15.50:6803/3027840955', 'heartbeat_back_addr': '172.21.15.50:6807/3027840955', 'heartbeat_front_addr': '172.21.15.50:6805/3027840955', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'f6d63b1e-2673-4542-a2e2-fbb0c4577864', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6816', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6817', 'nonce': 2889879466}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6818', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 2889879466}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6822', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6823', 'nonce': 2889879466}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6820', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6821', 'nonce': 2889879466}]}, 'public_addr': '172.21.15.50:6817/2889879466', 'cluster_addr': '172.21.15.50:6819/2889879466', 'heartbeat_back_addr': '172.21.15.50:6823/2889879466', 'heartbeat_front_addr': '172.21.15.50:6821/2889879466', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '273ec4c6-0c2a-41d5-90c1-68b317365484', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2735137939453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 24, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 1774319792}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 1774319792}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 1774319792}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 1774319792}]}, 'public_addr': '172.21.15.110:6809/1774319792', 'cluster_addr': '172.21.15.110:6811/1774319792', 'heartbeat_back_addr': '172.21.15.110:6815/1774319792', 'heartbeat_front_addr': '172.21.15.110:6813/1774319792', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5f6cf36b-2dd0-47de-97c4-42e98f849734', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 1348894681}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 1348894681}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 1348894681}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 1348894681}]}, 'public_addr': '172.21.15.110:6817/1348894681', 'cluster_addr': '172.21.15.110:6819/1348894681', 'heartbeat_back_addr': '172.21.15.110:6823/1348894681', 'heartbeat_front_addr': '172.21.15.110:6821/1348894681', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2d6ed4a6-3d83-4c9d-9e96-2dbab049448a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 792585226}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 792585226}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 792585226}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 792585226}]}, 'public_addr': '172.21.15.110:6825/792585226', 'cluster_addr': '172.21.15.110:6827/792585226', 'heartbeat_back_addr': '172.21.15.110:6831/792585226', 'heartbeat_front_addr': '172.21.15.110:6829/792585226', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dbe1901b-5f78-419f-864a-89946452f4a6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 63, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2161010500}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2161010500}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2161010500}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2161010500}]}, 'public_addr': '172.21.15.110:6801/2161010500', 'cluster_addr': '172.21.15.110:6803/2161010500', 'heartbeat_back_addr': '172.21.15.110:6807/2161010500', 'heartbeat_front_addr': '172.21.15.110:6805/2161010500', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-05T17:30:22.246726+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.638940+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.694544+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.653253+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.467561+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.797765+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.649372+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.242988+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.7', 'osds': [6, 7]}], 'pg_upmap_items': [{'pgid': '2.0', 'mappings': [{'from': 1, 'to': 4}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-05T17:31:42.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:31:42.215 INFO:teuthology.orchestra.run.smithi050.stdout:3727 read 0x5497303 thru 0x549f333 (0x8031 bytes) 2024-09-05T17:31:42.215 INFO:teuthology.orchestra.run.smithi050.stdout:3728 read 0x27e9de thru 0x28a59e (0xbbc1 bytes) 2024-09-05T17:31:42.215 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:42.125+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:42.216 INFO:teuthology.orchestra.run.smithi050.stdout:3729 read 0x10f29b6 thru 0x10fdd9f (0xb3ea bytes) 2024-09-05T17:31:42.216 INFO:teuthology.orchestra.run.smithi050.stdout:3731 read 0xbc2fd9 thru 0xbc76dd (0x4705 bytes) 2024-09-05T17:31:42.216 INFO:teuthology.orchestra.run.smithi050.stdout:3732 flatten 2024-09-05T17:31:42.216 INFO:teuthology.orchestra.run.smithi050.stdout:3733 clone 21 order 25 su 1048576 sc 13 2024-09-05T17:31:42.257 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:42.257+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:42.329 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:42.329+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:42.387 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:42.387 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:42.401 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:42.444 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:42.445+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:42.525 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:42.525 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:42.531 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:42.529+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:42.538 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:42.576 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:31:42.577 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:31:42.596 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-05T17:31:41.789362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650291912,"num_objects":813,"num_object_clones":287,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":813,"num_whiteouts":235,"num_read":76238,"num_read_kb":187626,"num_write":12867,"num_write_kb":114132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":678,"num_bytes_recovered":22640023,"num_keys_recovered":72,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10060,"ondisk_log_size":10060,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":296716,"kb_used_data":21472,"kb_used_omap":10,"kb_used_meta":275061,"kb_avail":660306164,"statfs":{"total":676457349120,"available":676153511936,"internally_reserved":0,"allocated":21987328,"data_stored":151688226,"data_compressed":5211260,"data_compressed_allocated":11390976,"data_compressed_original":145997950,"omap_allocated":11156,"internal_metadata":281662572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20771680,"num_objects":28,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":5,"num_read":3349,"num_read_kb":8905,"num_write":694,"num_write_kb":3773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":634,"num_bytes_recovered":22447542,"num_keys_recovered":72,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001026"},"pg_stats":[{"pgid":"3.1f","version":"62'206","reported_seq":2099,"reported_epoch":63,"state":"peering","last_fresh":"2024-09-05T17:31:39.502033+0000","last_change":"2024-09-05T17:31:39.502033+0000","last_active":"2024-09-05T17:31:39.502033+0000","last_peered":"2024-09-05T17:31:38.936351+0000","last_clean":"2024-09-05T17:31:36.239425+0000","last_became_active":"2024-09-05T17:31:38.522403+0000","last_became_peered":"2024-09-05T17:31:38.522403+0000","last_unstale":"2024-09-05T17:31:39.502033+0000","last_undegraded":"2024-09-05T17:31:39.502033+0000","last_fullsized":"2024-09-05T17:31:39.502033+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023314770000000002,"stat_sum":{"num_bytes":41948147,"num_objects":31,"num_object_clones":11,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":8,"num_read":2295,"num_read_kb":9542,"num_write":234,"num_write_kb":5670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":3163339,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"55'213","reported_seq":805,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.501664+0000","last_change":"2024-09-05T17:30:45.601580+0000","last_active":"2024-09-05T17:31:39.501664+0000","last_peered":"2024-09-05T17:31:39.501664+0000","last_clean":"2024-09-05T17:31:39.501664+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:31:39.501664+0000","last_undegraded":"2024-09-05T17:31:39.501664+0000","last_fullsized":"2024-09-05T17:31:39.501664+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:13:00.534191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012442379999999999,"stat_sum":{"num_bytes":3071594,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":1327,"num_read_kb":1812,"num_write":223,"num_write_kb":3261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"62'126","reported_seq":623,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.500962+0000","last_change":"2024-09-05T17:30:45.585378+0000","last_active":"2024-09-05T17:31:39.500962+0000","last_peered":"2024-09-05T17:31:39.500962+0000","last_clean":"2024-09-05T17:31:39.500962+0000","last_became_active":"2024-09-05T17:30:43.597087+0000","last_became_peered":"2024-09-05T17:30:43.597087+0000","last_unstale":"2024-09-05T17:31:39.500962+0000","last_undegraded":"2024-09-05T17:31:39.500962+0000","last_fullsized":"2024-09-05T17:31:39.500962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:20:37.103319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064572499999999999,"stat_sum":{"num_bytes":21959678,"num_objects":22,"num_object_clones":7,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":623,"num_read_kb":3019,"num_write":125,"num_write_kb":2630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"62'186","reported_seq":1697,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.583637+0000","last_change":"2024-09-05T17:30:45.586287+0000","last_active":"2024-09-05T17:31:39.583637+0000","last_peered":"2024-09-05T17:31:39.583637+0000","last_clean":"2024-09-05T17:31:39.583637+0000","last_became_active":"2024-09-05T17:30:43.604511+0000","last_became_peered":"2024-09-05T17:30:43.604511+0000","last_unstale":"2024-09-05T17:31:39.583637+0000","last_undegraded":"2024-09-05T17:31:39.583637+0000","last_fullsized":"2024-09-05T17:31:39.583637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:50:13.036470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015056150000000001,"stat_sum":{"num_bytes":5892321,"num_objects":19,"num_object_clones":4,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":3,"num_read":1473,"num_read_kb":3121,"num_write":187,"num_write_kb":2179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"51'187","reported_seq":684,"reported_epoch":63,"state":"peering","last_fresh":"2024-09-05T17:31:38.781404+0000","last_change":"2024-09-05T17:31:39.844730+0000","last_active":"2024-09-05T17:31:39.844730+0000","last_peered":"2024-09-05T17:31:38.781404+0000","last_clean":"2024-09-05T17:31:35.738960+0000","last_became_active":"2024-09-05T17:31:38.533773+0000","last_became_peered":"2024-09-05T17:31:38.533773+0000","last_unstale":"2024-09-05T17:31:38.781404+0000","last_undegraded":"2024-09-05T17:31:38.781404+0000","last_fullsized":"2024-09-05T17:31:38.781404+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001548448,"stat_sum":{"num_bytes":35594159,"num_objects":20,"num_object_clones":8,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":5,"num_read":434,"num_read_kb":3770,"num_write":182,"num_write_kb":2863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1722378,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"62'438","reported_seq":3257,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.581666+0000","last_change":"2024-09-05T17:31:31.709738+0000","last_active":"2024-09-05T17:31:39.581666+0000","last_peered":"2024-09-05T17:31:39.581666+0000","last_clean":"2024-09-05T17:31:39.581666+0000","last_became_active":"2024-09-05T17:31:31.708688+0000","last_became_peered":"2024-09-05T17:31:31.708688+0000","last_unstale":"2024-09-05T17:31:39.581666+0000","last_undegraded":"2024-09-05T17:31:39.581666+0000","last_fullsized":"2024-09-05T17:31:39.581666+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:13:48.201055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058024300000000003,"stat_sum":{"num_bytes":12660480,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":4769,"num_read_kb":5938,"num_write":532,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"59'182","reported_seq":4002,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.501285+0000","last_change":"2024-09-05T17:30:45.579337+0000","last_active":"2024-09-05T17:31:39.501285+0000","last_peered":"2024-09-05T17:31:39.501285+0000","last_clean":"2024-09-05T17:31:39.501285+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:31:39.501285+0000","last_undegraded":"2024-09-05T17:31:39.501285+0000","last_fullsized":"2024-09-05T17:31:39.501285+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:20:34.913580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096919599999999997,"stat_sum":{"num_bytes":11902099,"num_objects":12,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":4,"num_read":3836,"num_read_kb":6268,"num_write":198,"num_write_kb":2021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"62'161","reported_seq":888,"reported_epoch":62,"state":"peering","last_fresh":"2024-09-05T17:31:38.942389+0000","last_change":"2024-09-05T17:31:39.501982+0000","last_active":"2024-09-05T17:31:39.501982+0000","last_peered":"2024-09-05T17:31:38.942389+0000","last_clean":"2024-09-05T17:31:36.532695+0000","last_became_active":"2024-09-05T17:31:38.527516+0000","last_became_peered":"2024-09-05T17:31:38.527516+0000","last_unstale":"2024-09-05T17:31:38.942389+0000","last_undegraded":"2024-09-05T17:31:38.942389+0000","last_fullsized":"2024-09-05T17:31:38.509080+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371232,"stat_sum":{"num_bytes":7404489,"num_objects":21,"num_object_clones":9,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":550,"num_read_kb":3489,"num_write":167,"num_write_kb":3899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":49,"num_bytes_recovered":1454927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"62'358","reported_seq":803,"reported_epoch":63,"state":"peering","last_fresh":"2024-09-05T17:31:39.504009+0000","last_change":"2024-09-05T17:31:39.504009+0000","last_active":"2024-09-05T17:31:39.504009+0000","last_peered":"2024-09-05T17:31:38.788078+0000","last_clean":"2024-09-05T17:31:36.577150+0000","last_became_active":"2024-09-05T17:31:38.547425+0000","last_became_peered":"2024-09-05T17:31:38.547425+0000","last_unstale":"2024-09-05T17:31:39.504009+0000","last_undegraded":"2024-09-05T17:31:39.504009+0000","last_fullsized":"2024-09-05T17:31:39.504009+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024520119999999999,"stat_sum":{"num_bytes":10571888,"num_objects":13,"num_object_clones":3,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":3,"num_read":1328,"num_read_kb":1390,"num_write":505,"num_write_kb":1597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":64694,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"63'515","reported_seq":1127,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.544006+0000","last_change":"2024-09-05T17:30:45.586718+0000","last_active":"2024-09-05T17:31:39.544006+0000","last_peered":"2024-09-05T17:31:39.544006+0000","last_clean":"2024-09-05T17:31:39.544006+0000","last_became_active":"2024-09-05T17:30:43.604988+0000","last_became_peered":"2024-09-05T17:30:43.604988+0000","last_unstale":"2024-09-05T17:31:39.544006+0000","last_undegraded":"2024-09-05T17:31:39.544006+0000","last_fullsized":"2024-09-05T17:31:39.544006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:19:14.992120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017597120000000001,"stat_sum":{"num_bytes":14690487,"num_objects":36,"num_object_clones":13,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":9,"num_read":2435,"num_read_kb":4889,"num_write":738,"num_write_kb":2101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"59'143","reported_seq":535,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.507543+0000","last_change":"2024-09-05T17:30:46.331830+0000","last_active":"2024-09-05T17:31:39.507543+0000","last_peered":"2024-09-05T17:31:39.507543+0000","last_clean":"2024-09-05T17:31:39.507543+0000","last_became_active":"2024-09-05T17:30:43.598646+0000","last_became_peered":"2024-09-05T17:30:43.598646+0000","last_unstale":"2024-09-05T17:31:39.507543+0000","last_undegraded":"2024-09-05T17:31:39.507543+0000","last_fullsized":"2024-09-05T17:31:39.507543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:37:18.635497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010679610000000001,"stat_sum":{"num_bytes":4803289,"num_objects":30,"num_object_clones":12,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":11,"num_read":340,"num_read_kb":2191,"num_write":130,"num_write_kb":1496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"63'237","reported_seq":1823,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.590182+0000","last_change":"2024-09-05T17:31:31.709878+0000","last_active":"2024-09-05T17:31:39.590182+0000","last_peered":"2024-09-05T17:31:39.590182+0000","last_clean":"2024-09-05T17:31:39.590182+0000","last_became_active":"2024-09-05T17:31:31.707629+0000","last_became_peered":"2024-09-05T17:31:31.707629+0000","last_unstale":"2024-09-05T17:31:39.590182+0000","last_undegraded":"2024-09-05T17:31:39.590182+0000","last_fullsized":"2024-09-05T17:31:39.590182+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":237,"log_dups_size":0,"ondisk_log_size":237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:16:43.372721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010724350000000001,"stat_sum":{"num_bytes":13318461,"num_objects":27,"num_object_clones":9,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":2207,"num_read_kb":5250,"num_write":256,"num_write_kb":2679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.504214+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:31:39.504214+0000","last_peered":"2024-09-05T17:31:39.504214+0000","last_clean":"2024-09-05T17:31:39.504214+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:31:39.504214+0000","last_undegraded":"2024-09-05T17:31:39.504214+0000","last_fullsized":"2024-09-05T17:31:39.504214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"62'314","reported_seq":1529,"reported_epoch":63,"state":"peering","last_fresh":"2024-09-05T17:31:39.502052+0000","last_change":"2024-09-05T17:31:39.502052+0000","last_active":"2024-09-05T17:31:39.502052+0000","last_peered":"2024-09-05T17:31:38.930724+0000","last_clean":"2024-09-05T17:31:36.293187+0000","last_became_active":"2024-09-05T17:31:38.535568+0000","last_became_peered":"2024-09-05T17:31:38.535568+0000","last_unstale":"2024-09-05T17:31:39.502052+0000","last_undegraded":"2024-09-05T17:31:39.502052+0000","last_fullsized":"2024-09-05T17:31:39.502052+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024656499999999998,"stat_sum":{"num_bytes":25900036,"num_objects":29,"num_object_clones":11,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":8,"num_read":2596,"num_read_kb":10808,"num_write":302,"num_write_kb":5517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":4774793,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.501618+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:31:39.501618+0000","last_peered":"2024-09-05T17:31:39.501618+0000","last_clean":"2024-09-05T17:31:39.501618+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:31:39.501618+0000","last_undegraded":"2024-09-05T17:31:39.501618+0000","last_fullsized":"2024-09-05T17:31:39.501618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"62'164","reported_seq":391,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.503830+0000","last_change":"2024-09-05T17:31:18.499515+0000","last_active":"2024-09-05T17:31:39.503830+0000","last_peered":"2024-09-05T17:31:39.503830+0000","last_clean":"2024-09-05T17:31:39.503830+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:31:39.503830+0000","last_undegraded":"2024-09-05T17:31:39.503830+0000","last_fullsized":"2024-09-05T17:31:39.503830+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:23.090775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062572599999999995,"stat_sum":{"num_bytes":2771906,"num_objects":11,"num_object_clones":4,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":5,"num_read":57,"num_read_kb":138,"num_write":160,"num_write_kb":888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.508576+0000","last_change":"2024-09-05T17:31:37.502979+0000","last_active":"2024-09-05T17:31:39.508576+0000","last_peered":"2024-09-05T17:31:39.508576+0000","last_clean":"2024-09-05T17:31:39.508576+0000","last_became_active":"2024-09-05T17:31:37.502514+0000","last_became_peered":"2024-09-05T17:31:37.502514+0000","last_unstale":"2024-09-05T17:31:39.508576+0000","last_undegraded":"2024-09-05T17:31:39.508576+0000","last_fullsized":"2024-09-05T17:31:39.508576+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:26:03.249089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"62'443","reported_seq":1987,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.501291+0000","last_change":"2024-09-05T17:30:45.579183+0000","last_active":"2024-09-05T17:31:39.501291+0000","last_peered":"2024-09-05T17:31:39.501291+0000","last_clean":"2024-09-05T17:31:39.501291+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:31:39.501291+0000","last_undegraded":"2024-09-05T17:31:39.501291+0000","last_fullsized":"2024-09-05T17:31:39.501291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:55.117960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075116199999999999,"stat_sum":{"num_bytes":19319080,"num_objects":22,"num_object_clones":6,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":6,"num_read":3376,"num_read_kb":4558,"num_write":631,"num_write_kb":2232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.501204+0000","last_change":"2024-09-05T17:31:37.508050+0000","last_active":"2024-09-05T17:31:39.501204+0000","last_peered":"2024-09-05T17:31:39.501204+0000","last_clean":"2024-09-05T17:31:39.501204+0000","last_became_active":"2024-09-05T17:31:37.507154+0000","last_became_peered":"2024-09-05T17:31:37.507154+0000","last_unstale":"2024-09-05T17:31:39.501204+0000","last_undegraded":"2024-09-05T17:31:39.501204+0000","last_fullsized":"2024-09-05T17:31:39.501204+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:03:10.252281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"59'327","reported_seq":979,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.501431+0000","last_change":"2024-09-05T17:30:45.585838+0000","last_active":"2024-09-05T17:31:39.501431+0000","last_peered":"2024-09-05T17:31:39.501431+0000","last_clean":"2024-09-05T17:31:39.501431+0000","last_became_active":"2024-09-05T17:30:43.586429+0000","last_became_peered":"2024-09-05T17:30:43.586429+0000","last_unstale":"2024-09-05T17:31:39.501431+0000","last_undegraded":"2024-09-05T17:31:39.501431+0000","last_fullsized":"2024-09-05T17:31:39.501431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:27:21.527218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010231579999999999,"stat_sum":{"num_bytes":37012630,"num_objects":29,"num_object_clones":10,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":8,"num_read":1530,"num_read_kb":12396,"num_write":370,"num_write_kb":8963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"62'241","reported_seq":1434,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-05T17:31:39.032067+0000","last_change":"2024-09-05T17:31:39.842092+0000","last_active":"2024-09-05T17:31:39.842092+0000","last_peered":"2024-09-05T17:31:39.032067+0000","last_clean":"2024-09-05T17:31:36.737164+0000","last_became_active":"2024-09-05T17:31:38.533688+0000","last_became_peered":"2024-09-05T17:31:38.533688+0000","last_unstale":"2024-09-05T17:31:39.032067+0000","last_undegraded":"2024-09-05T17:31:39.032067+0000","last_fullsized":"2024-09-05T17:31:39.032067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077238000000000003,"stat_sum":{"num_bytes":6681830,"num_objects":25,"num_object_clones":11,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":6,"num_read":1752,"num_read_kb":5049,"num_write":235,"num_write_kb":4190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":2070576,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":104,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.500189+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:31:39.500189+0000","last_peered":"2024-09-05T17:31:39.500189+0000","last_clean":"2024-09-05T17:31:39.500189+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:31:39.500189+0000","last_undegraded":"2024-09-05T17:31:39.500189+0000","last_fullsized":"2024-09-05T17:31:39.500189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"63'436","reported_seq":1904,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.582030+0000","last_change":"2024-09-05T17:30:45.580126+0000","last_active":"2024-09-05T17:31:39.582030+0000","last_peered":"2024-09-05T17:31:39.582030+0000","last_clean":"2024-09-05T17:31:39.582030+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:31:39.582030+0000","last_undegraded":"2024-09-05T17:31:39.582030+0000","last_fullsized":"2024-09-05T17:31:39.582030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:57:09.598398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093389999999999999,"stat_sum":{"num_bytes":6586834,"num_objects":39,"num_object_clones":15,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":14,"num_read":2981,"num_read_kb":4394,"num_write":603,"num_write_kb":2412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.505801+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:31:39.505801+0000","last_peered":"2024-09-05T17:31:39.505801+0000","last_clean":"2024-09-05T17:31:39.505801+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:31:39.505801+0000","last_undegraded":"2024-09-05T17:31:39.505801+0000","last_fullsized":"2024-09-05T17:31:39.505801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"62'194","reported_seq":6559,"reported_epoch":63,"state":"creating+peering","last_fresh":"2024-09-05T17:31:39.167288+0000","last_change":"2024-09-05T17:31:39.846816+0000","last_active":"2024-09-05T17:31:39.846816+0000","last_peered":"2024-09-05T17:31:39.167288+0000","last_clean":"2024-09-05T17:31:36.567322+0000","last_became_active":"2024-09-05T17:31:38.543594+0000","last_became_peered":"2024-09-05T17:31:38.543594+0000","last_unstale":"2024-09-05T17:31:39.167288+0000","last_undegraded":"2024-09-05T17:31:39.167288+0000","last_fullsized":"2024-09-05T17:31:39.167288+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001490367,"stat_sum":{"num_bytes":21847514,"num_objects":27,"num_object_clones":10,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":8,"num_read":6689,"num_read_kb":14499,"num_write":200,"num_write_kb":3162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":2048426,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.505547+0000","last_change":"2024-09-05T17:31:03.554542+0000","last_active":"2024-09-05T17:31:39.505547+0000","last_peered":"2024-09-05T17:31:39.505547+0000","last_clean":"2024-09-05T17:31:39.505547+0000","last_became_active":"2024-09-05T17:31:03.554149+0000","last_became_peered":"2024-09-05T17:31:03.554149+0000","last_unstale":"2024-09-05T17:31:39.505547+0000","last_undegraded":"2024-09-05T17:31:39.505547+0000","last_fullsized":"2024-09-05T17:31:39.505547+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:00:28.398696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"62'1437","reported_seq":4371,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.502642+0000","last_change":"2024-09-05T17:30:45.600843+0000","last_active":"2024-09-05T17:31:39.502642+0000","last_peered":"2024-09-05T17:31:39.502642+0000","last_clean":"2024-09-05T17:31:39.502642+0000","last_became_active":"2024-09-05T17:30:43.587691+0000","last_became_peered":"2024-09-05T17:30:43.587691+0000","last_unstale":"2024-09-05T17:31:39.502642+0000","last_undegraded":"2024-09-05T17:31:39.502642+0000","last_fullsized":"2024-09-05T17:31:39.502642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1437,"log_dups_size":0,"ondisk_log_size":1437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:21:17.716384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069190400000000002,"stat_sum":{"num_bytes":26788807,"num_objects":31,"num_object_clones":11,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":10140,"num_read_kb":12890,"num_write":2573,"num_write_kb":3601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":103,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.499848+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:31:39.499848+0000","last_peered":"2024-09-05T17:31:39.499848+0000","last_clean":"2024-09-05T17:31:39.499848+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:31:39.499848+0000","last_undegraded":"2024-09-05T17:31:39.499848+0000","last_fullsized":"2024-09-05T17:31:39.499848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":205,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.505589+0000","last_change":"2024-09-05T17:31:37.511716+0000","last_active":"2024-09-05T17:31:39.505589+0000","last_peered":"2024-09-05T17:31:39.505589+0000","last_clean":"2024-09-05T17:31:39.505589+0000","last_became_active":"2024-09-05T17:31:37.504681+0000","last_became_peered":"2024-09-05T17:31:37.504681+0000","last_unstale":"2024-09-05T17:31:39.505589+0000","last_undegraded":"2024-09-05T17:31:39.505589+0000","last_fullsized":"2024-09-05T17:31:39.505589+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:56:00.807964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"59'232","reported_seq":1671,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.501652+0000","last_change":"2024-09-05T17:30:45.601218+0000","last_active":"2024-09-05T17:31:39.501652+0000","last_peered":"2024-09-05T17:31:39.501652+0000","last_clean":"2024-09-05T17:31:39.501652+0000","last_became_active":"2024-09-05T17:30:43.584933+0000","last_became_peered":"2024-09-05T17:30:43.584933+0000","last_unstale":"2024-09-05T17:31:39.501652+0000","last_undegraded":"2024-09-05T17:31:39.501652+0000","last_fullsized":"2024-09-05T17:31:39.501652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:24:52.825889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097333599999999999,"stat_sum":{"num_bytes":66713390,"num_objects":35,"num_object_clones":13,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":12,"num_read":1490,"num_read_kb":9281,"num_write":256,"num_write_kb":8919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"62'396","reported_seq":3207,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.559746+0000","last_change":"2024-09-05T17:30:45.577452+0000","last_active":"2024-09-05T17:31:39.559746+0000","last_peered":"2024-09-05T17:31:39.559746+0000","last_clean":"2024-09-05T17:31:39.559746+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:31:39.559746+0000","last_undegraded":"2024-09-05T17:31:39.559746+0000","last_fullsized":"2024-09-05T17:31:39.559746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:46:12.644987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00119338,"stat_sum":{"num_bytes":9531514,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":6,"num_read":4537,"num_read_kb":8742,"num_write":578,"num_write_kb":1650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"62'271","reported_seq":1138,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.503245+0000","last_change":"2024-09-05T17:30:45.806921+0000","last_active":"2024-09-05T17:31:39.503245+0000","last_peered":"2024-09-05T17:31:39.503245+0000","last_clean":"2024-09-05T17:31:39.503245+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:31:39.503245+0000","last_undegraded":"2024-09-05T17:31:39.503245+0000","last_fullsized":"2024-09-05T17:31:39.503245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:36:40.063660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092165900000000002,"stat_sum":{"num_bytes":5521525,"num_objects":24,"num_object_clones":7,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":6,"num_read":1112,"num_read_kb":2627,"num_write":314,"num_write_kb":2526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"59'763","reported_seq":4234,"reported_epoch":62,"state":"peering","last_fresh":"2024-09-05T17:31:38.912453+0000","last_change":"2024-09-05T17:31:39.502720+0000","last_active":"2024-09-05T17:31:39.502720+0000","last_peered":"2024-09-05T17:31:38.912453+0000","last_clean":"2024-09-05T17:31:36.261637+0000","last_became_active":"2024-09-05T17:31:38.534452+0000","last_became_peered":"2024-09-05T17:31:38.534452+0000","last_unstale":"2024-09-05T17:31:38.912453+0000","last_undegraded":"2024-09-05T17:31:38.912453+0000","last_fullsized":"2024-09-05T17:31:38.508790+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053415,"stat_sum":{"num_bytes":47042627,"num_objects":36,"num_object_clones":13,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":6863,"num_read_kb":13614,"num_write":1133,"num_write_kb":5118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":3050131,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"54'176","reported_seq":376,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.500653+0000","last_change":"2024-09-05T17:30:45.586557+0000","last_active":"2024-09-05T17:31:39.500653+0000","last_peered":"2024-09-05T17:31:39.500653+0000","last_clean":"2024-09-05T17:31:39.500653+0000","last_became_active":"2024-09-05T17:30:43.586452+0000","last_became_peered":"2024-09-05T17:30:43.586452+0000","last_unstale":"2024-09-05T17:31:39.500653+0000","last_undegraded":"2024-09-05T17:31:39.500653+0000","last_fullsized":"2024-09-05T17:31:39.500653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:30:31.640348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012305,"stat_sum":{"num_bytes":10268913,"num_objects":21,"num_object_clones":9,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":10,"num_read":122,"num_read_kb":2735,"num_write":166,"num_write_kb":1680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"62'203","reported_seq":455,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.508149+0000","last_change":"2024-09-05T17:30:46.333102+0000","last_active":"2024-09-05T17:31:39.508149+0000","last_peered":"2024-09-05T17:31:39.508149+0000","last_clean":"2024-09-05T17:31:39.508149+0000","last_became_active":"2024-09-05T17:30:43.600919+0000","last_became_peered":"2024-09-05T17:30:43.600919+0000","last_unstale":"2024-09-05T17:31:39.508149+0000","last_undegraded":"2024-09-05T17:31:39.508149+0000","last_fullsized":"2024-09-05T17:31:39.508149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:41:33.590729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002229342,"stat_sum":{"num_bytes":39594653,"num_objects":23,"num_object_clones":9,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":203,"num_read_kb":2117,"num_write":203,"num_write_kb":1798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"62'113","reported_seq":490,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.510921+0000","last_change":"2024-09-05T17:30:46.333307+0000","last_active":"2024-09-05T17:31:39.510921+0000","last_peered":"2024-09-05T17:31:39.510921+0000","last_clean":"2024-09-05T17:31:39.510921+0000","last_became_active":"2024-09-05T17:30:43.600952+0000","last_became_peered":"2024-09-05T17:30:43.600952+0000","last_unstale":"2024-09-05T17:31:39.510921+0000","last_undegraded":"2024-09-05T17:31:39.510921+0000","last_fullsized":"2024-09-05T17:31:39.510921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:35:06.123956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019952949999999998,"stat_sum":{"num_bytes":16788592,"num_objects":22,"num_object_clones":7,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":5,"num_read":310,"num_read_kb":9604,"num_write":121,"num_write_kb":12739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"62'217","reported_seq":2988,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.572034+0000","last_change":"2024-09-05T17:30:46.332586+0000","last_active":"2024-09-05T17:31:39.572034+0000","last_peered":"2024-09-05T17:31:39.572034+0000","last_clean":"2024-09-05T17:31:39.572034+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:31:39.572034+0000","last_undegraded":"2024-09-05T17:31:39.572034+0000","last_fullsized":"2024-09-05T17:31:39.572034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:25:42.853818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001698326,"stat_sum":{"num_bytes":15675265,"num_objects":32,"num_object_clones":12,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":9,"num_read":3132,"num_read_kb":4581,"num_write":211,"num_write_kb":3127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"59'389","reported_seq":3069,"reported_epoch":62,"state":"peering","last_fresh":"2024-09-05T17:31:38.639691+0000","last_change":"2024-09-05T17:31:39.504868+0000","last_active":"2024-09-05T17:31:39.504868+0000","last_peered":"2024-09-05T17:31:38.639691+0000","last_clean":"2024-09-05T17:31:36.538749+0000","last_became_active":"2024-09-05T17:31:38.521234+0000","last_became_peered":"2024-09-05T17:31:38.521234+0000","last_unstale":"2024-09-05T17:31:38.639691+0000","last_undegraded":"2024-09-05T17:31:38.639691+0000","last_fullsized":"2024-09-05T17:31:38.497253+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000919516,"stat_sum":{"num_bytes":27287863,"num_objects":26,"num_object_clones":10,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":8,"num_read":3415,"num_read_kb":7193,"num_write":532,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":956848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"62'177","reported_seq":534,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.506079+0000","last_change":"2024-09-05T17:30:46.332397+0000","last_active":"2024-09-05T17:31:39.506079+0000","last_peered":"2024-09-05T17:31:39.506079+0000","last_clean":"2024-09-05T17:31:39.506079+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:31:39.506079+0000","last_undegraded":"2024-09-05T17:31:39.506079+0000","last_fullsized":"2024-09-05T17:31:39.506079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:29:21.035173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015389449999999999,"stat_sum":{"num_bytes":14342815,"num_objects":22,"num_object_clones":6,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":5,"num_read":300,"num_read_kb":1765,"num_write":176,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"62'336","reported_seq":1724,"reported_epoch":63,"state":"peering","last_fresh":"2024-09-05T17:31:39.506839+0000","last_change":"2024-09-05T17:31:39.506839+0000","last_active":"2024-09-05T17:31:39.506839+0000","last_peered":"2024-09-05T17:31:38.713098+0000","last_clean":"2024-09-05T17:31:36.576030+0000","last_became_active":"2024-09-05T17:31:38.549313+0000","last_became_peered":"2024-09-05T17:31:38.549313+0000","last_unstale":"2024-09-05T17:31:39.506839+0000","last_undegraded":"2024-09-05T17:31:39.506839+0000","last_fullsized":"2024-09-05T17:31:39.506839+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164483,"stat_sum":{"num_bytes":47964389,"num_objects":40,"num_object_clones":17,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":15,"num_read":2363,"num_read_kb":6157,"num_write":330,"num_write_kb":5963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":2551062,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"62'204","reported_seq":894,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-05T17:31:39.506112+0000","last_change":"2024-09-05T17:30:46.331733+0000","last_active":"2024-09-05T17:31:39.506112+0000","last_peered":"2024-09-05T17:31:39.506112+0000","last_clean":"2024-09-05T17:31:39.506112+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:31:39.506112+0000","last_undegraded":"2024-09-05T17:31:39.506112+0000","last_fullsized":"2024-09-05T17:31:39.506112+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:33:02.287226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099853899999999989,"stat_sum":{"num_bytes":18244250,"num_objects":25,"num_object_clones":8,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":1587,"num_read_kb":3744,"num_write":193,"num_write_kb":1783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":649701525,"num_objects":809,"num_object_clones":287,"num_object_copies":1618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":809,"num_whiteouts":235,"num_read":76172,"num_read_kb":187571,"num_write":12764,"num_write_kb":112502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":676,"num_bytes_recovered":22049655,"num_keys_recovered":72,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20103168,"data_stored":180624892,"data_compressed":6136108,"data_compressed_allocated":13647872,"data_compressed_original":176588636,"omap_allocated":0,"internal_metadata":0},"log_size":9985,"ondisk_log_size":9985,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":17596,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42788,"kb_used_data":3272,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329052,"statfs":{"total":96636764160,"available":96592949248,"internally_reserved":0,"allocated":3350528,"data_stored":24463605,"data_compressed":732800,"data_compressed_allocated":1716224,"data_compressed_original":23560401,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36816,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335024,"statfs":{"total":96636764160,"available":96599064576,"internally_reserved":0,"allocated":1507328,"data_stored":7390553,"data_compressed":200565,"data_compressed_allocated":475136,"data_compressed_original":6881280,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52772,"kb_used_data":3516,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319068,"statfs":{"total":96636764160,"available":96582725632,"internally_reserved":0,"allocated":3600384,"data_stored":23316627,"data_compressed":1091206,"data_compressed_allocated":1974272,"data_compressed_original":22432942,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":4672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":4784128,"data_stored":41570538,"data_compressed":1157553,"data_compressed_allocated":2768896,"data_compressed_original":40425391,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53656,"kb_used_data":4416,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94318184,"statfs":{"total":96636764160,"available":96581820416,"internally_reserved":0,"allocated":4521984,"data_stored":31483249,"data_compressed":1257360,"data_compressed_allocated":2633728,"data_compressed_original":30430207,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36904,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334936,"statfs":{"total":96636764160,"available":96598974464,"internally_reserved":0,"allocated":1597440,"data_stored":5968268,"data_compressed":270092,"data_compressed_allocated":552960,"data_compressed_original":5455872,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42068,"kb_used_data":2564,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329772,"statfs":{"total":96636764160,"available":96593686528,"internally_reserved":0,"allocated":2625536,"data_stored":17495386,"data_compressed":501684,"data_compressed_allocated":1269760,"data_compressed_original":16811857,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":60129542162,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3162112,"data_stored":32212042,"data_compressed":895810,"data_compressed_allocated":2285568,"data_compressed_original":31635166,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1904640,"data_stored":17177059,"data_compressed":501684,"data_compressed_allocated":1269760,"data_compressed_original":16811857,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":880640,"data_stored":5649960,"data_compressed":270092,"data_compressed_allocated":552960,"data_compressed_original":5455872,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3805184,"data_stored":31164941,"data_compressed":1257360,"data_compressed_allocated":2633728,"data_compressed_original":30430207,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4055040,"data_stored":41245771,"data_compressed":1157553,"data_compressed_allocated":2768896,"data_compressed_original":40425391,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2887680,"data_stored":23003122,"data_compressed":1091206,"data_compressed_allocated":1974272,"data_compressed_original":22432942,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":749568,"data_stored":6481877,"data_compressed":194157,"data_compressed_allocated":438272,"data_compressed_original":6291456,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2658304,"data_stored":23690120,"data_compressed":768246,"data_compressed_allocated":1724416,"data_compressed_original":23105745,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:31:42.599 INFO:tasks.thrashosds.thrasher:Setting 3.f to [1, 4, 6, 2] 2024-09-05T17:31:42.599 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.f', '1', '4', '6', '2'] 2024-09-05T17:31:42.599 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.f 1 4 6 2 2024-09-05T17:31:42.632 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:42.629+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:42.700 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:42.701 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:42.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:42.701 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:42.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.701 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:8976 3.10 3:0f1f7ceb:::rbd_data.11403f2d9bbd.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-05T17:31:42.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:42.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.201139134000002, 2024-09-05T17:31:42.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043813337000000001, 2024-09-05T17:31:42.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:42.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 8976 2024-09-05T17:31:42.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:42.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:42.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498241+0000", 2024-09-05T17:31:42.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6529999999999998e-06 2024-09-05T17:31:42.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498253+0000", 2024-09-05T17:31:42.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1681999999999999e-05 2024-09-05T17:31:42.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498283+0000", 2024-09-05T17:31:42.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0097999999999999e-05 2024-09-05T17:31:42.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498299+0000", 2024-09-05T17:31:42.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5498999999999998e-05 2024-09-05T17:31:42.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498406+0000", 2024-09-05T17:31:42.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010711 2024-09-05T17:31:42.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:42.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498540+0000", 2024-09-05T17:31:42.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134461 2024-09-05T17:31:42.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:42.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.506438+0000", 2024-09-05T17:31:42.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078981060000000002 2024-09-05T17:31:42.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:42.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541694+0000", 2024-09-05T17:31:42.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.035255701 2024-09-05T17:31:42.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:42.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541815+0000", 2024-09-05T17:31:42.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-05T17:31:42.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:42.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541919+0000", 2024-09-05T17:31:42.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010451299999999999 2024-09-05T17:31:42.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.542052+0000", 2024-09-05T17:31:42.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132745 2024-09-05T17:31:42.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.715 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28575 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:42.715 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.022180003000003, 2024-09-05T17:31:42.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041664701999999998, 2024-09-05T17:31:42.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:42.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.717 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28575 2024-09-05T17:31:42.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.717 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677199+0000", 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0699999999999996e-07 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677203+0000", 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1869999999999999e-06 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677219+0000", 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5724999999999999e-05 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677230+0000", 2024-09-05T17:31:42.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1902999999999999e-05 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717588+0000", 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040357993000000002 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717758+0000", 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016953399999999999 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718863+0000", 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011046529999999999 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28576 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.022134452000003, 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042556272999999999, 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28576 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677245+0000", 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.494e-06 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677250+0000", 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.276e-06 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677280+0000", 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9451999999999999e-05 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677288+0000", 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5990000000000002e-06 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718928+0000", 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041639279000000001 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719099+0000", 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000171151 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719800+0000", 2024-09-05T17:31:42.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00070102200000000004 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28577 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 69632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.021748901000002, 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04307043, 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:42.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28577 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677631+0000", 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0760000000000001e-06 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677640+0000", 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1560000000000001e-06 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677666+0000", 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6156000000000002e-05 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677686+0000", 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9321999999999999e-05 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719867+0000", 2024-09-05T17:31:42.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042181070000000001 2024-09-05T17:31:42.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:42.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720043+0000", 2024-09-05T17:31:42.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176496 2024-09-05T17:31:42.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720699+0000", 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065615400000000005 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28578 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.731 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.021663175999997, 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043977430999999997, 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28578 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677716+0000", 2024-09-05T17:31:42.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.533e-06 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677723+0000", 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.613e-06 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677742+0000", 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8629000000000001e-05 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677756+0000", 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4566000000000001e-05 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720766+0000", 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043009798000000002 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721003+0000", 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721692+0000", 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068963399999999995 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28579 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.021601349000001, 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044067576999999997, 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.736 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28579 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677778+0000", 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.043e-06 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677783+0000", 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-06 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677801+0000", 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7825999999999998e-05 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677815+0000", 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3532e-05 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721827+0000", 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044012451000000001 2024-09-05T17:31:42.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721844+0000", 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7144999999999999e-05 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28580 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.021542109000002, 2024-09-05T17:31:42.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044087135, 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28580 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677837+0000", 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2130000000000001e-06 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677843+0000", 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1e-06 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677862+0000", 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8719000000000002e-05 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677876+0000", 2024-09-05T17:31:42.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4079e-05 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721907+0000", 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044030712999999999 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721923+0000", 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6311e-05 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28581 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:42.745 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.021477625000003, 2024-09-05T17:31:42.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044089852999999998, 2024-09-05T17:31:42.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.745 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28581 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677902+0000", 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.28e-06 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677907+0000", 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6019999999999999e-06 2024-09-05T17:31:42.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677926+0000", 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8346e-05 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677939+0000", 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3796e-05 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721974+0000", 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044035004000000003 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721990+0000", 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5824999999999998e-05 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28662 3.a 3.10099d2a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.019480786000003, 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042160502000000002, 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28662 2024-09-05T17:31:42.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679900+0000", 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.407e-06 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679912+0000", 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.219e-05 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679937+0000", 2024-09-05T17:31:42.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5525e-05 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679958+0000", 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0268e-05 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722042+0000", 2024-09-05T17:31:42.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042084253000000002 2024-09-05T17:31:42.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722058+0000", 2024-09-05T17:31:42.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5858999999999998e-05 2024-09-05T17:31:42.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28700 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.017350059000002, 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040505403000000002, 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28700 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682029+0000", 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682035+0000", 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5999999999999997e-06 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682052+0000", 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6833e-05 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682064+0000", 2024-09-05T17:31:42.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2795e-05 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722517+0000", 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040453000000000003 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722533+0000", 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5798999999999999e-05 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28701 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.017297042000003, 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040534632000000001, 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28701 2024-09-05T17:31:42.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682082+0000", 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0729999999999999e-06 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682087+0000", 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8829999999999997e-06 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682103+0000", 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6049000000000002e-05 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682117+0000", 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3740000000000001e-05 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722583+0000", 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040466323999999998 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722616+0000", 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2563e-05 2024-09-05T17:31:42.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28702 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.017242598000003, 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040547896999999999, 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28702 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:42.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682137+0000", 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2899999999999999e-06 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682143+0000", 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0159999999999997e-06 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682160+0000", 2024-09-05T17:31:42.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7655999999999998e-05 2024-09-05T17:31:42.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682175+0000", 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4836e-05 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722665+0000", 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040490155999999999 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722683+0000", 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7943000000000001e-05 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28703 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.017184081000003, 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040556400999999999, 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28703 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:42.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682195+0000", 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682201+0000", 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5729999999999998e-06 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682218+0000", 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7915999999999999e-05 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682232+0000", 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3576e-05 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722734+0000", 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040502437000000002 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722750+0000", 2024-09-05T17:31:42.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5756e-05 2024-09-05T17:31:42.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.773 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28704 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.017126210999997, 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040560355999999999, 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.774 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28704 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682253+0000", 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.153e-06 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682258+0000", 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5629999999999999e-06 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682275+0000", 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6983e-05 2024-09-05T17:31:42.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682290+0000", 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4158999999999999e-05 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722798+0000", 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040508294 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722812+0000", 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4204e-05 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28705 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.017068344000002, 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040566735, 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28705 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682311+0000", 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.187e-06 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682316+0000", 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4929999999999998e-06 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682334+0000", 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7305000000000001e-05 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682347+0000", 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.328e-05 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722861+0000", 2024-09-05T17:31:42.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040513999000000002 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722876+0000", 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5471000000000001e-05 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28706 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.782 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.017012459999997, 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040580441000000002, 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28706 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682367+0000", 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682385+0000", 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8352e-05 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682403+0000", 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7940000000000001e-05 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682417+0000", 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4285e-05 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722930+0000", 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040512907000000001 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722946+0000", 2024-09-05T17:31:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5537e-05 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28707 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.016939424, 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040576270999999997, 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28707 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682440+0000", 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1200000000000001e-06 2024-09-05T17:31:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682445+0000", 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6899999999999997e-06 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682463+0000", 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7765999999999999e-05 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682477+0000", 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3465999999999999e-05 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722998+0000", 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040521807 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723015+0000", 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6422e-05 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28708 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.016879572999997, 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040582981999999997, 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28708 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682500+0000", 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.26e-06 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682505+0000", 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6489999999999996e-06 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682523+0000", 2024-09-05T17:31:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682535+0000", 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2313000000000001e-05 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723066+0000", 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040530432999999998 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723081+0000", 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5784999999999999e-05 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28709 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.016823156000001, 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040593911000000003, 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28709 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682556+0000", 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.19e-06 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682561+0000", 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4820000000000002e-06 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682579+0000", 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7430000000000001e-05 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682593+0000", 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799e-05 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723133+0000", 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040540208000000001 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723149+0000", 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5801999999999999e-05 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28710 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.016745380000003, 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040581488999999998, 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28710 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682634+0000", 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.483e-06 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682640+0000", 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.319e-06 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682659+0000", 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8266000000000001e-05 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682673+0000", 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.431e-05 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723198+0000", 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040525383999999998 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723214+0000", 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5727e-05 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:42.804 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:42.806 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:31:42.807 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:42.807 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:42.805+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:42.907 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:42.905+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:42.984 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:42.984 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:42.984 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:42.984 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:42.999 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:43.041 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:43.041+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:43.064 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-05T17:31:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.080 INFO:teuthology.orchestra.run.smithi050.stdout:3736 writesame 0x4290ef7 thru 0x429c6a8 data_size 0x7(0xb7b2 bytes) 2024-09-05T17:31:43.097 INFO:teuthology.orchestra.run.smithi050.stdout:3737 writesame 0x2643360 thru 0x2650ffe data_size 0x1(0xdc9f bytes) 2024-09-05T17:31:43.109 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:43.109+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:43.167 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:43.168 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:43.168 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:43.168 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:43.168 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:43.173 INFO:teuthology.orchestra.run.smithi050.stdout:3738 writesame 0xbb0575e thru 0xbb0c2c9 data_size 0x5(0x6b6c bytes) 2024-09-05T17:31:43.182 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:43.189 INFO:teuthology.orchestra.run.smithi050.stdout:3739 trunc from 0xbb0c2ca to 0x74f84fc 2024-09-05T17:31:43.218 INFO:teuthology.orchestra.run.smithi050.stdout:3740 write 0x7372272 thru 0x7379a8a (0x7819 bytes) 2024-09-05T17:31:43.221 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.229 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:43.229+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:43.236 INFO:teuthology.orchestra.run.smithi050.stdout:3742 trunc from 0x74f84fc to 0x4a6a0d 2024-09-05T17:31:43.279 INFO:teuthology.orchestra.run.smithi050.stdout:3743 read 0x28979c thru 0x294555 (0xadba bytes) 2024-09-05T17:31:43.310 INFO:teuthology.orchestra.run.smithi050.stdout:3744 write 0x7911bf1 thru 0x791bd53 (0xa163 bytes) 2024-09-05T17:31:43.311 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:43.313+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:3745 punch from 0x6a425dc to 0x6a43ac8, (0x14ec bytes) 2024-09-05T17:31:43.313 INFO:teuthology.orchestra.run.smithi050.stdout:3746 read 0x7669baf thru 0x7673945 (0x9d97 bytes) 2024-09-05T17:31:43.328 INFO:teuthology.orchestra.run.smithi050.stdout:3748 write 0x7b4a3ea thru 0x7b5543c (0xb053 bytes) 2024-09-05T17:31:43.335 INFO:teuthology.orchestra.run.smithi050.stdout:3750 writesame 0x47e4a06 thru 0x47e8c63 data_size 0x5(0x425e bytes) 2024-09-05T17:31:43.340 INFO:teuthology.orchestra.run.smithi050.stdout:3751 read 0x799da1b thru 0x79a5b0c (0x80f2 bytes) 2024-09-05T17:31:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:3752 read 0x74ec5f7 thru 0x74f8d8a (0xc794 bytes) 2024-09-05T17:31:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:3754 punch from 0x37bd146 to 0x37c3416, (0x62d0 bytes) 2024-09-05T17:31:43.341 INFO:teuthology.orchestra.run.smithi050.stdout:3755 write 0x20a1d1c thru 0x20a6646 (0x492b bytes) 2024-09-05T17:31:43.345 INFO:teuthology.orchestra.run.smithi050.stdout:3756 read 0x6ac0852 thru 0x6ac57b6 (0x4f65 bytes) 2024-09-05T17:31:43.346 INFO:teuthology.orchestra.run.smithi050.stdout:3757 writesame 0x215e569 thru 0x2161acb data_size 0x1(0x3563 bytes) 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 76.347975345999998, 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:31:43.366 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:31:43.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:31:43.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:31:43.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38987 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 253952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615546213000002, 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074851697999999994, 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38987 2024-09-05T17:31:43.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749281+0000", 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.023e-06 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749286+0000", 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999996e-06 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749308+0000", 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1141999999999998e-05 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749321+0000", 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3653e-05 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.823944+0000", 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074623192000000005 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824027+0000", 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.297e-05 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824132+0000", 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104548 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38988 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 268288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615488316, 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075009180999999994, 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.378 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38988 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749339+0000", 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0330000000000001e-06 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749344+0000", 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7230000000000004e-06 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749359+0000", 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5427e-05 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749385+0000", 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5469e-05 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824164+0000", 2024-09-05T17:31:43.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074779258000000001 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824251+0000", 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6620999999999996e-05 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824347+0000", 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6650000000000005e-05 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38989 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 282624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615420924999999, 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075156843000000001, 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38989 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749407+0000", 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749412+0000", 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8000000000000004e-06 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749430+0000", 2024-09-05T17:31:43.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7816e-05 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749444+0000", 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3919e-05 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824381+0000", 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074936661000000002 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824462+0000", 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1176999999999999e-05 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824562+0000", 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010029700000000001 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38990 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 296960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:43.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615363828, 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075320143000000006, 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38990 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:43.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749464+0000", 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1769999999999999e-06 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749480+0000", 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5886e-05 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749498+0000", 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8238999999999999e-05 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749512+0000", 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3876000000000001e-05 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824587+0000", 2024-09-05T17:31:43.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075075107000000002 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824657+0000", 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9859999999999999e-05 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824783+0000", 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125998 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.391 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38991 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615295394, 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075469580999999994, 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38991 2024-09-05T17:31:43.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749532+0000", 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749538+0000", 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4469999999999997e-06 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749555+0000", 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749569+0000", 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3397000000000001e-05 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824814+0000", 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075245765000000006 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824900+0000", 2024-09-05T17:31:43.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700999999999998e-05 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825001+0000", 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100556 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38992 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 325632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615240786000001, 2024-09-05T17:31:43.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075625943000000001, 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38992 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749587+0000", 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749591+0000", 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6970000000000001e-06 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749608+0000", 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6569e-05 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749621+0000", 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3457e-05 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825030+0000", 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075408915000000007 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825109+0000", 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825212+0000", 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102644 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38993 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615188218, 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075788663000000006, 2024-09-05T17:31:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38993 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749639+0000", 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749659+0000", 2024-09-05T17:31:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0092e-05 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749678+0000", 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8450000000000001e-05 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749693+0000", 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4583000000000001e-05 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825241+0000", 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075548134000000003 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825323+0000", 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2410000000000005e-05 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825427+0000", 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103831 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38994 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 354304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615114824999999, 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075917854000000007, 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38994 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749713+0000", 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.097e-06 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749718+0000", 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3569999999999997e-06 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749735+0000", 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6969e-05 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749748+0000", 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825456+0000", 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075707846999999995 2024-09-05T17:31:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825532+0000", 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5480000000000002e-05 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825629+0000", 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7785e-05 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38995 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 368640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.615061279999999, 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076074345000000002, 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38995 2024-09-05T17:31:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749766+0000", 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0470000000000001e-06 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749771+0000", 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8720000000000001e-06 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749788+0000", 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6762999999999999e-05 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749819+0000", 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1056000000000002e-05 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825659+0000", 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075840487999999998 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825738+0000", 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8862000000000005e-05 2024-09-05T17:31:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825839+0000", 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101257 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38996 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 382976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614989373, 2024-09-05T17:31:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076198058999999999, 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38996 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749838+0000", 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8700000000000004e-07 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749843+0000", 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.339e-06 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749860+0000", 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7059999999999999e-05 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749874+0000", 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3769e-05 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825869+0000", 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075995094999999999 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825945+0000", 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5661000000000006e-05 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826035+0000", 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0148000000000005e-05 2024-09-05T17:31:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38997 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614935461999998, 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076361818999999997, 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38997 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749892+0000", 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0130000000000001e-06 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749897+0000", 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6859999999999997e-06 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749913+0000", 2024-09-05T17:31:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6637e-05 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749927+0000", 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3396e-05 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826068+0000", 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076140883000000006 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826148+0000", 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0698000000000006e-05 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826253+0000", 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010450600000000001 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38998 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 411648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614882921, 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076522440999999997, 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38998 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749945+0000", 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9999999999999995e-07 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749949+0000", 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6500000000000004e-06 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749966+0000", 2024-09-05T17:31:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6756e-05 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749980+0000", 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3746e-05 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826284+0000", 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076304300000000005 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826364+0000", 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689000000000002e-05 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826466+0000", 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010230000000000001 2024-09-05T17:31:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38999 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 425984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614828447000001, 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076686775999999998, 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38999 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749999+0000", 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.054e-06 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750004+0000", 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8459999999999999e-06 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750025+0000", 2024-09-05T17:31:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750039+0000", 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4141999999999999e-05 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826498+0000", 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076458700000000004 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826584+0000", 2024-09-05T17:31:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6123000000000002e-05 2024-09-05T17:31:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826685+0000", 2024-09-05T17:31:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010075499999999999 2024-09-05T17:31:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39000 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 440320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614769366000001, 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076822304999999994, 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39000 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750058+0000", 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1739999999999999e-06 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750076+0000", 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7309e-05 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750097+0000", 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1345999999999999e-05 2024-09-05T17:31:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750111+0000", 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4205e-05 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826715+0000", 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076604277999999998 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826792+0000", 2024-09-05T17:31:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6561000000000001e-05 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826879+0000", 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7431999999999999e-05 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39001 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614697405000001, 2024-09-05T17:31:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076972354000000007, 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39001 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750130+0000", 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1459999999999999e-06 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750135+0000", 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8169999999999998e-06 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750155+0000", 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0409000000000001e-05 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750169+0000", 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3786e-05 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826909+0000", 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076740082000000001 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827000+0000", 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0956000000000001e-05 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827101+0000", 2024-09-05T17:31:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101158 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39002 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614630344999998, 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077117667000000001, 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39002 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750197+0000", 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1599999999999999e-06 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750203+0000", 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6699999999999999e-06 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750228+0000", 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5131999999999999e-05 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750243+0000", 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4610000000000001e-05 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827135+0000", 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076891994000000005 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827217+0000", 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2766e-05 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827314+0000", 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6335000000000005e-05 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39003 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614564388000002, 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077268069999999994, 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39003 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750263+0000", 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750269+0000", 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.48e-06 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750294+0000", 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4981999999999999e-05 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750308+0000", 2024-09-05T17:31:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4266e-05 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827344+0000", 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077036358999999999 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827428+0000", 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3332999999999996e-05 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827530+0000", 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102396 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39004 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 497664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.614499634000001, 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077374380000000006, 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39004 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750328+0000", 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750346+0000", 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7929999999999999e-05 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750367+0000", 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750391+0000", 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4009e-05 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827549+0000", 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077158103000000006 2024-09-05T17:31:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827618+0000", 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8660999999999999e-05 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827701+0000", 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3341e-05 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39005 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.61441108, 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077409180999999994, 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39005 2024-09-05T17:31:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750416+0000", 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750422+0000", 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4029999999999998e-06 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750442+0000", 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0162000000000001e-05 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750456+0000", 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3699999999999999e-05 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827719+0000", 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077263407000000006 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827767+0000", 2024-09-05T17:31:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8174999999999999e-05 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827825+0000", 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7191000000000002e-05 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:43.462 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:43.464 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:43.461+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:43.465 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:43.466 INFO:teuthology.orchestra.run.smithi050.stdout:3758 write 0xcf6603c thru 0xcf66b8f (0xb54 bytes) 2024-09-05T17:31:43.466 INFO:teuthology.orchestra.run.smithi050.stdout:3760 read 0xc9fb392 thru 0xca03cb9 (0x8928 bytes) 2024-09-05T17:31:43.466 INFO:teuthology.orchestra.run.smithi050.stdout:3761 read 0x285cb9 thru 0x286d70 (0x10b8 bytes) 2024-09-05T17:31:43.466 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.466 INFO:teuthology.orchestra.run.smithi050.stdout:3763 write 0xe280b8 thru 0xe3038b (0x82d4 bytes) 2024-09-05T17:31:43.466 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.466 INFO:teuthology.orchestra.run.smithi050.stdout:3766 write 0x71ffcef thru 0x72018d2 (0x1be4 bytes) 2024-09-05T17:31:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:3767 punch from 0x12fde6a to 0x13069a8, (0x8b3e bytes) 2024-09-05T17:31:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:3768 writesame 0x88c5912 thru 0x88d2b8f data_size 0x15(0xd27e bytes) 2024-09-05T17:31:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:3770 read 0x7afd1f3 thru 0x7aff90d (0x271b bytes) 2024-09-05T17:31:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:3772 write 0xc3ec85a thru 0xc3f8ff8 (0xc79f bytes) 2024-09-05T17:31:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:3773 punch from 0x713af3f to 0x713f157, (0x4218 bytes) 2024-09-05T17:31:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:3774 punch from 0xce84ec0 to 0xce88f82, (0x40c2 bytes) 2024-09-05T17:31:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:3776 trunc from 0xcf66b90 to 0xdcd58d0 2024-09-05T17:31:43.467 INFO:teuthology.orchestra.run.smithi050.stdout:3777 trunc from 0xdcd58d0 to 0x3cbd177 2024-09-05T17:31:43.482 INFO:teuthology.orchestra.run.smithi050.stdout:3780 punch from 0x378accc to 0x378b0e2, (0x416 bytes) 2024-09-05T17:31:43.513 INFO:teuthology.orchestra.run.smithi050.stdout:3782 writesame 0xe14d024 thru 0xe154f53 data_size 0x94(0x7f30 bytes) 2024-09-05T17:31:43.516 INFO:teuthology.orchestra.run.smithi050.stdout:3783 writesame 0x73d0eee thru 0x73df40e data_size 0x1(0xe521 bytes) 2024-09-05T17:31:43.565 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:43.565+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:43.588 INFO:teuthology.orchestra.run.smithi050.stdout:3784 punch from 0x68ebc20 to 0x68f98d5, (0xdcb5 bytes) 2024-09-05T17:31:43.589 INFO:teuthology.orchestra.run.smithi050.stdout:3785 punch from 0x38e1e91 to 0x38ed84a, (0xb9b9 bytes) 2024-09-05T17:31:43.589 INFO:teuthology.orchestra.run.smithi050.stdout:3787 read 0x3e6a0da thru 0x3e7015f (0x6086 bytes) 2024-09-05T17:31:43.603 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:43.603 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:43.603 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:43.603 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:43.613 INFO:teuthology.orchestra.run.smithi050.stdout:3788 trunc from 0xe154f54 to 0x17838e7 2024-09-05T17:31:43.625 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:43.633 INFO:teuthology.orchestra.run.smithi050.stdout:3791 trunc from 0x17838e7 to 0x3f34da2 2024-09-05T17:31:43.642 INFO:teuthology.orchestra.run.smithi050.stdout:3792 read 0x282f34f thru 0x2837a90 (0x8742 bytes) 2024-09-05T17:31:43.643 INFO:teuthology.orchestra.run.smithi050.stdout:3794 punch from 0x6464bf to 0x6476d8, (0x1219 bytes) 2024-09-05T17:31:43.643 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.643 INFO:teuthology.orchestra.run.smithi050.stdout:3796 punch from 0x15c9d1b to 0x15ccd95, (0x307a bytes) 2024-09-05T17:31:43.643 INFO:teuthology.orchestra.run.smithi050.stdout:3798 read 0x343c7e4 thru 0x3444ac0 (0x82dd bytes) 2024-09-05T17:31:43.647 INFO:teuthology.orchestra.run.smithi050.stdout:3799 trunc from 0x3f34da2 to 0x1b15660 2024-09-05T17:31:43.659 INFO:teuthology.orchestra.run.smithi050.stdout:3800 read 0x5144d4 thru 0x5193b3 (0x4ee0 bytes) 2024-09-05T17:31:43.659 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.666 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:43.665+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:43.683 INFO:teuthology.orchestra.run.smithi050.stdout:3802 write 0xbb91277 thru 0xbb9bc47 (0xa9d1 bytes) 2024-09-05T17:31:43.688 INFO:teuthology.orchestra.run.smithi050.stdout:3803 writesame 0x9797425 thru 0x97a5fa2 data_size 0x2b(0xeb7e bytes) 2024-09-05T17:31:43.695 INFO:teuthology.orchestra.run.smithi050.stdout:3804 punch from 0x1a57a8c to 0x1a59b42, (0x20b6 bytes) 2024-09-05T17:31:43.695 INFO:teuthology.orchestra.run.smithi050.stdout:3811 read 0x99b5c6e thru 0x99c1b58 (0xbeeb bytes) 2024-09-05T17:31:43.696 INFO:teuthology.orchestra.run.smithi050.stdout:3812 read 0x4a61698 thru 0x4a6accd (0x9636 bytes) 2024-09-05T17:31:43.714 INFO:teuthology.orchestra.run.smithi050.stdout:3813 trunc from 0xbb9bc48 to 0xc9ac5e 2024-09-05T17:31:43.732 INFO:teuthology.orchestra.run.smithi050.stdout:3815 read 0xc5e611 thru 0xc66789 (0x8179 bytes) 2024-09-05T17:31:43.751 INFO:teuthology.orchestra.run.smithi050.stdout:3820 write 0x4fdfbbb thru 0x4feb2c9 (0xb70f bytes) 2024-09-05T17:31:43.754 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.754 INFO:teuthology.orchestra.run.smithi050.stdout:3823 write 0x1df5676 thru 0x1dfec8c (0x9617 bytes) 2024-09-05T17:31:43.767 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:43.765+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:43.769 INFO:teuthology.orchestra.run.smithi050.stdout:3824 trunc from 0x4feb2ca to 0x9e27f6d 2024-09-05T17:31:43.770 INFO:teuthology.orchestra.run.smithi050.stderr:set 3.f pg_upmap_items mapping to [1->4,6->2] 2024-09-05T17:31:43.779 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:43.779 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:43.779 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:43.779 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:43.779 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:43.782 INFO:teuthology.orchestra.run.smithi050.stdout:3825 read 0x47f2937 thru 0x47f65aa (0x3c74 bytes) 2024-09-05T17:31:43.786 INFO:teuthology.orchestra.run.smithi050.stdout:3826 read 0x760913 thru 0x76406e (0x375c bytes) 2024-09-05T17:31:43.786 INFO:teuthology.orchestra.run.smithi050.stdout:3828 write 0x781146a thru 0x78125fa (0x1191 bytes) 2024-09-05T17:31:43.798 INFO:teuthology.orchestra.run.smithi050.stdout:3829 trunc from 0x9e27f6d to 0x469357c 2024-09-05T17:31:43.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:43.817 INFO:teuthology.orchestra.run.smithi050.stdout:3831 punch from 0x33affb9 to 0x33b5db3, (0x5dfa bytes) 2024-09-05T17:31:43.817 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.817 INFO:teuthology.orchestra.run.smithi050.stdout:3834 read 0x43d0fdc thru 0x43d5d24 (0x4d49 bytes) 2024-09-05T17:31:43.818 INFO:teuthology.orchestra.run.smithi050.stdout:3835 punch from 0x24b0bd0 to 0x24b3936, (0x2d66 bytes) 2024-09-05T17:31:43.818 INFO:teuthology.orchestra.run.smithi050.stdout:3836 punch from 0x37b47c5 to 0x37c02dd, (0xbb18 bytes) 2024-09-05T17:31:43.818 INFO:teuthology.orchestra.run.smithi050.stdout:3838 trunc from 0x469357c to 0x481c812 2024-09-05T17:31:43.826 INFO:teuthology.orchestra.run.smithi050.stdout:3839 read 0xa886a0 thru 0xa90861 (0x81c2 bytes) 2024-09-05T17:31:43.827 INFO:teuthology.orchestra.run.smithi050.stdout:3840 read 0x1f0cfc9 thru 0x1f0e3d1 (0x1409 bytes) 2024-09-05T17:31:43.846 INFO:teuthology.orchestra.run.smithi050.stdout:3841 writesame 0xa6dcfde thru 0xa6e494a data_size 0x1(0x796d bytes) 2024-09-05T17:31:43.849 INFO:teuthology.orchestra.run.smithi050.stdout:3842 read 0x12d069b thru 0x12da9cf (0xa335 bytes) 2024-09-05T17:31:43.849 INFO:teuthology.orchestra.run.smithi050.stdout:3843 writesame 0x502cb50 thru 0x5037913 data_size 0x42(0xadc4 bytes) 2024-09-05T17:31:43.853 INFO:teuthology.orchestra.run.smithi050.stdout:3845 write 0x1ce473 thru 0x1ce583 (0x111 bytes) 2024-09-05T17:31:43.867 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:43.869+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:43.868 INFO:teuthology.orchestra.run.smithi050.stdout:3846 write 0xc97b89e thru 0xc97efe2 (0x3745 bytes) 2024-09-05T17:31:43.870 INFO:teuthology.orchestra.run.smithi050.stdout:3848 read 0x4d4b5f3 thru 0x4d58925 (0xd333 bytes) 2024-09-05T17:31:43.871 INFO:teuthology.orchestra.run.smithi050.stdout:3849 read 0x6a1f73f thru 0x6a2c9a5 (0xd267 bytes) 2024-09-05T17:31:43.872 INFO:teuthology.orchestra.run.smithi050.stdout:3850 punch from 0x6cd4614 to 0x6cda893, (0x627f bytes) 2024-09-05T17:31:43.872 INFO:teuthology.orchestra.run.smithi050.stdout:3851 punch from 0x1c2dc7f to 0x1c38cac, (0xb02d bytes) 2024-09-05T17:31:43.872 INFO:teuthology.orchestra.run.smithi050.stdout:3852 writesame 0xa12f32e thru 0xa13c4c4 data_size 0x69(0xd197 bytes) 2024-09-05T17:31:43.895 INFO:teuthology.orchestra.run.smithi050.stdout:3854 trunc from 0xc97efe3 to 0x97cfc9 2024-09-05T17:31:43.927 INFO:teuthology.orchestra.run.smithi050.stdout:3856 read 0x809a7b thru 0x81013c (0x66c2 bytes) 2024-09-05T17:31:43.927 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866359940999999, 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:31:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:31:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866331525, 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:31:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866309598999997, 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:31:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:31:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:31:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:31:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:31:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:31:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:31:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866288152000003, 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866249861999997, 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866235046, 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:31:43.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866223847000001, 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:43.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866213008000003, 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:31:43.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866202530999999, 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:31:43.986 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:31:43.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.990 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866191708999999, 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:31:43.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:43.995 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866181308999998, 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:43.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:31:43.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:31:43.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.866162957, 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:44.000 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:31:44.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.865979332999999, 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:31:44.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:31:44.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:31:44.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.857320039000001, 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:31:44.009 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:31:44.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:31:44.013 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.857279497999997, 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.014 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.018 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.857239669000002, 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:31:44.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:31:44.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.023 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.857212193999999, 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:31:44.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:44.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:31:44.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.029 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.857173684999999, 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:31:44.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:31:44.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.857130945000002, 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.034 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:31:44.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:44.038 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.4558527310000002, 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:44.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:44.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:31:44.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:31:44.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.046 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:44.046 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:44.046 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:44.046 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:44.047 INFO:teuthology.orchestra.run.smithi050.stdout:3858 write 0x6ff3df5 thru 0x6ffc901 (0x8b0d bytes) 2024-09-05T17:31:44.047 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:44.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:44.049 INFO:teuthology.orchestra.run.smithi050.stdout:3860 writesame 0xe8d488f thru 0xe8d65d5 data_size 0x1(0x1d47 bytes) 2024-09-05T17:31:44.049 INFO:teuthology.orchestra.run.smithi050.stdout:3862 writesame 0x1f243b6 thru 0x1f2a5fc data_size 0x1(0x6247 bytes) 2024-09-05T17:31:44.049 INFO:teuthology.orchestra.run.smithi050.stdout:3863 read 0x9d9db54 thru 0x9da98ac (0xbd59 bytes) 2024-09-05T17:31:44.049 INFO:teuthology.orchestra.run.smithi050.stdout:3864 clone 22 order 20 su 524288 sc 6 2024-09-05T17:31:44.050 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:44.045+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:44.149 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:44.149+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:44.230 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:44.230 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:44.230 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:44.242 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:44.243 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:44.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:44.260 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:44.261 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:44.261 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:44.261+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:44.277 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:44.278 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:44.296 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:44.296 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:44.317 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:44.317 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:44.339 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:44.340 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:44.349 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:44.349+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:44.361 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:44.361 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:44.377 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:44.377 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:44.381 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:44.381 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:44.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:44.451 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:44.449+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:44.552 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:44.553+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:44.563 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:44.563 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:44.577 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:44.664 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:44.665+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:44.747 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:44.747 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:44.754 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:44.753+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:44.762 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:44.808 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:31:44.891 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:44.893+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:44.897 INFO:teuthology.orchestra.run.smithi050.stdout:leaving image image_client.0-clone21 intact 2024-09-05T17:31:44.938 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:44.939 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:44.954 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:44.953+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:44.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:45.055 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:45.053+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:45.121 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-05T17:31:45.124 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:45.124 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:45.142 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:45.156 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:45.153+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:45.257 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:45.257+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:45.265 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:45.265 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:45.281 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:45.352 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.352 INFO:teuthology.orchestra.run.smithi050.stdout:3869 write 0x2f8fa76 thru 0x2f91e84 (0x240f bytes) 2024-09-05T17:31:45.358 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:45.357+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:45.367 INFO:teuthology.orchestra.run.smithi050.stdout:3870 writesame 0x60d1dc5 thru 0x60d2b87 data_size 0x1(0xdc3 bytes) 2024-09-05T17:31:45.375 INFO:teuthology.orchestra.run.smithi050.stdout:3872 read 0xe33a0dd thru 0xe341a62 (0x7986 bytes) 2024-09-05T17:31:45.376 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.376 INFO:teuthology.orchestra.run.smithi050.stdout:3874 read 0xd16d6d9 thru 0xd173c5a (0x6582 bytes) 2024-09-05T17:31:45.376 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.383 INFO:teuthology.orchestra.run.smithi050.stdout:3876 trunc from 0xe8d65d6 to 0xa13dffc 2024-09-05T17:31:45.404 INFO:teuthology.orchestra.run.smithi050.stdout:3878 trunc from 0xa13dffc to 0x9fc4e8d 2024-09-05T17:31:45.407 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:45.407 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:45.424 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:45.441 INFO:teuthology.orchestra.run.smithi050.stdout:3879 writesame 0xc5846f4 thru 0xc58641e data_size 0x3(0x1d2b bytes) 2024-09-05T17:31:45.446 INFO:teuthology.orchestra.run.smithi050.stdout:3881 trunc from 0xc58641f to 0x98332d3 2024-09-05T17:31:45.460 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:45.457+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:45.485 INFO:teuthology.orchestra.run.smithi050.stdout:3882 punch from 0xdd909a to 0xde8a3d, (0xf9a3 bytes) 2024-09-05T17:31:45.485 INFO:teuthology.orchestra.run.smithi050.stdout:3883 write 0x2a80123 thru 0x2a86a99 (0x6977 bytes) 2024-09-05T17:31:45.493 INFO:teuthology.orchestra.run.smithi050.stdout:3884 punch from 0x7de3265 to 0x7de727e, (0x4019 bytes) 2024-09-05T17:31:45.505 INFO:teuthology.orchestra.run.smithi050.stdout:3886 write 0xae26f17 thru 0xae2712f (0x219 bytes) 2024-09-05T17:31:45.512 INFO:teuthology.orchestra.run.smithi050.stdout:3887 punch from 0x8896493 to 0x88a1ce0, (0xb84d bytes) 2024-09-05T17:31:45.524 INFO:teuthology.orchestra.run.smithi050.stdout:3889 write 0xc78dcf9 thru 0xc7964b4 (0x87bc bytes) 2024-09-05T17:31:45.531 INFO:teuthology.orchestra.run.smithi050.stdout:3890 read 0x16893e6 thru 0x168e753 (0x536e bytes) 2024-09-05T17:31:45.532 INFO:teuthology.orchestra.run.smithi050.stdout:3893 read 0x4c9ec6a thru 0x4ca69d7 (0x7d6e bytes) 2024-09-05T17:31:45.532 INFO:teuthology.orchestra.run.smithi050.stdout:3894 read 0x9fd1721 thru 0x9fd884e (0x712e bytes) 2024-09-05T17:31:45.544 INFO:teuthology.orchestra.run.smithi050.stdout:3896 write 0xd6a2b87 thru 0xd6b1075 (0xe4ef bytes) 2024-09-05T17:31:45.552 INFO:teuthology.orchestra.run.smithi050.stdout:3897 read 0x27c67f2 thru 0x27d1aa1 (0xb2b0 bytes) 2024-09-05T17:31:45.553 INFO:teuthology.orchestra.run.smithi050.stdout:3898 write 0x27a1fb2 thru 0x27b11fd (0xf24c bytes) 2024-09-05T17:31:45.561 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:45.561+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:45.578 INFO:teuthology.orchestra.run.smithi050.stdout:3899 trunc from 0xd6b1076 to 0x649baf4 2024-09-05T17:31:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:45.579 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:45.595 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:45.614 INFO:teuthology.orchestra.run.smithi050.stdout:3900 read 0x12ff747 thru 0x1309bfa (0xa4b4 bytes) 2024-09-05T17:31:45.615 INFO:teuthology.orchestra.run.smithi050.stdout:3901 punch from 0x5edd079 to 0x5ee1d21, (0x4ca8 bytes) 2024-09-05T17:31:45.615 INFO:teuthology.orchestra.run.smithi050.stdout:3902 punch from 0x18c044f to 0x18c7b95, (0x7746 bytes) 2024-09-05T17:31:45.615 INFO:teuthology.orchestra.run.smithi050.stdout:3903 writesame 0x3576d07 thru 0x3580ea8 data_size 0x11(0xa1a2 bytes) 2024-09-05T17:31:45.622 INFO:teuthology.orchestra.run.smithi050.stdout:3905 read 0x5e8d934 thru 0x5e92e1a (0x54e7 bytes) 2024-09-05T17:31:45.640 INFO:teuthology.orchestra.run.smithi050.stdout:3906 write 0xa5d7782 thru 0xa5daab2 (0x3331 bytes) 2024-09-05T17:31:45.645 INFO:teuthology.orchestra.run.smithi050.stdout:3907 writesame 0x74a84af thru 0x74b758a data_size 0xa(0xf0dc bytes) 2024-09-05T17:31:45.659 INFO:teuthology.orchestra.run.smithi050.stdout:3909 trunc from 0xa5daab3 to 0x765a9b4 2024-09-05T17:31:45.661 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:45.661+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:45.680 INFO:teuthology.orchestra.run.smithi050.stdout:3910 punch from 0x27c7565 to 0x27cbcbf, (0x475a bytes) 2024-09-05T17:31:45.688 INFO:teuthology.orchestra.run.smithi050.stdout:3911 trunc from 0x765a9b4 to 0xa9866ef 2024-09-05T17:31:45.723 INFO:teuthology.orchestra.run.smithi050.stdout:3912 write 0xd6906b9 thru 0xd699d98 (0x96e0 bytes) 2024-09-05T17:31:45.729 INFO:teuthology.orchestra.run.smithi050.stdout:3914 writesame 0x65f7fd2 thru 0x66066af data_size 0x1d(0xe6de bytes) 2024-09-05T17:31:45.733 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:45.733 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:45.740 INFO:teuthology.orchestra.run.smithi050.stdout:3915 writesame 0xa41d4e0 thru 0xa42235c data_size 0x1(0x4e7d bytes) 2024-09-05T17:31:45.749 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:45.762 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:45.761+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:45.784 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:31:45.792 INFO:teuthology.orchestra.run.smithi050.stdout:3916 trunc from 0xd699d99 to 0x5abe21b 2024-09-05T17:31:45.815 INFO:teuthology.orchestra.run.smithi050.stdout:3917 write 0x14478dc thru 0x1452496 (0xabbb bytes) 2024-09-05T17:31:45.829 INFO:teuthology.orchestra.run.smithi050.stdout:3918 writesame 0x6eab0f6 thru 0x6eb8aa1 data_size 0x2(0xd9ac bytes) 2024-09-05T17:31:45.829 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.829 INFO:teuthology.orchestra.run.smithi050.stdout:3920 writesame 0x6d586dc thru 0x6d62bc9 data_size 0x5d(0xa4ee bytes) 2024-09-05T17:31:45.834 INFO:teuthology.orchestra.run.smithi050.stdout:3921 punch from 0x5a04a74 to 0x5a0b0b1, (0x663d bytes) 2024-09-05T17:31:45.834 INFO:teuthology.orchestra.run.smithi050.stdout:3923 punch from 0x249f513 to 0x24a92be, (0x9dab bytes) 2024-09-05T17:31:45.834 INFO:teuthology.orchestra.run.smithi050.stdout:3924 punch from 0x549aed4 to 0x54a1b2b, (0x6c57 bytes) 2024-09-05T17:31:45.834 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.834 INFO:teuthology.orchestra.run.smithi050.stdout:3927 write 0x270e09d thru 0x2710e28 (0x2d8c bytes) 2024-09-05T17:31:45.838 INFO:teuthology.orchestra.run.smithi050.stdout:3928 read 0x92802f thru 0x930451 (0x8423 bytes) 2024-09-05T17:31:45.839 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.839 INFO:teuthology.orchestra.run.smithi050.stdout:3931 read 0x23b939 thru 0x247379 (0xba41 bytes) 2024-09-05T17:31:45.840 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.840 INFO:teuthology.orchestra.run.smithi050.stdout:3934 write 0x10a3520 thru 0x10aaf84 (0x7a65 bytes) 2024-09-05T17:31:45.846 INFO:teuthology.orchestra.run.smithi050.stdout:3935 read 0x6bc5bfc thru 0x6bcb065 (0x546a bytes) 2024-09-05T17:31:45.846 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.846 INFO:teuthology.orchestra.run.smithi050.stdout:3938 read 0x9b0bbc thru 0x9b8d75 (0x81ba bytes) 2024-09-05T17:31:45.847 INFO:teuthology.orchestra.run.smithi050.stdout:3939 write 0x42ea260 thru 0x42f9e38 (0xfbd9 bytes) 2024-09-05T17:31:45.852 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.852 INFO:teuthology.orchestra.run.smithi050.stdout:3942 read 0x63df3af thru 0x63ee53e (0xf190 bytes) 2024-09-05T17:31:45.852 INFO:teuthology.orchestra.run.smithi050.stdout:3944 read 0x3a33ca4 thru 0x3a3ea14 (0xad71 bytes) 2024-09-05T17:31:45.853 INFO:teuthology.orchestra.run.smithi050.stdout:3945 read 0x2c8df69 thru 0x2c9df57 (0xffef bytes) 2024-09-05T17:31:45.855 INFO:teuthology.orchestra.run.smithi050.stdout:3946 trunc from 0x6eb8aa2 to 0x6a4b2b3 2024-09-05T17:31:45.863 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:45.861+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:45.879 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:45.879 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:45.892 INFO:teuthology.orchestra.run.smithi050.stdout:3947 writesame 0xade5f8c thru 0xadf16b8 data_size 0x57(0xb72d bytes) 2024-09-05T17:31:45.892 INFO:teuthology.orchestra.run.smithi050.stdout:3949 read 0x700f6aa thru 0x7012b33 (0x348a bytes) 2024-09-05T17:31:45.893 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:45.901 INFO:teuthology.orchestra.run.smithi050.stdout:3950 writesame 0xaede9db thru 0xaee4778 data_size 0x1(0x5d9e bytes) 2024-09-05T17:31:45.901 INFO:teuthology.orchestra.run.smithi050.stdout:3951 punch from 0x130ead1 to 0x131be42, (0xd371 bytes) 2024-09-05T17:31:45.901 INFO:teuthology.orchestra.run.smithi050.stdout:3953 writesame 0xab9df44 thru 0xaba6d12 data_size 0x1(0x8dcf bytes) 2024-09-05T17:31:45.926 INFO:teuthology.orchestra.run.smithi050.stdout:3954 read 0x6b85527 thru 0x6b8f459 (0x9f33 bytes) 2024-09-05T17:31:45.926 INFO:teuthology.orchestra.run.smithi050.stdout:3955 punch from 0x6a3322 to 0x6abbcc, (0x88aa bytes) 2024-09-05T17:31:45.927 INFO:teuthology.orchestra.run.smithi050.stdout:3956 punch from 0x7ce072b to 0x7ce7258, (0x6b2d bytes) 2024-09-05T17:31:45.927 INFO:teuthology.orchestra.run.smithi050.stdout:3957 read 0x31c0085 thru 0x31cfc8a (0xfc06 bytes) 2024-09-05T17:31:45.927 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:45.940 INFO:teuthology.orchestra.run.smithi050.stdout:3959 trunc from 0xaee4779 to 0x6315f95 2024-09-05T17:31:45.959 INFO:teuthology.orchestra.run.smithi050.stdout:3961 read 0x489616a thru 0x489e803 (0x869a bytes) 2024-09-05T17:31:45.964 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:45.965+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:45.989 INFO:teuthology.orchestra.run.smithi050.stdout:3962 write 0xc7b46d2 thru 0xc7b4bec (0x51b bytes) 2024-09-05T17:31:46.011 INFO:teuthology.orchestra.run.smithi050.stdout:3963 writesame 0xd11d664 thru 0xd12a9c7 data_size 0x4(0xd364 bytes) 2024-09-05T17:31:46.011 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:46.011 INFO:teuthology.orchestra.run.smithi050.stdout:3965 clone 23 order 24 su 4194304 sc 3 2024-09-05T17:31:46.019 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:46.019 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:46.033 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:46.081 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:46.081+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:46.154 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:46.155 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:46.166 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:46.165+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:46.169 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:46.267 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:46.265+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:46.332 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:46.332 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:46.347 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:46.393 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:46.393+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:46.401 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:46.468 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:46.469+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:46.471 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:46.471 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:46.485 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:46.565 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:46.565 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:46.577 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:46.577+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:46.582 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:46.582 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:46.598 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:46.598 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:46.615 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:46.615 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:46.636 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:46.636 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:46.652 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:46.652 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:46.654 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:46.655 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:46.667 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:46.675 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:46.675 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:46.696 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:46.696 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:46.713 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:46.713+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:46.770 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:46.769+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:46.842 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:46.842 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:46.856 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:46.871 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:46.873+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:46.967 INFO:teuthology.orchestra.run.smithi050.stdout:flattening image image_client.0-clone22 2024-09-05T17:31:46.973 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:46.973+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:8976 3.10 3:0f1f7ceb:::rbd_data.11403f2d9bbd.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-05T17:31:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.492121716, 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043813337000000001, 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 8976 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498239+0000", 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498241+0000", 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6529999999999998e-06 2024-09-05T17:31:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498253+0000", 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1681999999999999e-05 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498283+0000", 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0097999999999999e-05 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498299+0000", 2024-09-05T17:31:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5498999999999998e-05 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498406+0000", 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010711 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.498540+0000", 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000134461 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.506438+0000", 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078981060000000002 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541694+0000", 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.035255701 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541815+0000", 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-05T17:31:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.541919+0000", 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010451299999999999 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:56.542052+0000", 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132745 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28575 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.313162585000001, 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041664701999999998, 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28575 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677198+0000", 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677199+0000", 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0699999999999996e-07 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677203+0000", 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1869999999999999e-06 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677219+0000", 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5724999999999999e-05 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677230+0000", 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1902999999999999e-05 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717588+0000", 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040357993000000002 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.717758+0000", 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016953399999999999 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718863+0000", 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011046529999999999 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28576 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.313117034000001, 2024-09-05T17:31:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042556272999999999, 2024-09-05T17:31:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28576 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677243+0000", 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677245+0000", 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.494e-06 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677250+0000", 2024-09-05T17:31:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.276e-06 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677280+0000", 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9451999999999999e-05 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677288+0000", 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5990000000000002e-06 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.718928+0000", 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.041639279000000001 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719099+0000", 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000171151 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719800+0000", 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00070102200000000004 2024-09-05T17:31:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28577 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 69632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.312731483, 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04307043, 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28577 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677629+0000", 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677631+0000", 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0760000000000001e-06 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677640+0000", 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1560000000000001e-06 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677666+0000", 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6156000000000002e-05 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677686+0000", 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9321999999999999e-05 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.719867+0000", 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042181070000000001 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720043+0000", 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176496 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720699+0000", 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065615400000000005 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28578 3.a 3:56b782cb:::rbd_data.11403aa71fdc.0000000000000002:8 [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.312645758000002, 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043977430999999997, 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28578 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677715+0000", 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677716+0000", 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.533e-06 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677723+0000", 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.613e-06 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677742+0000", 2024-09-05T17:31:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8629000000000001e-05 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677756+0000", 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4566000000000001e-05 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.720766+0000", 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.043009798000000002 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721003+0000", 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721692+0000", 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00068963399999999995 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28579 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.312583930999999, 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044067576999999997, 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28579 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677777+0000", 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677778+0000", 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.043e-06 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677783+0000", 2024-09-05T17:31:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5799999999999999e-06 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677801+0000", 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7825999999999998e-05 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677815+0000", 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3532e-05 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721827+0000", 2024-09-05T17:31:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044012451000000001 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721844+0000", 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7144999999999999e-05 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28580 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.312524691, 2024-09-05T17:31:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044087135, 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28580 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677836+0000", 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677837+0000", 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2130000000000001e-06 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677843+0000", 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1e-06 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677862+0000", 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8719000000000002e-05 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677876+0000", 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4079e-05 2024-09-05T17:31:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721907+0000", 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044030712999999999 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721923+0000", 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6311e-05 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28581 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.312460207000001, 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044089852999999998, 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28581 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677900+0000", 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677902+0000", 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.28e-06 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677907+0000", 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6019999999999999e-06 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677926+0000", 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8346e-05 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.677939+0000", 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3796e-05 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721974+0000", 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.044035004000000003 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.721990+0000", 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5824999999999998e-05 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28662 3.a 3.10099d2a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.310463368000001, 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042160502000000002, 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28662 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679897+0000", 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679900+0000", 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.407e-06 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679912+0000", 2024-09-05T17:31:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.219e-05 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679937+0000", 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5525e-05 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.679958+0000", 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0268e-05 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722042+0000", 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.042084253000000002 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722058+0000", 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5858999999999998e-05 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28700 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.308332641, 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040505403000000002, 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28700 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682028+0000", 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682029+0000", 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682035+0000", 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5999999999999997e-06 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682052+0000", 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6833e-05 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682064+0000", 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2795e-05 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722517+0000", 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040453000000000003 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722533+0000", 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5798999999999999e-05 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28701 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.308279624000001, 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040534632000000001, 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28701 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682081+0000", 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682082+0000", 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0729999999999999e-06 2024-09-05T17:31:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682087+0000", 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8829999999999997e-06 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682103+0000", 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6049000000000002e-05 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682117+0000", 2024-09-05T17:31:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3740000000000001e-05 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722583+0000", 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040466323999999998 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722616+0000", 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2563e-05 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28702 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.308225180000001, 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040547896999999999, 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28702 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682135+0000", 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682137+0000", 2024-09-05T17:31:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2899999999999999e-06 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682143+0000", 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0159999999999997e-06 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682160+0000", 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7655999999999998e-05 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682175+0000", 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4836e-05 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722665+0000", 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040490155999999999 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722683+0000", 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7943000000000001e-05 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28703 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.308166663000002, 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040556400999999999, 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28703 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682194+0000", 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682195+0000", 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682201+0000", 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5729999999999998e-06 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682218+0000", 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7915999999999999e-05 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682232+0000", 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3576e-05 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722734+0000", 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040502437000000002 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722750+0000", 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5756e-05 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28704 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.308108793000002, 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040560355999999999, 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28704 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682252+0000", 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682253+0000", 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.153e-06 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682258+0000", 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5629999999999999e-06 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682275+0000", 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6983e-05 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682290+0000", 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4158999999999999e-05 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722798+0000", 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040508294 2024-09-05T17:31:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722812+0000", 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4204e-05 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28705 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.308050926, 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040566735, 2024-09-05T17:31:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28705 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682310+0000", 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682311+0000", 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.187e-06 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682316+0000", 2024-09-05T17:31:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4929999999999998e-06 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682334+0000", 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7305000000000001e-05 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682347+0000", 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.328e-05 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722861+0000", 2024-09-05T17:31:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040513999000000002 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722876+0000", 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5471000000000001e-05 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28706 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.307995042000002, 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040580441000000002, 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28706 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682365+0000", 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682367+0000", 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682385+0000", 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8352e-05 2024-09-05T17:31:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682403+0000", 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7940000000000001e-05 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682417+0000", 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4285e-05 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722930+0000", 2024-09-05T17:31:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040512907000000001 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722946+0000", 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5537e-05 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28707 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.307922005999998, 2024-09-05T17:31:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040576270999999997, 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28707 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682438+0000", 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682440+0000", 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1200000000000001e-06 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682445+0000", 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6899999999999997e-06 2024-09-05T17:31:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682463+0000", 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7765999999999999e-05 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682477+0000", 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3465999999999999e-05 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.722998+0000", 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040521807 2024-09-05T17:31:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723015+0000", 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6422e-05 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28708 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.307862155000002, 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040582981999999997, 2024-09-05T17:31:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28708 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682498+0000", 2024-09-05T17:31:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682500+0000", 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.26e-06 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682505+0000", 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6489999999999996e-06 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682523+0000", 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682535+0000", 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2313000000000001e-05 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723066+0000", 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040530432999999998 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723081+0000", 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5784999999999999e-05 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28709 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.307805737999999, 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040593911000000003, 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28709 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682555+0000", 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682556+0000", 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.19e-06 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682561+0000", 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4820000000000002e-06 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682579+0000", 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7430000000000001e-05 2024-09-05T17:31:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682593+0000", 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799e-05 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723133+0000", 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040540208000000001 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723149+0000", 2024-09-05T17:31:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5801999999999999e-05 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28710 3.a 3.d341ed6a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.307727962000001, 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040581488999999998, 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28710 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682633+0000", 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682634+0000", 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.483e-06 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682640+0000", 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.319e-06 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682659+0000", 2024-09-05T17:31:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8266000000000001e-05 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.682673+0000", 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.431e-05 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723198+0000", 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.040525383999999998 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.723214+0000", 2024-09-05T17:31:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5727e-05 2024-09-05T17:31:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.080 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:47.081 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:47.082 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:47.081+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:47.183 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:47.181+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:31:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:47.227 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:47.237 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-05T17:31:47.283 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:47.281+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:47.349 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:47.349 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:47.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:47.384 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:47.385+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:47.485 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:47.485+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:47.525 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.507299645000003, 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:31:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:31:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38987 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 253952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774870512, 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074851697999999994, 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38987 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749281+0000", 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.023e-06 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749286+0000", 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999996e-06 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749308+0000", 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1141999999999998e-05 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749321+0000", 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3653e-05 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.823944+0000", 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074623192000000005 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824027+0000", 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.297e-05 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824132+0000", 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104548 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38988 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 268288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774812615000002, 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075009180999999994, 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38988 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749339+0000", 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0330000000000001e-06 2024-09-05T17:31:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749344+0000", 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7230000000000004e-06 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749359+0000", 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5427e-05 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749385+0000", 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5469e-05 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824164+0000", 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074779258000000001 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824251+0000", 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6620999999999996e-05 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824347+0000", 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6650000000000005e-05 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38989 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 282624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774745224, 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075156843000000001, 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38989 2024-09-05T17:31:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749407+0000", 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749412+0000", 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8000000000000004e-06 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749430+0000", 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7816e-05 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749444+0000", 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3919e-05 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824381+0000", 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074936661000000002 2024-09-05T17:31:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824462+0000", 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1176999999999999e-05 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824562+0000", 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010029700000000001 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38990 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 296960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774688126999997, 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075320143000000006, 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38990 2024-09-05T17:31:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749464+0000", 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1769999999999999e-06 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749480+0000", 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5886e-05 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749498+0000", 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8238999999999999e-05 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749512+0000", 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3876000000000001e-05 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824587+0000", 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075075107000000002 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824657+0000", 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9859999999999999e-05 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824783+0000", 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125998 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38991 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774619692999998, 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075469580999999994, 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38991 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749532+0000", 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749538+0000", 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4469999999999997e-06 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749555+0000", 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749569+0000", 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3397000000000001e-05 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824814+0000", 2024-09-05T17:31:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075245765000000006 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824900+0000", 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700999999999998e-05 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825001+0000", 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100556 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38992 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 325632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774565084999999, 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075625943000000001, 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38992 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749587+0000", 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749591+0000", 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6970000000000001e-06 2024-09-05T17:31:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749608+0000", 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6569e-05 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749621+0000", 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3457e-05 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825030+0000", 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075408915000000007 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825109+0000", 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825212+0000", 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102644 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38993 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774512516999998, 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075788663000000006, 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38993 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749639+0000", 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-05T17:31:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749659+0000", 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0092e-05 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749678+0000", 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8450000000000001e-05 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749693+0000", 2024-09-05T17:31:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4583000000000001e-05 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825241+0000", 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075548134000000003 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825323+0000", 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2410000000000005e-05 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825427+0000", 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103831 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38994 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 354304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774439123999997, 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075917854000000007, 2024-09-05T17:31:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38994 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749713+0000", 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.097e-06 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749718+0000", 2024-09-05T17:31:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3569999999999997e-06 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749735+0000", 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6969e-05 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749748+0000", 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825456+0000", 2024-09-05T17:31:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075707846999999995 2024-09-05T17:31:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825532+0000", 2024-09-05T17:31:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5480000000000002e-05 2024-09-05T17:31:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825629+0000", 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7785e-05 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38995 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 368640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774385578999997, 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076074345000000002, 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38995 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749766+0000", 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0470000000000001e-06 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749771+0000", 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8720000000000001e-06 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749788+0000", 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6762999999999999e-05 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749819+0000", 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1056000000000002e-05 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825659+0000", 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075840487999999998 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825738+0000", 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8862000000000005e-05 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825839+0000", 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101257 2024-09-05T17:31:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38996 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 382976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774313671999998, 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076198058999999999, 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38996 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749838+0000", 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8700000000000004e-07 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749843+0000", 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.339e-06 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749860+0000", 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7059999999999999e-05 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749874+0000", 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3769e-05 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825869+0000", 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075995094999999999 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825945+0000", 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5661000000000006e-05 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826035+0000", 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0148000000000005e-05 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38997 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774259761000003, 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076361818999999997, 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38997 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749892+0000", 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0130000000000001e-06 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749897+0000", 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6859999999999997e-06 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749913+0000", 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6637e-05 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749927+0000", 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3396e-05 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826068+0000", 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076140883000000006 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826148+0000", 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0698000000000006e-05 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826253+0000", 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010450600000000001 2024-09-05T17:31:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38998 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 411648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774207220000001, 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076522440999999997, 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38998 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749945+0000", 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9999999999999995e-07 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749949+0000", 2024-09-05T17:31:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6500000000000004e-06 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749966+0000", 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6756e-05 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749980+0000", 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3746e-05 2024-09-05T17:31:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826284+0000", 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076304300000000005 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826364+0000", 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689000000000002e-05 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826466+0000", 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010230000000000001 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38999 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 425984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774152745999999, 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076686775999999998, 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38999 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749999+0000", 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.054e-06 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750004+0000", 2024-09-05T17:31:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8459999999999999e-06 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750025+0000", 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750039+0000", 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4141999999999999e-05 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826498+0000", 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076458700000000004 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826584+0000", 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6123000000000002e-05 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826685+0000", 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010075499999999999 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39000 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 440320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774093665000002, 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076822304999999994, 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39000 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750058+0000", 2024-09-05T17:31:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1739999999999999e-06 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750076+0000", 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7309e-05 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750097+0000", 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1345999999999999e-05 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750111+0000", 2024-09-05T17:31:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4205e-05 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826715+0000", 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076604277999999998 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826792+0000", 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6561000000000001e-05 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826879+0000", 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7431999999999999e-05 2024-09-05T17:31:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39001 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.774021703999999, 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076972354000000007, 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39001 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750130+0000", 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1459999999999999e-06 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750135+0000", 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8169999999999998e-06 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750155+0000", 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0409000000000001e-05 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750169+0000", 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3786e-05 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826909+0000", 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076740082000000001 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827000+0000", 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0956000000000001e-05 2024-09-05T17:31:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827101+0000", 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101158 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39002 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.773954644, 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077117667000000001, 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39002 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750197+0000", 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1599999999999999e-06 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750203+0000", 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6699999999999999e-06 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750228+0000", 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5131999999999999e-05 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750243+0000", 2024-09-05T17:31:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4610000000000001e-05 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827135+0000", 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076891994000000005 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827217+0000", 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2766e-05 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827314+0000", 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6335000000000005e-05 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39003 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.773888687000003, 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077268069999999994, 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39003 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750263+0000", 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750269+0000", 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.48e-06 2024-09-05T17:31:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750294+0000", 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4981999999999999e-05 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750308+0000", 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4266e-05 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827344+0000", 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077036358999999999 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827428+0000", 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3332999999999996e-05 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827530+0000", 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102396 2024-09-05T17:31:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39004 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 497664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.773823933000003, 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077374380000000006, 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39004 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750328+0000", 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750346+0000", 2024-09-05T17:31:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7929999999999999e-05 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750367+0000", 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750391+0000", 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4009e-05 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827549+0000", 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077158103000000006 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827618+0000", 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8660999999999999e-05 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827701+0000", 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3341e-05 2024-09-05T17:31:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39005 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.773735379000001, 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077409180999999994, 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39005 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750416+0000", 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750422+0000", 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4029999999999998e-06 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750442+0000", 2024-09-05T17:31:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0162000000000001e-05 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750456+0000", 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3699999999999999e-05 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827719+0000", 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077263407000000006 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827767+0000", 2024-09-05T17:31:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8174999999999999e-05 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827825+0000", 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7191000000000002e-05 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:47.625 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:47.627 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:47.627 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:47.625+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:47.700 INFO:teuthology.orchestra.run.smithi050.stdout:3966 write 0xb17a69f thru 0xb18642a (0xbd8c bytes) 2024-09-05T17:31:47.716 INFO:teuthology.orchestra.run.smithi050.stdout:3967 write 0x27c967e thru 0x27cdcff (0x4682 bytes) 2024-09-05T17:31:47.728 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:47.725+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:47.729 INFO:teuthology.orchestra.run.smithi050.stdout:3968 read 0xb5e9a42 thru 0xb5f3fd1 (0xa590 bytes) 2024-09-05T17:31:47.729 INFO:teuthology.orchestra.run.smithi050.stdout:3969 write 0x967918f thru 0x9681eb2 (0x8d24 bytes) 2024-09-05T17:31:47.738 INFO:teuthology.orchestra.run.smithi050.stdout:3970 read 0x5e66c0d thru 0x5e70b82 (0x9f76 bytes) 2024-09-05T17:31:47.752 INFO:teuthology.orchestra.run.smithi050.stdout:3971 writesame 0xe61859c thru 0xe61d2a2 data_size 0x15(0x4d07 bytes) 2024-09-05T17:31:47.759 INFO:teuthology.orchestra.run.smithi050.stdout:3975 write 0x21aee75 thru 0x21bcbea (0xdd76 bytes) 2024-09-05T17:31:47.769 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:47.769 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:47.769 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:47.770 INFO:teuthology.orchestra.run.smithi050.stdout:3976 write 0x13f6bdc thru 0x13fa948 (0x3d6d bytes) 2024-09-05T17:31:47.781 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:47.781 INFO:teuthology.orchestra.run.smithi050.stdout:3978 write 0xa8e0f59 thru 0xa8f04cb (0xf573 bytes) 2024-09-05T17:31:47.785 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:47.814 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:31:47.815 INFO:teuthology.orchestra.run.smithi050.stdout:3979 trunc from 0xe61d2a3 to 0x185bc3d 2024-09-05T17:31:47.829 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:47.829+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:47.842 INFO:teuthology.orchestra.run.smithi050.stdout:3980 punch from 0x1657ead to 0x165e52d, (0x6680 bytes) 2024-09-05T17:31:47.873 INFO:teuthology.orchestra.run.smithi050.stdout:3982 writesame 0xe8cd5e0 thru 0xe8d1dfa data_size 0x15(0x481b bytes) 2024-09-05T17:31:47.873 INFO:teuthology.orchestra.run.smithi050.stdout:3983 write 0x9ffe3c7 thru 0xa0034a7 (0x50e1 bytes) 2024-09-05T17:31:47.883 INFO:teuthology.orchestra.run.smithi050.stdout:3985 write 0xdccd97e thru 0xdcd0e8d (0x3510 bytes) 2024-09-05T17:31:47.891 INFO:teuthology.orchestra.run.smithi050.stdout:3987 punch from 0x9dbd3a8 to 0x9dcc77a, (0xf3d2 bytes) 2024-09-05T17:31:47.891 INFO:teuthology.orchestra.run.smithi050.stdout:3988 punch from 0x125d3bc to 0x1261287, (0x3ecb bytes) 2024-09-05T17:31:47.891 INFO:teuthology.orchestra.run.smithi050.stdout:3989 clone 24 order 18 su 8192 sc 5 2024-09-05T17:31:47.914 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:47.914 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:47.914 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:47.930 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:47.930 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:47.929+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:48.030 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:48.029+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:48.090 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:48.090 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:48.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:48.090 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007620686999999, 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:31:48.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:31:48.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:48.095 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007592271, 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:31:48.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007570344999998, 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:31:48.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007548898000003, 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:48.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:31:48.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007510607999997, 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.110 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:31:48.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007495792, 2024-09-05T17:31:48.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:31:48.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007484593000001, 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:48.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007473754000003, 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:48.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007463276999999, 2024-09-05T17:31:48.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.129 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:31:48.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:48.133 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007452454999999, 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:48.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:31:48.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007442054999999, 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.138 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.142 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007423703000001, 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:31:48.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.007240078999999, 2024-09-05T17:31:48.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:48.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:31:48.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.998580785000001, 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:31:48.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.998540243999997, 2024-09-05T17:31:48.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:31:48.161 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.998500415000002, 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.162 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:48.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.998472939999999, 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:48.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:31:48.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.998434431, 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:31:48.171 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:48.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:31:48.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.998391691000002, 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.176 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.597113477000001, 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:31:48.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:31:48.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:31:48.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.188 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.189 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:48.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:48.191 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:48.189+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:48.291 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:48.293+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:48.318 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:48.318 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:48.318 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:48.318 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:48.334 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:48.419 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:48.421+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:48.493 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:48.493+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:48.504 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:48.504 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:48.504 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:48.504 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:48.504 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:48.519 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:48.607 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:48.609+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:48.695 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:48.697+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:48.696 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15042 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8564736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933275264999999, 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054711072999999999, 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.697 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15042 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:48.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763434+0000", 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3910000000000001e-06 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763441+0000", 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1130000000000003e-06 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763449+0000", 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4059999999999999e-06 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.817943+0000", 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054494611999999998 2024-09-05T17:31:48.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818037+0000", 2024-09-05T17:31:48.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3430999999999994e-05 2024-09-05T17:31:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818143+0000", 2024-09-05T17:31:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010574 2024-09-05T17:31:48.704 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15043 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8581120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933250510000001, 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054839756000000003, 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15043 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763457+0000", 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9700000000000002e-07 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763459+0000", 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2079999999999999e-06 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763466+0000", 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4869999999999996e-06 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763472+0000", 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4099999999999999e-06 2024-09-05T17:31:48.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818179+0000", 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054706751999999997 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818235+0000", 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6433e-05 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818296+0000", 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1068999999999994e-05 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15044 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8597504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933227158000001, 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055068822000000003, 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15044 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763482+0000", 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3120000000000001e-06 2024-09-05T17:31:48.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763489+0000", 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8020000000000003e-06 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763494+0000", 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.276e-06 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818342+0000", 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054847104000000001 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818431+0000", 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9835999999999998e-05 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818548+0000", 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011708499999999999 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.714 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15045 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8613888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933204904999997, 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055286647000000001, 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.715 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15045 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763505+0000", 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763511+0000", 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.533e-06 2024-09-05T17:31:48.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763517+0000", 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3979999999999998e-06 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818594+0000", 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055077706999999997 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818679+0000", 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4797999999999997e-05 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818789+0000", 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109369 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15046 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8630272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.719 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933168043999999, 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055492107999999998, 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15046 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5699999999999998e-07 2024-09-05T17:31:48.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763542+0000", 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6860000000000002e-06 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763550+0000", 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9859999999999994e-06 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763556+0000", 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0610000000000001e-06 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818833+0000", 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055276618 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818932+0000", 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9474000000000003e-05 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819031+0000", 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8826000000000006e-05 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15047 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8646656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933141767000002, 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055685474999999998, 2024-09-05T17:31:48.724 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15047 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763566+0000", 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763568+0000", 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7049999999999999e-06 2024-09-05T17:31:48.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763576+0000", 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6340000000000001e-06 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763581+0000", 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.519e-06 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819078+0000", 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055496668999999998 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819175+0000", 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6883000000000001e-05 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819250+0000", 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5462000000000004e-05 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.728 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15048 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8663040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933116849999998, 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055952927999999999, 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15048 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3599999999999999e-07 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763593+0000", 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6589999999999999e-06 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763600+0000", 2024-09-05T17:31:48.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0879999999999997e-06 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763607+0000", 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6649999999999997e-06 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819308+0000", 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055701181000000002 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819418+0000", 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109755 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819543+0000", 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012514399999999999 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15049 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8679424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933091834000003, 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056101897999999997, 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.734 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15049 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.63e-07 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763618+0000", 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5959999999999998e-06 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763625+0000", 2024-09-05T17:31:48.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9879999999999998e-06 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763631+0000", 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6069999999999998e-06 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819610+0000", 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055979244999999997 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819655+0000", 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5488999999999998e-05 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819717+0000", 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1509999999999999e-05 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15050 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8695808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.738 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933063523000001, 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056583593000000001, 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15050 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763644+0000", 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2600000000000002e-07 2024-09-05T17:31:48.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763647+0000", 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763654+0000", 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0119999999999999e-06 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763659+0000", 2024-09-05T17:31:48.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639999999999997e-06 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819747+0000", 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056088302 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820111+0000", 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036350299999999999 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820227+0000", 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011605 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15051 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8712192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933039637999997, 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056866834999999998, 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.743 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15051 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763668+0000", 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7899999999999999e-07 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763670+0000", 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3580000000000001e-06 2024-09-05T17:31:48.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763677+0000", 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9809999999999997e-06 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763682+0000", 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3499999999999996e-06 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820263+0000", 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056581285000000002 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820427+0000", 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016371100000000001 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820534+0000", 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106771 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15052 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8728576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.933017096999997, 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057071953000000002, 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15052 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9099999999999999e-07 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763692+0000", 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.092e-06 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763699+0000", 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5470000000000002e-06 2024-09-05T17:31:48.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763704+0000", 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1039999999999998e-06 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820568+0000", 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056863805000000003 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820665+0000", 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7090999999999996e-05 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820762+0000", 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6922999999999993e-05 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15053 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8744960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.752 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.932995104, 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057269911999999999, 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15053 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:48.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763714+0000", 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3489999999999999e-06 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763721+0000", 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3119999999999999e-06 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763725+0000", 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.741e-06 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820794+0000", 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057069021999999997 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820883+0000", 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8739999999999994e-05 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820982+0000", 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8368000000000004e-05 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15054 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8761344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.932972245000002, 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057438612999999999, 2024-09-05T17:31:48.757 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15054 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2e-07 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763737+0000", 2024-09-05T17:31:48.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4140000000000001e-06 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763744+0000", 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8279999999999997e-06 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763755+0000", 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1126e-05 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821013+0000", 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057257844000000002 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821087+0000", 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3651000000000003e-05 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821173+0000", 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6329999999999995e-05 2024-09-05T17:31:48.761 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15055 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8777728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.932944646000003, 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.05769469, 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.762 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15055 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763763+0000", 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0600000000000001e-07 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763765+0000", 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.12e-06 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763770+0000", 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8209999999999998e-06 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763777+0000", 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999999e-06 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821205+0000", 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057428078 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821292+0000", 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6842000000000006e-05 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821457+0000", 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016531299999999999 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15056 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8794112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.932922796, 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057974700999999997, 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15056 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.767 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763786+0000", 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1229999999999998e-06 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763794+0000", 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1590000000000004e-06 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763799+0000", 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9309999999999999e-06 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821490+0000", 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057691872999999998 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821616+0000", 2024-09-05T17:31:48.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125327 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821759+0000", 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014289500000000001 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15057 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8810496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.932901192999999, 2024-09-05T17:31:48.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058215998999999997, 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15057 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:48.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4300000000000003e-07 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763808+0000", 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0379999999999998e-06 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763816+0000", 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763821+0000", 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0429999999999998e-06 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821799+0000", 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057977385999999999 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821909+0000", 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110801 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822022+0000", 2024-09-05T17:31:48.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000112185 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15058 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8826880~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.932862915999998, 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058413768999999997, 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.776 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15058 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770678+0000", 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068342020000000002 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770685+0000", 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.063e-06 2024-09-05T17:31:48.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770696+0000", 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1225e-05 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770704+0000", 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3880000000000002e-06 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822073+0000", 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.051369608999999997 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822153+0000", 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9225000000000001e-05 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822258+0000", 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010505699999999999 2024-09-05T17:31:48.780 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15079 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9170944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.925725935000003, 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054753171000000003, 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.781 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15079 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:48.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7500000000000001e-07 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770982+0000", 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770986+0000", 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.225e-06 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770989+0000", 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825631+0000", 2024-09-05T17:31:48.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054642257999999999 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825680+0000", 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9026000000000001e-05 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825734+0000", 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4218000000000002e-05 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15080 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9187328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.925697086, 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054872632999999997, 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15080 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.786 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:48.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8599999999999999e-07 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771012+0000", 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.57e-06 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771016+0000", 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1919999999999998e-06 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771019+0000", 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0790000000000001e-06 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825770+0000", 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054750974000000001 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825820+0000", 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9873999999999997e-05 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825882+0000", 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2558000000000007e-05 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15081 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9203712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.925673895999999, 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054991252999999997, 2024-09-05T17:31:48.790 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15081 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778817+0000", 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077838489999999998 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:48.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778822+0000", 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9910000000000002e-06 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778831+0000", 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2089999999999994e-06 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778837+0000", 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8289999999999996e-06 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825928+0000", 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047091230999999997 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825972+0000", 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3964000000000001e-05 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.826024+0000", 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2179999999999998e-05 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.794 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:48.795 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:48.795 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:48.795 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:48.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:48.797 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:48.797+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:48.801 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:48.801 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:31:48.801 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-05T17:31:48.801 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 1.000000 2024-09-05T17:31:48.801 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-05T17:31:48.820 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:31:48.898 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:48.897+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:48.944 INFO:teuthology.orchestra.run.smithi050.stdout:leaving image image_client.0-clone23 intact 2024-09-05T17:31:48.963 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:48.963 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:48.963 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:48.963 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:48.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:48.989 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:48.990 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:48.999 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:48.997+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:49.024 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:49.024 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:49.043 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:49.043 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:49.077 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:49.078 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:49.100 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:49.100 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:49.100 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:49.097+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:49.104 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:49.104 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:49.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:49.122 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:49.122 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:49.143 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:49.143 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:49.162 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-05T17:31:49.180 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:49.181 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:49.201 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:49.201+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:49.272 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:49.272 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:49.289 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:49.335 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:49.337+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:49.403 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:49.401+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:49.412 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:49.412 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:49.429 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:49.523 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:49.525+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:49.548 INFO:teuthology.orchestra.run.smithi050.stdout:3990 trunc from 0xe8d1dfb to 0x48b7f78 2024-09-05T17:31:49.578 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:49.579 INFO:teuthology.orchestra.run.smithi050.stdout:3992 writesame 0x22c06c1 thru 0x22c2d24 data_size 0x54(0x2664 bytes) 2024-09-05T17:31:49.604 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:49.601+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:49.606 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:49.606 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:49.607 INFO:teuthology.orchestra.run.smithi050.stdout:3993 punch from 0x29b96ea to 0x29bf4df, (0x5df5 bytes) 2024-09-05T17:31:49.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:49.632 INFO:teuthology.orchestra.run.smithi050.stdout:3994 writesame 0xc4d8ada thru 0xc4e72e5 data_size 0x2(0xe80c bytes) 2024-09-05T17:31:49.632 INFO:teuthology.orchestra.run.smithi050.stdout:3995 punch from 0xac284b0 to 0xac2dca4, (0x57f4 bytes) 2024-09-05T17:31:49.632 INFO:teuthology.orchestra.run.smithi050.stdout:3997 punch from 0xab05812 to 0xab0bb97, (0x6385 bytes) 2024-09-05T17:31:49.632 INFO:teuthology.orchestra.run.smithi050.stdout:3998 read 0xa0ddc09 thru 0xa0e0ad8 (0x2ed0 bytes) 2024-09-05T17:31:49.632 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:49.632 INFO:teuthology.orchestra.run.smithi050.stdout:4001 writesame 0x7f373a7 thru 0x7f3b84a data_size 0x2e(0x44a4 bytes) 2024-09-05T17:31:49.641 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:49.656 INFO:teuthology.orchestra.run.smithi050.stdout:4006 writesame 0xdbe852b thru 0xdbeae38 data_size 0x5(0x290e bytes) 2024-09-05T17:31:49.656 INFO:teuthology.orchestra.run.smithi050.stdout:4009 write 0x5f3da8 thru 0x5ffc86 (0xbedf bytes) 2024-09-05T17:31:49.700 INFO:teuthology.orchestra.run.smithi050.stdout:4010 read 0x1d891f4 thru 0x1d92177 (0x8f84 bytes) 2024-09-05T17:31:49.705 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:49.705+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:49.714 INFO:teuthology.orchestra.run.smithi050.stdout:4011 trunc from 0xdbeae39 to 0x5847f5f 2024-09-05T17:31:49.732 INFO:teuthology.orchestra.run.smithi050.stdout:4012 read 0x1b0b05b thru 0x1b186f9 (0xd69f bytes) 2024-09-05T17:31:49.744 INFO:teuthology.orchestra.run.smithi050.stdout:4014 trunc from 0x5847f5f to 0xc132257 2024-09-05T17:31:49.763 INFO:teuthology.orchestra.run.smithi050.stdout:4015 trunc from 0xc132257 to 0x6873c72 2024-09-05T17:31:49.774 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:49.775 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:49.796 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:49.799 INFO:teuthology.orchestra.run.smithi050.stdout:4017 writesame 0xc67da4d thru 0xc68babe data_size 0x1(0xe072 bytes) 2024-09-05T17:31:49.806 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:49.805+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:49.807 INFO:teuthology.orchestra.run.smithi050.stdout:4018 trunc from 0xc68babf to 0x5209152 2024-09-05T17:31:49.819 INFO:teuthology.orchestra.run.smithi050.stdout:4019 punch from 0x981e5b to 0x9906b5, (0xe85a bytes) 2024-09-05T17:31:49.823 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-05T17:31:49.823 INFO:teuthology.orchestra.run.smithi050.stdout:4020 trunc from 0x5209152 to 0x25ddf19 2024-09-05T17:31:49.874 INFO:teuthology.orchestra.run.smithi050.stdout:4021 write 0xe66d3a thru 0xe712ab (0xa572 bytes) 2024-09-05T17:31:49.906 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:49.905+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:49.927 INFO:teuthology.orchestra.run.smithi050.stdout:4022 flatten 2024-09-05T17:31:49.956 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:49.957 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:49.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:50.007 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:50.005+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:50.108 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:50.105+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:50.145 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:50.145 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:50.164 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:50.209 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:50.209+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:50.310 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:50.309+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:50.322 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:50.322 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:50.339 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:50.411 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:50.409+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:50.498 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:50.498 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:50.511 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:50.512 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:50.513+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:50.612 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:50.613+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:50.646 INFO:teuthology.orchestra.run.smithi050.stdout:4023 read 0x3b7e92 thru 0x3c76de (0xf84d bytes) 2024-09-05T17:31:50.647 INFO:teuthology.orchestra.run.smithi050.stdout:4024 punch from 0x254c124 to 0x254c817, (0x6f3 bytes) 2024-09-05T17:31:50.647 INFO:teuthology.orchestra.run.smithi050.stdout:4025 read 0x1207b44 thru 0x12083e5 (0x8a2 bytes) 2024-09-05T17:31:50.650 INFO:teuthology.orchestra.run.smithi050.stdout:4027 trunc from 0x25ddf19 to 0x366fe48 2024-09-05T17:31:50.654 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:50.654 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:50.669 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:50.693 INFO:teuthology.orchestra.run.smithi050.stdout:4029 write 0xb7169f1 thru 0xb71cd34 (0x6344 bytes) 2024-09-05T17:31:50.704 INFO:teuthology.orchestra.run.smithi050.stdout:4032 write 0x9e93d2b thru 0x9ea03cc (0xc6a2 bytes) 2024-09-05T17:31:50.713 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:50.713+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:50.732 INFO:teuthology.orchestra.run.smithi050.stdout:4033 trunc from 0xb71cd35 to 0x6987b29 2024-09-05T17:31:50.779 INFO:teuthology.orchestra.run.smithi050.stdout:4034 write 0xbfeabde thru 0xbff27fd (0x7c20 bytes) 2024-09-05T17:31:50.793 INFO:teuthology.orchestra.run.smithi050.stdout:4036 write 0xe44d25 thru 0xe4ee3f (0xa11b bytes) 2024-09-05T17:31:50.798 INFO:teuthology.orchestra.run.smithi050.stdout:4037 write 0xebb4f2 thru 0xec03ae (0x4ebd bytes) 2024-09-05T17:31:50.799 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:50.800 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:50.802 INFO:teuthology.orchestra.run.smithi050.stdout:4038 punch from 0x769b3d3 to 0x769cfd1, (0x1bfe bytes) 2024-09-05T17:31:50.802 INFO:teuthology.orchestra.run.smithi050.stdout:4039 write 0x4593915 thru 0x4595181 (0x186d bytes) 2024-09-05T17:31:50.810 INFO:teuthology.orchestra.run.smithi050.stdout:4040 punch from 0x702dc1f to 0x703b0e1, (0xd4c2 bytes) 2024-09-05T17:31:50.810 INFO:teuthology.orchestra.run.smithi050.stdout:4041 punch from 0x23396d4 to 0x23430ef, (0x9a1b bytes) 2024-09-05T17:31:50.810 INFO:teuthology.orchestra.run.smithi050.stdout:4044 clone 25 order 24 su 1048576 sc 3 2024-09-05T17:31:50.814 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:50.813+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:50.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:50.853 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:31:50.915 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:50.913+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:50.943 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:50.943 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:50.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:51.015 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:51.017+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:51.074 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:51.075 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:51.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:51.141 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:51.141+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:51.150 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-05T17:31:51.214 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:51.214 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:51.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:51.217 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:51.217+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:51.227 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:51.318 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:51.317+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:51.365 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:51.365 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:51.383 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:51.384 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:51.390 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:51.390 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:51.400 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:51.401 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:51.404 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:51.418 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:51.418 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:51.436 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:51.436 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:51.449 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:51.449+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:51.457 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:51.457 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:51.476 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:51.476 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:51.497 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:51.497 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:51.519 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:51.521+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:51.571 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:51.571 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:31:51.571 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:31:51.571 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:31:51.571 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:51.578 INFO:teuthology.orchestra.run.smithi050.stdout:4045 trunc from 0xbff27fe to 0xa3aff8e 2024-09-05T17:31:51.586 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:51.604 INFO:teuthology.orchestra.run.smithi050.stdout:4046 trunc from 0xa3aff8e to 0x8560b48 2024-09-05T17:31:51.632 INFO:teuthology.orchestra.run.smithi050.stdout:4047 read 0x39039e6 thru 0x390ccf6 (0x9311 bytes) 2024-09-05T17:31:51.633 INFO:teuthology.orchestra.run.smithi050.stdout:4048 read 0x2d70885 thru 0x2d75acd (0x5249 bytes) 2024-09-05T17:31:51.633 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:51.633+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:51.644 INFO:teuthology.orchestra.run.smithi050.stdout:4051 write 0x9c6ab53 thru 0x9c6deaa (0x3358 bytes) 2024-09-05T17:31:51.650 INFO:teuthology.orchestra.run.smithi050.stdout:4052 read 0x5089949 thru 0x50977dd (0xde95 bytes) 2024-09-05T17:31:51.650 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:51.650 INFO:teuthology.orchestra.run.smithi050.stdout:4054 punch from 0x82f209d to 0x82fc567, (0xa4ca bytes) 2024-09-05T17:31:51.650 INFO:teuthology.orchestra.run.smithi050.stdout:4057 punch from 0x5d21e4d to 0x5d232ce, (0x1481 bytes) 2024-09-05T17:31:51.650 INFO:teuthology.orchestra.run.smithi050.stdout:4058 punch from 0x4c07667 to 0x4c13db4, (0xc74d bytes) 2024-09-05T17:31:51.650 INFO:teuthology.orchestra.run.smithi050.stdout:4059 writesame 0x8654d9c thru 0x8663dfb data_size 0x30(0xf060 bytes) 2024-09-05T17:31:51.674 INFO:teuthology.orchestra.run.smithi050.stdout:4060 write 0xe1bbfb1 thru 0xe1c15ed (0x563d bytes) 2024-09-05T17:31:51.682 INFO:teuthology.orchestra.run.smithi050.stdout:4061 punch from 0xa58a908 to 0xa595aaf, (0xb1a7 bytes) 2024-09-05T17:31:51.682 INFO:teuthology.orchestra.run.smithi050.stdout:4062 writesame 0xc5c84a5 thru 0xc5cb796 data_size 0x1(0x32f2 bytes) 2024-09-05T17:31:51.703 INFO:teuthology.orchestra.run.smithi050.stdout:4063 writesame 0x7156d6 thru 0x724157 data_size 0xd(0xea82 bytes) 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.697385624000006, 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:31:51.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:31:51.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38987 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 253952~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964956491000002, 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074851697999999994, 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38987 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749280+0000", 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749281+0000", 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.023e-06 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749286+0000", 2024-09-05T17:31:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999996e-06 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749308+0000", 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1141999999999998e-05 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749321+0000", 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3653e-05 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.823944+0000", 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074623192000000005 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824027+0000", 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.297e-05 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824132+0000", 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104548 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38988 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 268288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964898593999997, 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075009180999999994, 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38988 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749338+0000", 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749339+0000", 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0330000000000001e-06 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749344+0000", 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7230000000000004e-06 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749359+0000", 2024-09-05T17:31:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5427e-05 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749385+0000", 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5469e-05 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824164+0000", 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074779258000000001 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824251+0000", 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6620999999999996e-05 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824347+0000", 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6650000000000005e-05 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38989 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 282624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964831203000003, 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075156843000000001, 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38989 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749406+0000", 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749407+0000", 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749412+0000", 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8000000000000004e-06 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749430+0000", 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7816e-05 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749444+0000", 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3919e-05 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824381+0000", 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074936661000000002 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824462+0000", 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1176999999999999e-05 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824562+0000", 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010029700000000001 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38990 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 296960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964774106, 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075320143000000006, 2024-09-05T17:31:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38990 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749463+0000", 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749464+0000", 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1769999999999999e-06 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749480+0000", 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5886e-05 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749498+0000", 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8238999999999999e-05 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749512+0000", 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3876000000000001e-05 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824587+0000", 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075075107000000002 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824657+0000", 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9859999999999999e-05 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824783+0000", 2024-09-05T17:31:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125998 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38991 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 311296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964705672000001, 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075469580999999994, 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38991 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749531+0000", 2024-09-05T17:31:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749532+0000", 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749538+0000", 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4469999999999997e-06 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749555+0000", 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7541999999999999e-05 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749569+0000", 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3397000000000001e-05 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824814+0000", 2024-09-05T17:31:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075245765000000006 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.824900+0000", 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5700999999999998e-05 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825001+0000", 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100556 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38992 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 325632~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964651064000002, 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075625943000000001, 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38992 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749586+0000", 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749587+0000", 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749591+0000", 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6970000000000001e-06 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749608+0000", 2024-09-05T17:31:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6569e-05 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749621+0000", 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3457e-05 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825030+0000", 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075408915000000007 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825109+0000", 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825212+0000", 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102644 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38993 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 339968~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964598496000001, 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075788663000000006, 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38993 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749638+0000", 2024-09-05T17:31:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749639+0000", 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749659+0000", 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0092e-05 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749678+0000", 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8450000000000001e-05 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749693+0000", 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4583000000000001e-05 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825241+0000", 2024-09-05T17:31:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075548134000000003 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825323+0000", 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2410000000000005e-05 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825427+0000", 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000103831 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38994 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 354304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964525103, 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075917854000000007, 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38994 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749712+0000", 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749713+0000", 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.097e-06 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749718+0000", 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3569999999999997e-06 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749735+0000", 2024-09-05T17:31:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6969e-05 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749748+0000", 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825456+0000", 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075707846999999995 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825532+0000", 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5480000000000002e-05 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825629+0000", 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7785e-05 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38995 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 368640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964471558, 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076074345000000002, 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38995 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749765+0000", 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749766+0000", 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0470000000000001e-06 2024-09-05T17:31:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749771+0000", 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8720000000000001e-06 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749788+0000", 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6762999999999999e-05 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749819+0000", 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1056000000000002e-05 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825659+0000", 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075840487999999998 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825738+0000", 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8862000000000005e-05 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825839+0000", 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101257 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38996 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 382976~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964399651000001, 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076198058999999999, 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38996 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749837+0000", 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749838+0000", 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8700000000000004e-07 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749843+0000", 2024-09-05T17:31:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.339e-06 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749860+0000", 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7059999999999999e-05 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749874+0000", 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3769e-05 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825869+0000", 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.075995094999999999 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.825945+0000", 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5661000000000006e-05 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826035+0000", 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0148000000000005e-05 2024-09-05T17:31:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38997 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 397312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964345739999999, 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076361818999999997, 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38997 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749891+0000", 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749892+0000", 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0130000000000001e-06 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749897+0000", 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6859999999999997e-06 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749913+0000", 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6637e-05 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749927+0000", 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3396e-05 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826068+0000", 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076140883000000006 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826148+0000", 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0698000000000006e-05 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826253+0000", 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010450600000000001 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38998 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 411648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964293198999997, 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076522440999999997, 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38998 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749944+0000", 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749945+0000", 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9999999999999995e-07 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749949+0000", 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6500000000000004e-06 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749966+0000", 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6756e-05 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749980+0000", 2024-09-05T17:31:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3746e-05 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826284+0000", 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076304300000000005 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826364+0000", 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689000000000002e-05 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826466+0000", 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010230000000000001 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38999 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 425984~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964238725000001, 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076686775999999998, 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38999 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749998+0000", 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.749999+0000", 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.054e-06 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750004+0000", 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8459999999999999e-06 2024-09-05T17:31:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750025+0000", 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750039+0000", 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4141999999999999e-05 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826498+0000", 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076458700000000004 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826584+0000", 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6123000000000002e-05 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826685+0000", 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010075499999999999 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39000 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 440320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964179643999998, 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076822304999999994, 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39000 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750057+0000", 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750058+0000", 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1739999999999999e-06 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750076+0000", 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7309e-05 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750097+0000", 2024-09-05T17:31:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1345999999999999e-05 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750111+0000", 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4205e-05 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826715+0000", 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076604277999999998 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826792+0000", 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6561000000000001e-05 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826879+0000", 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7431999999999999e-05 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39001 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 454656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964107683000002, 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076972354000000007, 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39001 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750129+0000", 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750130+0000", 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1459999999999999e-06 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750135+0000", 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8169999999999998e-06 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750155+0000", 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0409000000000001e-05 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750169+0000", 2024-09-05T17:31:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3786e-05 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.826909+0000", 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076740082000000001 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827000+0000", 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0956000000000001e-05 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827101+0000", 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101158 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39002 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 468992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.964040623000002, 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077117667000000001, 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39002 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750196+0000", 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750197+0000", 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1599999999999999e-06 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750203+0000", 2024-09-05T17:31:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6699999999999999e-06 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750228+0000", 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5131999999999999e-05 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750243+0000", 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4610000000000001e-05 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827135+0000", 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.076891994000000005 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827217+0000", 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2766e-05 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827314+0000", 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6335000000000005e-05 2024-09-05T17:31:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39003 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 483328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.963974665999999, 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077268069999999994, 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39003 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750262+0000", 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750263+0000", 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750269+0000", 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.48e-06 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750294+0000", 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4981999999999999e-05 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750308+0000", 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4266e-05 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827344+0000", 2024-09-05T17:31:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077036358999999999 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827428+0000", 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3332999999999996e-05 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827530+0000", 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102396 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39004 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 497664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.963909911999998, 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077374380000000006, 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39004 2024-09-05T17:31:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750327+0000", 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750328+0000", 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750346+0000", 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7929999999999999e-05 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750367+0000", 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1155999999999999e-05 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750391+0000", 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4009e-05 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827549+0000", 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077158103000000006 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827618+0000", 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8660999999999999e-05 2024-09-05T17:31:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827701+0000", 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3341e-05 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:39005 3.f 3:f71d5791:::rbd_data.11404462ede9.0000000000000002:b [read 512000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.963821357999997, 2024-09-05T17:31:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077409180999999994, 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 39005 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750415+0000", 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750416+0000", 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1429999999999999e-06 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:31:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750422+0000", 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4029999999999998e-06 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750442+0000", 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0162000000000001e-05 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.750456+0000", 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3699999999999999e-05 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827719+0000", 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.077263407000000006 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827767+0000", 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8174999999999999e-05 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.827825+0000", 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7191000000000002e-05 2024-09-05T17:31:51.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:31:51.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:31:51.813 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:31:51.814 INFO:teuthology.orchestra.run.smithi050.stdout:4064 trunc from 0xe1c15ee to 0xa7b2b66 2024-09-05T17:31:51.814 INFO:teuthology.orchestra.run.smithi050.stdout:4065 write 0xe3a6de8 thru 0xe3b6897 (0xfab0 bytes) 2024-09-05T17:31:51.814 INFO:teuthology.orchestra.run.smithi050.stdout:4066 write 0x8e8bfd thru 0x8f7d55 (0xf159 bytes) 2024-09-05T17:31:51.815 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:51.813+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:51.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:51.837 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:31:51.845 INFO:teuthology.orchestra.run.smithi050.stdout:4068 read 0x9c47591 thru 0x9c4c12f (0x4b9f bytes) 2024-09-05T17:31:51.846 INFO:teuthology.orchestra.run.smithi050.stdout:4069 writesame 0x2a9d3da thru 0x2aab19f data_size 0x1(0xddc6 bytes) 2024-09-05T17:31:51.915 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:51.913+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:51.918 INFO:teuthology.orchestra.run.smithi050.stdout:4070 read 0xb3a821f thru 0xb3b30ea (0xaecc bytes) 2024-09-05T17:31:51.918 INFO:teuthology.orchestra.run.smithi050.stdout:4072 read 0x8b9c38 thru 0x8c8d32 (0xf0fb bytes) 2024-09-05T17:31:51.919 INFO:teuthology.orchestra.run.smithi050.stdout:4073 read 0x8f9d5a2 thru 0x8fa6f96 (0x99f5 bytes) 2024-09-05T17:31:51.920 INFO:teuthology.orchestra.run.smithi050.stdout:4074 writesame 0x674a687 thru 0x6753445 data_size 0x1(0x8dbf bytes) 2024-09-05T17:31:51.949 INFO:teuthology.orchestra.run.smithi050.stdout:4075 read 0xb408133 thru 0xb41331a (0xb1e8 bytes) 2024-09-05T17:31:51.950 INFO:teuthology.orchestra.run.smithi050.stdout:4076 read 0x13f038 thru 0x143b44 (0x4b0d bytes) 2024-09-05T17:31:51.951 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:51.951 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:51.951 INFO:teuthology.orchestra.run.smithi050.stdout:4081 punch from 0xddfef7b to 0xde06f8a, (0x800f bytes) 2024-09-05T17:31:51.951 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:51.951 INFO:teuthology.orchestra.run.smithi050.stdout:4083 punch from 0xf8e097 to 0xf9d989, (0xf8f2 bytes) 2024-09-05T17:31:51.951 INFO:teuthology.orchestra.run.smithi050.stdout:4084 read 0x4a285c8 thru 0x4a33214 (0xac4d bytes) 2024-09-05T17:31:51.952 INFO:teuthology.orchestra.run.smithi050.stdout:4085 write 0x39848c0 thru 0x398b748 (0x6e89 bytes) 2024-09-05T17:31:51.954 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:51.954 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:51.954 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:51.955 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:51.961 INFO:teuthology.orchestra.run.smithi050.stdout:4086 read 0xba01fb thru 0xba6987 (0x678d bytes) 2024-09-05T17:31:51.962 INFO:teuthology.orchestra.run.smithi050.stdout:4087 read 0xc389faa thru 0xc3996e4 (0xf73b bytes) 2024-09-05T17:31:51.962 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:51.962 INFO:teuthology.orchestra.run.smithi050.stdout:4090 read 0x3c0758d thru 0x3c08670 (0x10e4 bytes) 2024-09-05T17:31:51.963 INFO:teuthology.orchestra.run.smithi050.stdout:4091 read 0x4c3ab55 thru 0x4c435ab (0x8a57 bytes) 2024-09-05T17:31:51.963 INFO:teuthology.orchestra.run.smithi050.stdout:4092 write 0x3e073d thru 0x3e846d (0x7d31 bytes) 2024-09-05T17:31:51.967 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:51.968 INFO:teuthology.orchestra.run.smithi050.stdout:4095 punch from 0x1d1b8d0 to 0x1d2ac57, (0xf387 bytes) 2024-09-05T17:31:51.971 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:51.980 INFO:teuthology.orchestra.run.smithi050.stdout:4096 writesame 0xea7977c thru 0xea82d83 data_size 0x4(0x9608 bytes) 2024-09-05T17:31:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:4097 punch from 0xd955c4b to 0xd962bc9, (0xcf7e bytes) 2024-09-05T17:31:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:4098 read 0x3d348df thru 0x3d3e7ba (0x9edc bytes) 2024-09-05T17:31:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:51.981 INFO:teuthology.orchestra.run.smithi050.stdout:4102 write 0x7ed2335 thru 0x7ed3081 (0xd4d bytes) 2024-09-05T17:31:51.993 INFO:teuthology.orchestra.run.smithi050.stdout:4103 trunc from 0xea82d84 to 0xab29d89 2024-09-05T17:31:52.014 INFO:teuthology.orchestra.run.smithi050.stdout:4104 write 0xcddb6 thru 0xda994 (0xcbdf bytes) 2024-09-05T17:31:52.016 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:52.013+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:52.019 INFO:teuthology.orchestra.run.smithi050.stdout:4105 write 0x612c9cc thru 0x6132721 (0x5d56 bytes) 2024-09-05T17:31:52.022 INFO:teuthology.orchestra.run.smithi050.stdout:4106 write 0x6c5fc5a thru 0x6c64af7 (0x4e9e bytes) 2024-09-05T17:31:52.026 INFO:teuthology.orchestra.run.smithi050.stdout:4107 punch from 0x7c2054c to 0x7c26956, (0x640a bytes) 2024-09-05T17:31:52.026 INFO:teuthology.orchestra.run.smithi050.stdout:4108 read 0x200fd16 thru 0x2013b72 (0x3e5d bytes) 2024-09-05T17:31:52.044 INFO:teuthology.orchestra.run.smithi050.stdout:4109 write 0xecc43f2 thru 0xecc7cff (0x390e bytes) 2024-09-05T17:31:52.050 INFO:teuthology.orchestra.run.smithi050.stdout:4111 write 0x293eae thru 0x29e1ec (0xa33f bytes) 2024-09-05T17:31:52.053 INFO:teuthology.orchestra.run.smithi050.stdout:4112 write 0x2e5637c thru 0x2e5b862 (0x54e7 bytes) 2024-09-05T17:31:52.057 INFO:teuthology.orchestra.run.smithi050.stdout:4113 writesame 0xe4e062e thru 0xe4e8911 data_size 0x2(0x82e4 bytes) 2024-09-05T17:31:52.083 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.084 INFO:teuthology.orchestra.run.smithi050.stdout:4117 write 0x7386b01 thru 0x738862b (0x1b2b bytes) 2024-09-05T17:31:52.087 INFO:teuthology.orchestra.run.smithi050.stdout:4118 write 0x9b400bc thru 0x9b4f5f3 (0xf538 bytes) 2024-09-05T17:31:52.095 INFO:teuthology.orchestra.run.smithi050.stdout:4119 punch from 0x3a3e95 to 0x3af52f, (0xb69a bytes) 2024-09-05T17:31:52.095 INFO:teuthology.orchestra.run.smithi050.stdout:4120 punch from 0xe59dc7a to 0xe5a37ae, (0x5b34 bytes) 2024-09-05T17:31:52.095 INFO:teuthology.orchestra.run.smithi050.stdout:4122 write 0xc5c723a thru 0xc5d3e07 (0xcbce bytes) 2024-09-05T17:31:52.098 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.098 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.098 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.098 INFO:teuthology.orchestra.run.smithi050.stdout:4126 write 0x1f5eb52 thru 0x1f6d3b5 (0xe864 bytes) 2024-09-05T17:31:52.102 INFO:teuthology.orchestra.run.smithi050.stdout:4127 write 0xd12bca0 thru 0xd13b884 (0xfbe5 bytes) 2024-09-05T17:31:52.105 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.105 INFO:teuthology.orchestra.run.smithi050.stdout:truncating to largest ever: 0xee17fd7 2024-09-05T17:31:52.105 INFO:teuthology.orchestra.run.smithi050.stdout:4129 trunc from 0xecc7d00 to 0xee17fd7 2024-09-05T17:31:52.116 INFO:teuthology.orchestra.run.smithi050.stdout:4130 read 0x31842ab thru 0x3193aef (0xf845 bytes) 2024-09-05T17:31:52.116 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.116 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.116 INFO:teuthology.orchestra.run.smithi050.stdout:4135 write 0x7710fb9 thru 0x7717efe (0x6f46 bytes) 2024-09-05T17:31:52.117 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:52.117+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:52.122 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:52.122 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:52.122 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:52.139 INFO:teuthology.orchestra.run.smithi050.stdout:4136 trunc from 0xee17fd7 to 0xf77403 2024-09-05T17:31:52.148 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:52.166 INFO:teuthology.orchestra.run.smithi050.stdout:4137 writesame 0x77b7d6 thru 0x785cc6 data_size 0x19(0xa4f1 bytes) 2024-09-05T17:31:52.202 INFO:teuthology.orchestra.run.smithi050.stdout:4138 writesame 0xe0118d8 thru 0xe01c37c data_size 0x1(0xaaa5 bytes) 2024-09-05T17:31:52.202 INFO:teuthology.orchestra.run.smithi050.stdout:4139 write 0x61c606a thru 0x61c742c (0x13c3 bytes) 2024-09-05T17:31:52.208 INFO:teuthology.orchestra.run.smithi050.stdout:4140 write 0x504f37f thru 0x505820d (0x8e8f bytes) 2024-09-05T17:31:52.214 INFO:teuthology.orchestra.run.smithi050.stdout:4141 write 0xa353fee thru 0xa359fe1 (0x5ff4 bytes) 2024-09-05T17:31:52.219 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:52.217+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:52.222 INFO:teuthology.orchestra.run.smithi050.stdout:4142 read 0xcc4f71f thru 0xcc5909f (0x9981 bytes) 2024-09-05T17:31:52.222 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.222 INFO:teuthology.orchestra.run.smithi050.stdout:4144 punch from 0xc70df70 to 0xc70f957, (0x19e7 bytes) 2024-09-05T17:31:52.222 INFO:teuthology.orchestra.run.smithi050.stdout:4145 punch from 0x462790b to 0x46284f6, (0xbeb bytes) 2024-09-05T17:31:52.223 INFO:teuthology.orchestra.run.smithi050.stdout:4146 read 0xcbd0b90 thru 0xcbd2824 (0x1c95 bytes) 2024-09-05T17:31:52.233 INFO:teuthology.orchestra.run.smithi050.stdout:4147 trunc from 0xe01c37d to 0x72367c0 2024-09-05T17:31:52.276 INFO:teuthology.orchestra.run.smithi050.stdout:4148 write 0xdc268d8 thru 0xdc2d3f9 (0x6b22 bytes) 2024-09-05T17:31:52.284 INFO:teuthology.orchestra.run.smithi050.stdout:4150 write 0x1b5944e thru 0x1b62e1f (0x99d2 bytes) 2024-09-05T17:31:52.288 INFO:teuthology.orchestra.run.smithi050.stdout:4151 read 0x929cdea thru 0x92a4371 (0x7588 bytes) 2024-09-05T17:31:52.289 INFO:teuthology.orchestra.run.smithi050.stdout:4154 read 0xcbe1bc0 thru 0xcbf032b (0xe76c bytes) 2024-09-05T17:31:52.289 INFO:teuthology.orchestra.run.smithi050.stdout:4155 write 0x647433b thru 0x6474653 (0x319 bytes) 2024-09-05T17:31:52.291 INFO:teuthology.orchestra.run.smithi050.stdout:4156 writesame 0x1cd15d0 thru 0x1cd3a90 data_size 0x1(0x24c1 bytes) 2024-09-05T17:31:52.302 INFO:teuthology.orchestra.run.smithi050.stdout:4158 read 0x8a694cc thru 0x8a758fe (0xc433 bytes) 2024-09-05T17:31:52.302 INFO:teuthology.orchestra.run.smithi050.stdout:4159 write 0x6fb6bd thru 0x700236 (0x4b7a bytes) 2024-09-05T17:31:52.302 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219653061999999, 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.303 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:52.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:31:52.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.309 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.309 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:52.309 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219624646, 2024-09-05T17:31:52.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:31:52.309 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:31:52.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219602719999997, 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.314 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:31:52.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:31:52.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:31:52.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:31:52.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:31:52.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219581273000003, 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:31:52.321 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:52.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:31:52.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219542982999997, 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:31:52.326 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:31:52.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:31:52.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:31:52.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219528167, 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.331 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:31:52.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:31:52.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219516968000001, 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.336 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:31:52.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219506129000003, 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.341 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219495651999999, 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:31:52.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219484829999999, 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.351 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:31:52.355 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219474429999998, 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:31:52.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219456078, 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:31:52.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:31:52.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.219272453999999, 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:31:52.365 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:31:52.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.210613160000001, 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:52.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:31:52.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:31:52.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.210572618999997, 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:31:52.375 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:31:52.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.210532790000002, 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:31:52.380 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:31:52.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.384 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.210505314999999, 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.385 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:31:52.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.210466805999999, 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.390 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.210424066000002, 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:31:52.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:31:52.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:31:52.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.809145852, 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:31:52.400 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:52.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:31:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:31:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:31:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:31:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:31:52.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:31:52.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:31:52.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:31:52.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:31:52.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.409 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.409 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.409 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:52.411 INFO:teuthology.orchestra.run.smithi050.stdout:4160 read 0xc42ac49 thru 0xc42f0ec (0x44a4 bytes) 2024-09-05T17:31:52.411 INFO:teuthology.orchestra.run.smithi050.stdout:4161 punch from 0xad52193 to 0xad5fe5b, (0xdcc8 bytes) 2024-09-05T17:31:52.411 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.412 INFO:teuthology.orchestra.run.smithi050.stdout:4164 read 0x983e1c thru 0x98f124 (0xb309 bytes) 2024-09-05T17:31:52.412 INFO:teuthology.orchestra.run.smithi050.stdout:4165 write 0x4dc6010 thru 0x4dd4fec (0xefdd bytes) 2024-09-05T17:31:52.412 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:4167 write 0xdf311dc thru 0xdf3a196 (0x8fbb bytes) 2024-09-05T17:31:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:4168 writesame 0x296735a thru 0x29680f4 data_size 0x1b(0xd9b bytes) 2024-09-05T17:31:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:4170 write 0xae491f4 thru 0xae52ab2 (0x98bf bytes) 2024-09-05T17:31:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.416 INFO:teuthology.orchestra.run.smithi050.stdout:4172 trunc from 0xdf3a197 to 0x627d24e 2024-09-05T17:31:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:4173 writesame 0x782825e thru 0x7833950 data_size 0x5f(0xb6f3 bytes) 2024-09-05T17:31:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:4174 trunc from 0x7833951 to 0x81430e0 2024-09-05T17:31:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:4175 punch from 0x1f7989a to 0x1f85466, (0xbbcc bytes) 2024-09-05T17:31:52.417 INFO:teuthology.orchestra.run.smithi050.stdout:4176 write 0x6d0e331 thru 0x6d134b9 (0x5189 bytes) 2024-09-05T17:31:52.418 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:52.409+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:52.435 INFO:teuthology.orchestra.run.smithi050.stdout:4177 write 0xb0115db thru 0xb01b1d6 (0x9bfc bytes) 2024-09-05T17:31:52.442 INFO:teuthology.orchestra.run.smithi050.stdout:4179 writesame 0x6659be4 thru 0x665e335 data_size 0x3(0x4752 bytes) 2024-09-05T17:31:52.452 INFO:teuthology.orchestra.run.smithi050.stdout:4182 punch from 0xa416091 to 0xa4247fa, (0xe769 bytes) 2024-09-05T17:31:52.453 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.453 INFO:teuthology.orchestra.run.smithi050.stdout:4184 write 0x3afba65 thru 0x3afcfe3 (0x157f bytes) 2024-09-05T17:31:52.471 INFO:teuthology.orchestra.run.smithi050.stdout:4185 trunc from 0xb01b1d7 to 0x563f2d5 2024-09-05T17:31:52.497 INFO:teuthology.orchestra.run.smithi050.stdout:4186 trunc from 0x563f2d5 to 0x47051fa 2024-09-05T17:31:52.511 INFO:teuthology.orchestra.run.smithi050.stdout:4187 read 0x1039fa1 thru 0x1049a50 (0xfab0 bytes) 2024-09-05T17:31:52.511 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:52.509+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:52.520 INFO:teuthology.orchestra.run.smithi050.stdout:4188 trunc from 0x47051fa to 0x86a9f71 2024-09-05T17:31:52.532 INFO:teuthology.orchestra.run.smithi050.stdout:4190 write 0x318b8f6 thru 0x31918c5 (0x5fd0 bytes) 2024-09-05T17:31:52.535 INFO:teuthology.orchestra.run.smithi050.stdout:4191 punch from 0x4883578 to 0x488cdb7, (0x983f bytes) 2024-09-05T17:31:52.535 INFO:teuthology.orchestra.run.smithi050.stdout:4192 writesame 0x398d9b2 thru 0x399560d data_size 0x2a(0x7c5c bytes) 2024-09-05T17:31:52.543 INFO:teuthology.orchestra.run.smithi050.stdout:4193 write 0x4fc5584 thru 0x4fd36d7 (0xe154 bytes) 2024-09-05T17:31:52.549 INFO:teuthology.orchestra.run.smithi050.stdout:4194 punch from 0x4db8d28 to 0x4dc1ae1, (0x8db9 bytes) 2024-09-05T17:31:52.549 INFO:teuthology.orchestra.run.smithi050.stdout:4195 read 0x6c18cf9 thru 0x6c28044 (0xf34c bytes) 2024-09-05T17:31:52.549 INFO:teuthology.orchestra.run.smithi050.stdout:4196 write 0x4b7bde7 thru 0x4b87a3a (0xbc54 bytes) 2024-09-05T17:31:52.553 INFO:teuthology.orchestra.run.smithi050.stdout:4197 read 0x3ba0402 thru 0x3baac2c (0xa82b bytes) 2024-09-05T17:31:52.554 INFO:teuthology.orchestra.run.smithi050.stdout:4198 write 0x5a192c5 thru 0x5a1f694 (0x63d0 bytes) 2024-09-05T17:31:52.557 INFO:teuthology.orchestra.run.smithi050.stdout:4200 write 0x81bc021 thru 0x81c8dce (0xcdae bytes) 2024-09-05T17:31:52.565 INFO:teuthology.orchestra.run.smithi050.stdout:4201 read 0x75311e7 thru 0x753b03d (0x9e57 bytes) 2024-09-05T17:31:52.566 INFO:teuthology.orchestra.run.smithi050.stdout:4202 write 0x5c640c2 thru 0x5c6cce1 (0x8c20 bytes) 2024-09-05T17:31:52.569 INFO:teuthology.orchestra.run.smithi050.stdout:4203 punch from 0x338ac6a to 0x3392684, (0x7a1a bytes) 2024-09-05T17:31:52.569 INFO:teuthology.orchestra.run.smithi050.stdout:4204 read 0x605c858 thru 0x605de3a (0x15e3 bytes) 2024-09-05T17:31:52.579 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:52.579 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:52.579 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:52.579 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:52.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:52.597 INFO:teuthology.orchestra.run.smithi050.stdout:4205 writesame 0xeb58ba9 thru 0xeb5c5dc data_size 0x32(0x3a34 bytes) 2024-09-05T17:31:52.597 INFO:teuthology.orchestra.run.smithi050.stdout:4206 read 0x5e2a57c thru 0x5e3961f (0xf0a4 bytes) 2024-09-05T17:31:52.598 INFO:teuthology.orchestra.run.smithi050.stdout:4207 read 0xc92f64e thru 0xc938618 (0x8fcb bytes) 2024-09-05T17:31:52.599 INFO:teuthology.orchestra.run.smithi050.stdout:4208 writesame 0xe20f6be thru 0xe218616 data_size 0x1(0x8f59 bytes) 2024-09-05T17:31:52.613 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:52.613+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:52.650 INFO:teuthology.orchestra.run.smithi050.stdout:4209 punch from 0x175412c to 0x1755816, (0x16ea bytes) 2024-09-05T17:31:52.651 INFO:teuthology.orchestra.run.smithi050.stdout:4210 read 0x1ff4922 thru 0x1ffd741 (0x8e20 bytes) 2024-09-05T17:31:52.651 INFO:teuthology.orchestra.run.smithi050.stdout:4211 read 0x49bdaad thru 0x49c7d31 (0xa285 bytes) 2024-09-05T17:31:52.652 INFO:teuthology.orchestra.run.smithi050.stdout:4212 write 0x787f4bc thru 0x788697b (0x74c0 bytes) 2024-09-05T17:31:52.656 INFO:teuthology.orchestra.run.smithi050.stdout:4214 read 0x7b8d629 thru 0x7b976fd (0xa0d5 bytes) 2024-09-05T17:31:52.681 INFO:teuthology.orchestra.run.smithi050.stdout:4216 trunc from 0xeb5c5dd to 0xb43fdb 2024-09-05T17:31:52.714 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:52.713+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:52.731 INFO:teuthology.orchestra.run.smithi050.stdout:4217 trunc from 0xb43fdb to 0xde58ca6 2024-09-05T17:31:52.745 INFO:teuthology.orchestra.run.smithi050.stdout:4218 trunc from 0xde58ca6 to 0xc69eb7d 2024-09-05T17:31:52.756 INFO:teuthology.orchestra.run.smithi050.stdout:4219 write 0xd9ec1c thru 0xd9ecc6 (0xab bytes) 2024-09-05T17:31:52.759 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:52.759 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:52.759 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:52.759 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:52.759 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:52.781 INFO:teuthology.orchestra.run.smithi050.stdout:4220 trunc from 0xc69eb7d to 0x933acb 2024-09-05T17:31:52.792 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:52.814 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:52.813+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:52.819 INFO:teuthology.orchestra.run.smithi050.stdout:4221 writesame 0x8b67143 thru 0x8b6e9d9 data_size 0x1(0x7897 bytes) 2024-09-05T17:31:52.819 INFO:teuthology.orchestra.run.smithi050.stdout:4222 read 0xfe0b4 thru 0x105c0d (0x7b5a bytes) 2024-09-05T17:31:52.820 INFO:teuthology.orchestra.run.smithi050.stdout:4223 write 0x42d3854 thru 0x42e08be (0xd06b bytes) 2024-09-05T17:31:52.827 INFO:teuthology.orchestra.run.smithi050.stdout:4226 read 0x650dc0b thru 0x6512224 (0x461a bytes) 2024-09-05T17:31:52.827 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.827 INFO:teuthology.orchestra.run.smithi050.stdout:4229 writesame 0x7b39328 thru 0x7b39982 data_size 0x1(0x65b bytes) 2024-09-05T17:31:52.834 INFO:teuthology.orchestra.run.smithi050.stdout:4230 read 0x6c5141 thru 0x6ce360 (0x9220 bytes) 2024-09-05T17:31:52.845 INFO:teuthology.orchestra.run.smithi050.stdout:4231 trunc from 0x8b6e9da to 0x2df275f 2024-09-05T17:31:52.881 INFO:teuthology.orchestra.run.smithi050.stdout:4232 writesame 0x66ba037 thru 0x66c3d04 data_size 0x1(0x9cce bytes) 2024-09-05T17:31:52.881 INFO:teuthology.orchestra.run.smithi050.stdout:4234 read 0x24ab78f thru 0x24b1a25 (0x6297 bytes) 2024-09-05T17:31:52.882 INFO:teuthology.orchestra.run.smithi050.stdout:4235 read 0x4e63afb thru 0x4e6ad42 (0x7248 bytes) 2024-09-05T17:31:52.882 INFO:teuthology.orchestra.run.smithi050.stdout:4236 read 0x30a8d39 thru 0x30b5e7f (0xd147 bytes) 2024-09-05T17:31:52.904 INFO:teuthology.orchestra.run.smithi050.stdout:4237 writesame 0xe06cf41 thru 0xe078b3e data_size 0x27(0xbbfe bytes) 2024-09-05T17:31:52.904 INFO:teuthology.orchestra.run.smithi050.stdout:4239 writesame 0x437b7e thru 0x438af8 data_size 0x1(0xf7b bytes) 2024-09-05T17:31:52.907 INFO:teuthology.orchestra.run.smithi050.stdout:4240 punch from 0x8257a4a to 0x825992b, (0x1ee1 bytes) 2024-09-05T17:31:52.907 INFO:teuthology.orchestra.run.smithi050.stdout:4241 read 0xc5497df thru 0xc550f52 (0x7774 bytes) 2024-09-05T17:31:52.908 INFO:teuthology.orchestra.run.smithi050.stdout:4242 writesame 0x718a1f9 thru 0x71945e1 data_size 0x47(0xa3e9 bytes) 2024-09-05T17:31:52.914 INFO:teuthology.orchestra.run.smithi050.stdout:4243 writesame 0xb1c3443 thru 0xb1c4ed6 data_size 0xe(0x1a94 bytes) 2024-09-05T17:31:52.915 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:52.913+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:52.921 INFO:teuthology.orchestra.run.smithi050.stdout:4244 punch from 0xb6aae2d to 0xb6b9cf8, (0xeecb bytes) 2024-09-05T17:31:52.921 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:52.927 INFO:teuthology.orchestra.run.smithi050.stdout:4247 trunc from 0xe078b3f to 0xb5aba9e 2024-09-05T17:31:52.939 INFO:teuthology.orchestra.run.smithi050.stdout:4248 write 0x761a76f thru 0x761b4bc (0xd4e bytes) 2024-09-05T17:31:52.947 INFO:teuthology.orchestra.run.smithi050.stdout:4249 write 0x3406eeb thru 0x34095f5 (0x270b bytes) 2024-09-05T17:31:52.957 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:52.957 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:52.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:52.957 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:52.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.957 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15042 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8564736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.957 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194808266999999, 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054711072999999999, 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15042 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763432+0000", 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:52.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763434+0000", 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3910000000000001e-06 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763441+0000", 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1130000000000003e-06 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763449+0000", 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4059999999999999e-06 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.817943+0000", 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054494611999999998 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818037+0000", 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3430999999999994e-05 2024-09-05T17:31:52.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818143+0000", 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010574 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15043 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8581120~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:52.962 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194783512000001, 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054839756000000003, 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15043 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763456+0000", 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763457+0000", 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9700000000000002e-07 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763459+0000", 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2079999999999999e-06 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763466+0000", 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4869999999999996e-06 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763472+0000", 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4099999999999999e-06 2024-09-05T17:31:52.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818179+0000", 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054706751999999997 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818235+0000", 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6433e-05 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818296+0000", 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1068999999999994e-05 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15044 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8597504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194760160000001, 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055068822000000003, 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15044 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763480+0000", 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763482+0000", 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3120000000000001e-06 2024-09-05T17:31:52.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763489+0000", 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8020000000000003e-06 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763494+0000", 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.276e-06 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818342+0000", 2024-09-05T17:31:52.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054847104000000001 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818431+0000", 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9835999999999998e-05 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818548+0000", 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011708499999999999 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15045 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8613888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194737906999997, 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055286647000000001, 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15045 2024-09-05T17:31:52.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763502+0000", 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763505+0000", 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763511+0000", 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.533e-06 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763517+0000", 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3979999999999998e-06 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818594+0000", 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055077706999999997 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818679+0000", 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4797999999999997e-05 2024-09-05T17:31:52.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818789+0000", 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109369 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15046 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8630272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194701045999999, 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055492107999999998, 2024-09-05T17:31:52.976 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15046 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763539+0000", 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5699999999999998e-07 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763542+0000", 2024-09-05T17:31:52.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6860000000000002e-06 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763550+0000", 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9859999999999994e-06 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763556+0000", 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0610000000000001e-06 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818833+0000", 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055276618 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.818932+0000", 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9474000000000003e-05 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819031+0000", 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8826000000000006e-05 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15047 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8646656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194674769000002, 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055685474999999998, 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15047 2024-09-05T17:31:52.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763565+0000", 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763566+0000", 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763568+0000", 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7049999999999999e-06 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763576+0000", 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6340000000000001e-06 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763581+0000", 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.519e-06 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819078+0000", 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055496668999999998 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819175+0000", 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6883000000000001e-05 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819250+0000", 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5462000000000004e-05 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15048 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8663040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194649851999998, 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055952927999999999, 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15048 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763590+0000", 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3599999999999999e-07 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763593+0000", 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6589999999999999e-06 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763600+0000", 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0879999999999997e-06 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763607+0000", 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6649999999999997e-06 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819308+0000", 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055701181000000002 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819418+0000", 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109755 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819543+0000", 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012514399999999999 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.989 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15049 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8679424~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194624836000003, 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056101897999999997, 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15049 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763615+0000", 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.63e-07 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763618+0000", 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5959999999999998e-06 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763625+0000", 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9879999999999998e-06 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763631+0000", 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6069999999999998e-06 2024-09-05T17:31:52.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819610+0000", 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055979244999999997 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819655+0000", 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5488999999999998e-05 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819717+0000", 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1509999999999999e-05 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15050 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8695808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194596525000001, 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056583593000000001, 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.994 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15050 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763643+0000", 2024-09-05T17:31:52.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763644+0000", 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2600000000000002e-07 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763647+0000", 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:52.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763654+0000", 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0119999999999999e-06 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763659+0000", 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639999999999997e-06 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.819747+0000", 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056088302 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820111+0000", 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00036350299999999999 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820227+0000", 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011605 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15051 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8712192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:52.998 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194572639999997, 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056866834999999998, 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15051 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:52.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763667+0000", 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763668+0000", 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7899999999999999e-07 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763670+0000", 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3580000000000001e-06 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763677+0000", 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9809999999999997e-06 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763682+0000", 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3499999999999996e-06 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820263+0000", 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056581285000000002 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820427+0000", 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016371100000000001 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820534+0000", 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106771 2024-09-05T17:31:53.002 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15052 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8728576~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194550098999997, 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057071953000000002, 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.003 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15052 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763690+0000", 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9099999999999999e-07 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763692+0000", 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.092e-06 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763699+0000", 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5470000000000002e-06 2024-09-05T17:31:53.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763704+0000", 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1039999999999998e-06 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820568+0000", 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.056863805000000003 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820665+0000", 2024-09-05T17:31:53.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7090999999999996e-05 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820762+0000", 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6922999999999993e-05 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15053 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8744960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194528106, 2024-09-05T17:31:53.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057269911999999999, 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15053 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:53.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763712+0000", 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8000000000000001e-07 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763714+0000", 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3489999999999999e-06 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763721+0000", 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3119999999999999e-06 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763725+0000", 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.741e-06 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820794+0000", 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057069021999999997 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820883+0000", 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8739999999999994e-05 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.820982+0000", 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8368000000000004e-05 2024-09-05T17:31:53.011 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15054 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8761344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194505247000002, 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057438612999999999, 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15054 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763735+0000", 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2e-07 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763737+0000", 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4140000000000001e-06 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763744+0000", 2024-09-05T17:31:53.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8279999999999997e-06 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763755+0000", 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1126e-05 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821013+0000", 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057257844000000002 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821087+0000", 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3651000000000003e-05 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821173+0000", 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6329999999999995e-05 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.016 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15055 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8777728~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194477648000003, 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.05769469, 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15055 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763762+0000", 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763763+0000", 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0600000000000001e-07 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763765+0000", 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.12e-06 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763770+0000", 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8209999999999998e-06 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763777+0000", 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999999e-06 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821205+0000", 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057428078 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821292+0000", 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6842000000000006e-05 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821457+0000", 2024-09-05T17:31:53.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016531299999999999 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15056 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8794112~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194455798, 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057974700999999997, 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15056 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763784+0000", 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9299999999999999e-07 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763786+0000", 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1229999999999998e-06 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763794+0000", 2024-09-05T17:31:53.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1590000000000004e-06 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763799+0000", 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9309999999999999e-06 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821490+0000", 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057691872999999998 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821616+0000", 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125327 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821759+0000", 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014289500000000001 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15057 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8810496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:53.025 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194434194999999, 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058215998999999997, 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15057 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:53.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763806+0000", 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4300000000000003e-07 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763808+0000", 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0379999999999998e-06 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763816+0000", 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9030000000000004e-06 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763821+0000", 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0429999999999998e-06 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821799+0000", 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.057977385999999999 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.821909+0000", 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000110801 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822022+0000", 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000112185 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15058 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 8826880~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.194395917999998, 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.058413768999999997, 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15058 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.763844+0000", 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770678+0000", 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0068342020000000002 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770685+0000", 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.063e-06 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770696+0000", 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1225e-05 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770704+0000", 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3880000000000002e-06 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822073+0000", 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.051369608999999997 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822153+0000", 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9225000000000001e-05 2024-09-05T17:31:53.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.822258+0000", 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010505699999999999 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15079 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9170944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.187258937000003, 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054753171000000003, 2024-09-05T17:31:53.034 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15079 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770981+0000", 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7500000000000001e-07 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770982+0000", 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:31:53.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770986+0000", 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.225e-06 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.770989+0000", 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825631+0000", 2024-09-05T17:31:53.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054642257999999999 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825680+0000", 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9026000000000001e-05 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825734+0000", 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4218000000000002e-05 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15080 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9187328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.187230088, 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054872632999999997, 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15080 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771010+0000", 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8599999999999999e-07 2024-09-05T17:31:53.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771012+0000", 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.57e-06 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771016+0000", 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1919999999999998e-06 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771019+0000", 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0790000000000001e-06 2024-09-05T17:31:53.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825770+0000", 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054750974000000001 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825820+0000", 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9873999999999997e-05 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825882+0000", 2024-09-05T17:31:53.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2558000000000007e-05 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:15081 3.19 3:9e8034da:::rbd_data.11403f2d9bbd.0000000000000003:6 [read 9203712~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 53.187206897999999, 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054991252999999997, 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:53.043 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 15081 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.771033+0000", 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778817+0000", 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0077838489999999998 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778822+0000", 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9910000000000002e-06 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778831+0000", 2024-09-05T17:31:53.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2089999999999994e-06 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.778837+0000", 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8289999999999996e-06 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825928+0000", 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047091230999999997 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.825972+0000", 2024-09-05T17:31:53.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3964000000000001e-05 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.826024+0000", 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2179999999999998e-05 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.047 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:53.049 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:53.050 INFO:teuthology.orchestra.run.smithi050.stdout:4250 write 0xec14077 thru 0xec1469d (0x627 bytes) 2024-09-05T17:31:53.050 INFO:teuthology.orchestra.run.smithi050.stdout:4251 trunc from 0xec1469e to 0x852c99c 2024-09-05T17:31:53.050 INFO:teuthology.orchestra.run.smithi050.stdout:4252 read 0x78ee8aa thru 0x78f3509 (0x4c60 bytes) 2024-09-05T17:31:53.050 INFO:teuthology.orchestra.run.smithi050.stdout:4253 trunc from 0x852c99c to 0xc70e283 2024-09-05T17:31:53.050 INFO:teuthology.orchestra.run.smithi050.stdout:4255 write 0x46429e4 thru 0x464fb6a (0xd187 bytes) 2024-09-05T17:31:53.050 INFO:teuthology.orchestra.run.smithi050.stdout:4256 read 0x4f77423 thru 0x4f86a3d (0xf61b bytes) 2024-09-05T17:31:53.050 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:53.049+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:53.051 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:53.051 INFO:teuthology.orchestra.run.smithi050.stdout:4258 clone 26 order 23 su 1048576 sc 4 2024-09-05T17:31:53.150 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:53.149+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:53.181 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:53.181 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:53.181 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:53.181 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:53.197 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:53.251 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:53.249+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:53.325 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:53.325 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:53.325 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:53.325 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:53.325 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:53.341 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:53.352 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:53.353+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:53.453 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:53.453+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:53.463 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:53.463 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.217701339000001, 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:31:53.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:31:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:31:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:31:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:31:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:31:53.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:31:53.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.469 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:27439 3.9 e36/24 3:93bcc82a:::rbd_object_map.1140f3505917:head v 36'228, mlcod=36'226)", 2024-09-05T17:31:53.470 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 48.886898948000002, 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031113629999999998, 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577116+0000", 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577119+0000", 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7549999999999999e-06 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577132+0000", 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3699e-05 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577165+0000", 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2645999999999999e-05 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577181+0000", 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5764999999999999e-05 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577311+0000", 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013032399999999999 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.577375+0000", 2024-09-05T17:31:53.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3532000000000001e-05 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580116+0000", 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027411520000000002 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:04.580227+0000", 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011149 2024-09-05T17:31:53.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:34899 3.4 e40/24 3:21eb45c5:::rbd_data.11404462ede9.0000000000000026:head v 40'111, mlcod=40'109)", 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.860597495, 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003148802, 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603417+0000", 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603420+0000", 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8200000000000001e-06 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603437+0000", 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6891000000000001e-05 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603479+0000", 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2222999999999999e-05 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603501+0000", 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1297999999999998e-05 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603838+0000", 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033740899999999999 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.603900+0000", 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2150000000000006e-05 2024-09-05T17:31:53.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.606418+0000", 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0025176560000000001 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:10.606566+0000", 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148355 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:31:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.696758488999997, 2024-09-05T17:31:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:31:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:31:53.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:31:53.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:31:53.486 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.492800589000002, 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:31:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:31:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:31:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:31:53.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:31:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:31:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50307 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'168, mlcod=52'165)", 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.973249+0000", 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.490765460999999, 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031669549999999999, 2024-09-05T17:31:53.492 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.973249+0000", 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.973249+0000", 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.973251+0000", 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.79e-06 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.973268+0000", 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6671999999999999e-05 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.973302+0000", 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3893999999999998e-05 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.973331+0000", 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9190999999999999e-05 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.973404+0000", 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3292000000000002e-05 2024-09-05T17:31:53.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.973491+0000", 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7137000000000003e-05 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.976308+0000", 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00281687 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.976416+0000", 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108109 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.25480576, 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.497 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:31:53.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:31:53.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:31:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:31:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:31:53.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:31:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:31:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.24179122, 2024-09-05T17:31:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:31:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.504 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:31:53.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.239527290000002, 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:31:53.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.513 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.237435516000001, 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:31:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:31:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:31:53.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50790 3.4 e53/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 53'254, mlcod=53'251)", 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.921678+0000", 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.542337284999999, 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029105849999999998, 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.519 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.921678+0000", 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.921678+0000", 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.921679+0000", 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9400000000000001e-06 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.921694+0000", 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4836e-05 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.921729+0000", 2024-09-05T17:31:53.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4448e-05 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.921746+0000", 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7258999999999999e-05 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.921889+0000", 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143337 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.921945+0000", 2024-09-05T17:31:53.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5269000000000002e-05 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.924522+0000", 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002577064 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.924588+0000", 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6432000000000004e-05 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.523 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51735 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'202, mlcod=54'198)", 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.326121554, 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032394590000000001, 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137895+0000", 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4780000000000001e-06 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137904+0000", 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137926+0000", 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1013999999999999e-05 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137939+0000", 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.342e-05 2024-09-05T17:31:53.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138024+0000", 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5167000000000006e-05 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138055+0000", 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0982000000000003e-05 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.140997+0000", 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029416329999999999 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141133+0000", 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013600799999999999 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51736 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'203, mlcod=54'199)", 2024-09-05T17:31:53.528 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.324456217000002, 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003209534, 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139560+0000", 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5629999999999999e-06 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139573+0000", 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2595999999999999e-05 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139599+0000", 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6188999999999999e-05 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139616+0000", 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7356000000000001e-05 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139775+0000", 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158763 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139835+0000", 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.037e-05 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.142662+0000", 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00282636 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.142768+0000", 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106337 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:31:53.533 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 25.322647046, 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:31:53.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.930506058000001, 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.538 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:31:53.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:31:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:31:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:31:53.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.545 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54994 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'375, mlcod=60'373)", 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.914123418999999, 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032305459999999999, 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:31:53.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549893+0000", 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549906+0000", 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2974e-05 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549936+0000", 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0079000000000001e-05 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549954+0000", 2024-09-05T17:31:53.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7912999999999999e-05 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550156+0000", 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149400000000001 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550246+0000", 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0470000000000006e-05 2024-09-05T17:31:53.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553025+0000", 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027789780000000001 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553122+0000", 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6804000000000004e-05 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.908867909, 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGPush(3.1f 62/61 [PushOp(3:fde5eed2:::rbd_data.1140d4ae3aec.0000000000000004:5, version: 31'69, data_included: [0~146667,147456~16384,184320~16384,221184~16384,258048~266240], data_size: 462059, omap_header_size: 0, omap_entries_size: 0, attrset_size: 1, recovery_info: ObjectRecoveryInfo(3:fde5eed2:::rbd_data.1140d4ae3aec.0000000000000004:5@31'69, size: 786432, copy_subset: [(0, 786432)], clone_subset: {}, snapset: 5=[]:{5: [5]}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 786432, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.596998+0000", 2024-09-05T17:31:53.555 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.867016529000001, 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0031618729999999999, 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.596998+0000", 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.596998+0000", 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.597001+0000", 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.503e-06 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.597576+0000", 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057499299999999999 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.597621+0000", 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5142999999999998e-05 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.597656+0000", 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4721999999999997e-05 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.597812+0000", 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015644699999999999 2024-09-05T17:31:53.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.597834+0000", 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2238e-05 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.600160+0000", 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0023258269999999999 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGPush(3.1f 62/61 [PushOp(3:f8347a44:::rbd_data.114076cffc4f.0000000000000005:head, version: 51'175, data_included: [0~786432,1048576~262144], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:f8347a44:::rbd_data.114076cffc4f.0000000000000005:head@51'175, size: 1310720, copy_subset: [(0, 1310720)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 1310720, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.663198+0000", 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.800816598000001, 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0030006429999999999, 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.663198+0000", 2024-09-05T17:31:53.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.663198+0000", 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.663200+0000", 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7010000000000001e-06 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.664222+0000", 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001022174 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.664252+0000", 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9453000000000001e-05 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.664267+0000", 2024-09-05T17:31:53.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5784999999999999e-05 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.664404+0000", 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136885 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.664423+0000", 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9091000000000001e-05 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.666199+0000", 2024-09-05T17:31:53.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017755539999999999 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.332668028000001, 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:53.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:53.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:53.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:31:53.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:53.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:31:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:31:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:53.569 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:53.569 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:53.569 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:53.571 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:53.572 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:53.569+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:53.672 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:53.669+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:53.741 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:53.742 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:53.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:53.777 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:53.777 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:53.777 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:53.777+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:53.794 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:53.794 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:53.811 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:53.811 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:53.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:53.828 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:53.854 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:53.854 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:53.873 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:53.873+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:53.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:31:53.879 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:53.879 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:53.879 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:53.879 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:53.901 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:53.910 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:53.910 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:53.934 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:53.934 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:53.949 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone25 from 0xc70e283 (overlap 0x933acb) to 0x2c2b3c 2024-09-05T17:31:53.975 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:53.973+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:54.044 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:54.044 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:54.053 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-05T17:31:54.060 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:54.109 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:54.109+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:54.177 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:54.177+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:54.202 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:54.202 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:54.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:54.278 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:54.277+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:54.378 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:54.379 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:54.379 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:54.377+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:54.392 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:54.414 INFO:teuthology.orchestra.run.smithi050.stdout:4259 writesame 0x3b53a16 thru 0x3b60081 data_size 0x33(0xc66c bytes) 2024-09-05T17:31:54.427 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:54.428 INFO:teuthology.orchestra.run.smithi050.stdout:4261 writesame 0x3246e22 thru 0x3255d40 data_size 0xa5(0xef1f bytes) 2024-09-05T17:31:54.434 INFO:teuthology.orchestra.run.smithi050.stdout:4262 punch from 0xb1934a5 to 0xb19a164, (0x6cbf bytes) 2024-09-05T17:31:54.434 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:54.449 INFO:teuthology.orchestra.run.smithi050.stdout:4264 writesame 0xeaf5549 thru 0xeaf70ae data_size 0x15(0x1b66 bytes) 2024-09-05T17:31:54.449 INFO:teuthology.orchestra.run.smithi050.stdout:4266 read 0x91286dc thru 0x91371ba (0xeadf bytes) 2024-09-05T17:31:54.449 INFO:teuthology.orchestra.run.smithi050.stdout:4267 write 0x45700b9 thru 0x457a4aa (0xa3f2 bytes) 2024-09-05T17:31:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:4268 punch from 0x8d443ec to 0x8d4474f, (0x363 bytes) 2024-09-05T17:31:54.457 INFO:teuthology.orchestra.run.smithi050.stdout:4270 write 0x4941c1 thru 0x497bfc (0x3a3c bytes) 2024-09-05T17:31:54.468 INFO:teuthology.orchestra.run.smithi050.stdout:4271 write 0x7e9ce0c thru 0x7ea7a5c (0xac51 bytes) 2024-09-05T17:31:54.481 INFO:teuthology.orchestra.run.smithi050.stdout:4272 trunc from 0xeaf70af to 0xb608567 2024-09-05T17:31:54.485 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:54.485+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:54.502 INFO:teuthology.orchestra.run.smithi050.stdout:4274 punch from 0x5377b02 to 0x53870a4, (0xf5a2 bytes) 2024-09-05T17:31:54.502 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:54.512 INFO:teuthology.orchestra.run.smithi050.stdout:4277 trunc from 0xb608567 to 0x5b93f1d 2024-09-05T17:31:54.539 INFO:teuthology.orchestra.run.smithi050.stdout:4278 punch from 0x2f43097 to 0x2f4d3fb, (0xa364 bytes) 2024-09-05T17:31:54.539 INFO:teuthology.orchestra.run.smithi050.stdout:4279 read 0x4abf12f thru 0x4ac7be9 (0x8abb bytes) 2024-09-05T17:31:54.539 INFO:teuthology.orchestra.run.smithi050.stdout:4280 write 0x711d3 thru 0x7977f (0x85ad bytes) 2024-09-05T17:31:54.542 INFO:teuthology.orchestra.run.smithi050.stdout:4281 write 0x1c480ef thru 0x1c49caa (0x1bbc bytes) 2024-09-05T17:31:54.545 INFO:teuthology.orchestra.run.smithi050.stdout:4284 punch from 0x2cfd924 to 0x2d0a4f3, (0xcbcf bytes) 2024-09-05T17:31:54.545 INFO:teuthology.orchestra.run.smithi050.stdout:4286 read 0x19463a7 thru 0x1955257 (0xeeb1 bytes) 2024-09-05T17:31:54.549 INFO:teuthology.orchestra.run.smithi050.stdout:4287 trunc from 0x5b93f1d to 0x4bba1f4 2024-09-05T17:31:54.565 INFO:teuthology.orchestra.run.smithi050.stdout:4288 read 0x2178e9d thru 0x217b008 (0x216c bytes) 2024-09-05T17:31:54.566 INFO:teuthology.orchestra.run.smithi050.stdout:4289 read 0x283a865 thru 0x2846b8f (0xc32b bytes) 2024-09-05T17:31:54.567 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:54.567 INFO:teuthology.orchestra.run.smithi050.stdout:4291 punch from 0x16156a7 to 0x161c05d, (0x69b6 bytes) 2024-09-05T17:31:54.578 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:54.579 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:54.581 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:54.581+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:54.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:54.605 INFO:teuthology.orchestra.run.smithi050.stdout:4292 write 0xdff1613 thru 0xdffb92c (0xa31a bytes) 2024-09-05T17:31:54.613 INFO:teuthology.orchestra.run.smithi050.stdout:4293 trunc from 0xdffb92d to 0xe689703 2024-09-05T17:31:54.624 INFO:teuthology.orchestra.run.smithi050.stdout:4294 clone 27 order 18 su 2048 sc 13 2024-09-05T17:31:54.682 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:54.681+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:54.763 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:54.763 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:54.777 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:54.821 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:54.821+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:54.845 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:31:54.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-05T17:31:54.859 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:31:54.883 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:54.881+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:54.954 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:54.954 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:54.969 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:54.972 INFO:teuthology.orchestra.run.smithi050.stdout:leaving image image_client.0-clone26 intact 2024-09-05T17:31:55.013 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:55.013+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:55.085 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:55.085+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:55.090 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:55.091 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:55.106 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:55.182 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-05T17:31:55.185 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:55.185+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:55.189 INFO:teuthology.orchestra.run.smithi050.stdout:4295 writesame 0xbc7496f thru 0xbc7b123 data_size 0x1(0x67b5 bytes) 2024-09-05T17:31:55.217 INFO:teuthology.orchestra.run.smithi050.stdout:4296 writesame 0x5d371f3 thru 0x5d38fcc data_size 0x1(0x1dda bytes) 2024-09-05T17:31:55.259 INFO:teuthology.orchestra.run.smithi050.stdout:4297 punch from 0xbdcdc70 to 0xbdd9fc9, (0xc359 bytes) 2024-09-05T17:31:55.259 INFO:teuthology.orchestra.run.smithi050.stdout:4298 read 0xb1ee86 thru 0xb233d6 (0x4551 bytes) 2024-09-05T17:31:55.262 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:55.262 INFO:teuthology.orchestra.run.smithi050.stdout:4301 writesame 0x88bcda thru 0x88e037 data_size 0x9(0x235e bytes) 2024-09-05T17:31:55.286 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:55.285+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:55.304 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:55.305 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:55.324 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:55.354 INFO:teuthology.orchestra.run.smithi050.stdout:4303 write 0x61a212 thru 0x61f8f5 (0x56e4 bytes) 2024-09-05T17:31:55.387 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:55.385+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:55.488 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:55.485+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:55.492 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:55.492 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:55.502 INFO:teuthology.orchestra.run.smithi050.stdout:4304 writesame 0x69a959f thru 0x69af460 data_size 0x27(0x5ec2 bytes) 2024-09-05T17:31:55.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:31:55.529 INFO:teuthology.orchestra.run.smithi050.stdout:4305 write 0x7c5111b thru 0x7c59495 (0x837b bytes) 2024-09-05T17:31:55.558 INFO:teuthology.orchestra.run.smithi050.stdout:4306 writesame 0x16403e8 thru 0x1647eb1 data_size 0xd(0x7aca bytes) 2024-09-05T17:31:55.588 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:55.589+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:55.689 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:55.689+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:55.695 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:55.696 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:55.697 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:55.709 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:31:55.713 INFO:teuthology.orchestra.run.smithi050.stdout:4309 trunc from 0xe689703 to 0x39a70ed 2024-09-05T17:31:55.789 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:55.789+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:55.821 INFO:teuthology.orchestra.run.smithi050.stdout:4310 write 0x23d8e5a thru 0x23dee53 (0x5ffa bytes) 2024-09-05T17:31:55.856 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.1 to 1 (10000) 2024-09-05T17:31:55.873 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:55.873 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:55.885 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-05T17:31:55.886 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:31:55.932 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:55.933+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:55.958 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:31:55.989 INFO:teuthology.orchestra.run.smithi050.stdout:4311 write 0x39b9d9 thru 0x39fa38 (0x4060 bytes) 2024-09-05T17:31:55.992 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:55.993+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:56.016 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:56.016 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:56.023 INFO:teuthology.orchestra.run.smithi050.stdout:4312 write 0x8c5bd9f thru 0x8c67419 (0xb67b bytes) 2024-09-05T17:31:56.028 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:31:56.047 INFO:teuthology.orchestra.run.smithi050.stdout:4314 trunc from 0x8c6741a to 0x3bab39b 2024-09-05T17:31:56.061 INFO:teuthology.orchestra.run.smithi050.stdout:4315 read 0x38ee9c3 thru 0x38f23a8 (0x39e6 bytes) 2024-09-05T17:31:56.084 INFO:teuthology.orchestra.run.smithi050.stdout:4318 write 0xdfe044c thru 0xdfe6da7 (0x695c bytes) 2024-09-05T17:31:56.093 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:56.093+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:56.100 INFO:teuthology.orchestra.run.smithi050.stdout:4319 write 0xa6da213 thru 0xa6e08ba (0x66a8 bytes) 2024-09-05T17:31:56.117 INFO:teuthology.orchestra.run.smithi050.stdout:4320 writesame 0x6c11ff4 thru 0x6c1a451 data_size 0x1(0x845e bytes) 2024-09-05T17:31:56.137 INFO:teuthology.orchestra.run.smithi050.stdout:4321 writesame 0x650eb30 thru 0x65140b3 data_size 0x1a(0x5584 bytes) 2024-09-05T17:31:56.149 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:56.149 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:56.158 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:56.158 INFO:teuthology.orchestra.run.smithi050.stdout:4323 read 0x2b6e800 thru 0x2b7ad3c (0xc53d bytes) 2024-09-05T17:31:56.161 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:56.162 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:56.162 INFO:teuthology.orchestra.run.smithi050.stdout:4324 write 0x30c2395 thru 0x30cae7b (0x8ae7 bytes) 2024-09-05T17:31:56.163 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:31:56.207 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:56.209+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:56.216 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:56.216 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:56.254 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:56.254 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:56.264 INFO:teuthology.orchestra.run.smithi050.stdout:4325 write 0xc780391 thru 0xc780932 (0x5a2 bytes) 2024-09-05T17:31:56.269 INFO:teuthology.orchestra.run.smithi050.stdout:4326 write 0xd111fcc thru 0xd1184eb (0x6520 bytes) 2024-09-05T17:31:56.281 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:56.281 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:56.290 INFO:teuthology.orchestra.run.smithi050.stdout:4327 write 0x2db1cae thru 0x2dbe16a (0xc4bd bytes) 2024-09-05T17:31:56.295 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:56.297+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:56.308 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:56.308 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:56.337 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:56.337 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:56.343 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:56.343 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:56.343 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:56.343 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:56.360 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:56.360 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:56.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:31:56.386 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:56.386 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:56.395 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:56.393+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:56.425 INFO:teuthology.orchestra.run.smithi050.stdout:4328 write 0x57fd382 thru 0x5807caa (0xa929 bytes) 2024-09-05T17:31:56.441 INFO:teuthology.orchestra.run.smithi050.stdout:4329 write 0x6e8d8ed thru 0x6e90ca3 (0x33b7 bytes) 2024-09-05T17:31:56.450 INFO:teuthology.orchestra.run.smithi050.stdout:4331 writesame 0xbdc329 thru 0xbe59fe data_size 0x2b(0x96d6 bytes) 2024-09-05T17:31:56.496 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:56.493+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:56.538 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:56.539 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:56.539 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:56.539 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:56.539 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:56.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:31:56.599 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:56.601+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:56.698 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:56.697+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:56.716 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:56.716 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:56.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:56.716 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:56.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.717 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.717 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:56.717 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632744654, 2024-09-05T17:31:56.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:31:56.717 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.718 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.718 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.718 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.718 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:31:56.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.719 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:56.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:56.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:31:56.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:31:56.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:31:56.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:31:56.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:31:56.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:31:56.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:31:56.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:31:56.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:31:56.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:31:56.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:31:56.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:31:56.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:31:56.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:31:56.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.727 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.728 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.728 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:56.728 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632716238, 2024-09-05T17:31:56.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:31:56.728 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.729 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.729 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.729 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.729 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:31:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:31:56.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:31:56.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:31:56.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.734 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632694311999998, 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.735 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:31:56.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:31:56.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632672865000004, 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:31:56.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632634574999997, 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.745 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:56.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632619759000001, 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.750 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:31:56.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632608560000001, 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.755 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:31:56.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.756 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:56.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:31:56.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.760 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.760 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.760 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:56.760 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632597721000003, 2024-09-05T17:31:56.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:31:56.761 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.761 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.761 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.761 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.761 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.761 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:31:56.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.766 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.768 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:56.768 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632587244, 2024-09-05T17:31:56.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:31:56.768 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.768 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.768 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:31:56.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.772 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632576422, 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.773 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:56.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632566021999999, 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:31:56.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632547670000001, 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:31:56.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:31:56.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.787 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.632364045999999, 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:31:56.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:31:56.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.623704752000002, 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:31:56.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.623664210999998, 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:31:56.798 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:56.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:31:56.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.623624382000003, 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:31:56.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:31:56.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.623596907, 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:31:56.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:31:56.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.623558398, 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:31:56.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:31:56.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:31:56.817 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.623515658000002, 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:31:56.818 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.823 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.222237444000001, 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.824 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:56.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:31:56.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:56.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:31:56.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.831 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.832 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:56.832 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:56.832 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:56.833 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:31:56.834 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:56.834 INFO:teuthology.orchestra.run.smithi050.stdout:4335 writesame 0xb16e63e thru 0xb173af9 data_size 0x2c(0x54bc bytes) 2024-09-05T17:31:56.834 INFO:teuthology.orchestra.run.smithi050.stdout:4336 punch from 0xca32679 to 0xca34769, (0x20f0 bytes) 2024-09-05T17:31:56.834 INFO:teuthology.orchestra.run.smithi050.stdout:4337 write 0x2b9c920 thru 0x2ba9901 (0xcfe2 bytes) 2024-09-05T17:31:56.835 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:56.833+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:56.872 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.2 to 1 (10000) 2024-09-05T17:31:56.887 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:31:56.897 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-05T17:31:56.941 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:56.941+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:57.004 INFO:teuthology.orchestra.run.smithi050.stdout:4339 trunc from 0xdfe6da8 to 0x963d3e8 2024-09-05T17:31:57.011 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:57.011 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:57.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.011 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:79393 3.0 3:05b291cb:::rbd_data.1140e4bbd9e2.00000000000002a1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:31:57.011 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:57.012600+0000", 2024-09-05T17:31:57.011 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.001165461, 2024-09-05T17:31:57.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001190132, 2024-09-05T17:31:57.011 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "waiting for sub ops", 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 79393 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012600+0000", 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012600+0000", 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012602+0000", 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.283e-06 2024-09-05T17:31:57.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012607+0000", 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7219999999999996e-06 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012622+0000", 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4452e-05 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012630+0000", 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1750000000000005e-06 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012721+0000", 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1328000000000004e-05 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012817+0000", 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6019000000000003e-05 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 2", 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.012953+0000", 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000136033 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.016 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:79398 3.0 3:0549adb7:::rbd_data.1140e4bbd9e2.00000000000002c0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:57.013614+0000", 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.000151884, 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026895199999999998, 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 79398 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.017 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.013614+0000", 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.013614+0000", 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.013615+0000", 2024-09-05T17:31:57.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.207e-06 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.013620+0000", 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1730000000000003e-06 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.013642+0000", 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1423000000000001e-05 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.013650+0000", 2024-09-05T17:31:57.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5590000000000006e-06 2024-09-05T17:31:57.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.013810+0000", 2024-09-05T17:31:57.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016010500000000001 2024-09-05T17:31:57.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:57.013895+0000", 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4116000000000006e-05 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 2 2024-09-05T17:31:57.021 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:57.031 INFO:teuthology.orchestra.run.smithi050.stdout:4340 read 0x452b839 thru 0x4539a98 (0xe260 bytes) 2024-09-05T17:31:57.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:31:57.044 INFO:teuthology.orchestra.run.smithi050.stdout:4341 write 0xdbc982b thru 0xdbd6cd7 (0xd4ad bytes) 2024-09-05T17:31:57.044 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:57.045+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:57.067 INFO:teuthology.orchestra.run.smithi050.stdout:4343 read 0x40668ce thru 0x4075006 (0xe739 bytes) 2024-09-05T17:31:57.067 INFO:teuthology.orchestra.run.smithi050.stdout:4344 punch from 0x3c754fb to 0x3c811a9, (0xbcae bytes) 2024-09-05T17:31:57.067 INFO:teuthology.orchestra.run.smithi050.stdout:4345 writesame 0x5e61c19 thru 0x5e69c92 data_size 0x37(0x807a bytes) 2024-09-05T17:31:57.095 INFO:teuthology.orchestra.run.smithi050.stdout:4346 write 0xec3fce7 thru 0xec40eab (0x11c5 bytes) 2024-09-05T17:31:57.102 INFO:teuthology.orchestra.run.smithi050.stdout:4348 write 0x989b9fc thru 0x989d25a (0x185f bytes) 2024-09-05T17:31:57.111 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:57.111 INFO:teuthology.orchestra.run.smithi050.stdout:4350 write 0x8c73f7f thru 0x8c78390 (0x4412 bytes) 2024-09-05T17:31:57.127 INFO:teuthology.orchestra.run.smithi050.stdout:4351 read 0x28783d9 thru 0x287d32b (0x4f53 bytes) 2024-09-05T17:31:57.130 INFO:teuthology.orchestra.run.smithi050.stdout:4352 write 0x7da8b9e thru 0x7db4bf5 (0xc058 bytes) 2024-09-05T17:31:57.135 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:57.133+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:57.150 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:57.150 INFO:teuthology.orchestra.run.smithi050.stdout:4355 punch from 0x4815e2e to 0x48257a5, (0xf977 bytes) 2024-09-05T17:31:57.150 INFO:teuthology.orchestra.run.smithi050.stdout:4356 punch from 0x1108b2b to 0x111108d, (0x8562 bytes) 2024-09-05T17:31:57.150 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:57.150 INFO:teuthology.orchestra.run.smithi050.stdout:4358 read 0xaa36513 thru 0xaa36fc5 (0xab3 bytes) 2024-09-05T17:31:57.150 INFO:teuthology.orchestra.run.smithi050.stdout:4359 read 0x5bf68c thru 0x5cec63 (0xf5d8 bytes) 2024-09-05T17:31:57.155 INFO:teuthology.orchestra.run.smithi050.stdout:4360 trunc from 0xec40eac to 0xc8bfad7 2024-09-05T17:31:57.174 INFO:teuthology.orchestra.run.smithi050.stdout:4361 punch from 0xbf40405 to 0xbf4ded1, (0xdacc bytes) 2024-09-05T17:31:57.175 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:57.175 INFO:teuthology.orchestra.run.smithi050.stdout:4363 writesame 0xc8715a4 thru 0xc87b625 data_size 0x23(0xa082 bytes) 2024-09-05T17:31:57.205 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:57.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:57.205 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:57.205 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:57.205 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:57.206 INFO:teuthology.orchestra.run.smithi050.stdout:4365 write 0xce20a61 thru 0xce2a543 (0x9ae3 bytes) 2024-09-05T17:31:57.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:31:57.227 INFO:teuthology.orchestra.run.smithi050.stdout:4367 writesame 0x2ab2e68 thru 0x2abbc2b data_size 0x2b(0x8dc4 bytes) 2024-09-05T17:31:57.235 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:57.235 INFO:teuthology.orchestra.run.smithi050.stdout:4369 read 0xac3ccc0 thru 0xac40617 (0x3958 bytes) 2024-09-05T17:31:57.235 INFO:teuthology.orchestra.run.smithi050.stdout:4370 read 0x5d7dd55 thru 0x5d8c5cf (0xe87b bytes) 2024-09-05T17:31:57.236 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:57.237+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:57.246 INFO:teuthology.orchestra.run.smithi050.stdout:4371 write 0xea2800f thru 0xea37b09 (0xfafb bytes) 2024-09-05T17:31:57.268 INFO:teuthology.orchestra.run.smithi050.stdout:4372 write 0x7fc7aa4 thru 0x7fcabfc (0x3159 bytes) 2024-09-05T17:31:57.281 INFO:teuthology.orchestra.run.smithi050.stdout:4373 punch from 0x44f9e80 to 0x4505813, (0xb993 bytes) 2024-09-05T17:31:57.281 INFO:teuthology.orchestra.run.smithi050.stdout:4375 write 0x8da2938 thru 0x8da8fc4 (0x668d bytes) 2024-09-05T17:31:57.291 INFO:teuthology.orchestra.run.smithi050.stdout:4376 write 0x4ea4945 thru 0x4eb2395 (0xda51 bytes) 2024-09-05T17:31:57.311 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:57.311 INFO:teuthology.orchestra.run.smithi050.stdout:4380 write 0x61b7615 thru 0x61b84a3 (0xe8f bytes) 2024-09-05T17:31:57.319 INFO:teuthology.orchestra.run.smithi050.stdout:4381 read 0x4077685 thru 0x40776f6 (0x72 bytes) 2024-09-05T17:31:57.319 INFO:teuthology.orchestra.run.smithi050.stdout:4382 write 0x916d9a8 thru 0x917c181 (0xe7da bytes) 2024-09-05T17:31:57.336 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:57.333+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:4384 punch from 0x80a6e30 to 0x80b3690, (0xc860 bytes) 2024-09-05T17:31:57.341 INFO:teuthology.orchestra.run.smithi050.stdout:4385 read 0x6e4717c thru 0x6e48dcc (0x1c51 bytes) 2024-09-05T17:31:57.342 INFO:teuthology.orchestra.run.smithi050.stdout:4388 writesame 0x4178e26 thru 0x41800fc data_size 0x1(0x72d7 bytes) 2024-09-05T17:31:57.366 INFO:teuthology.orchestra.run.smithi050.stdout:4389 read 0x9cf87a0 thru 0x9cf94cf (0xd30 bytes) 2024-09-05T17:31:57.373 INFO:teuthology.orchestra.run.smithi050.stdout:4390 trunc from 0xea37b0a to 0x83d2350 2024-09-05T17:31:57.378 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:57.378 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:57.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:57.378 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:57.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78320 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2920448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54260119200000001, 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064661845999999995, 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78320 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837282+0000", 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:31:57.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837285+0000", 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837296+0000", 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.11e-05 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837302+0000", 2024-09-05T17:31:57.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6939999999999998e-06 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901848+0000", 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064545672999999998 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901890+0000", 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1853000000000001e-05 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901943+0000", 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3362999999999997e-05 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54254709599999995, 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.383 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:31:57.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.387 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54250163699999998, 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.388 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:31:57.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:31:57.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:31:57.392 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54247345000000002, 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:31:57.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:31:57.397 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54244583899999999, 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:31:57.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:31:57.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:31:57.402 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54241912299999995, 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:31:57.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:31:57.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:31:57.407 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54239021200000004, 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.408 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:31:57.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:31:57.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54235898100000002, 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:31:57.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.542328959, 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:31:57.417 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:31:57.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:31:57.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:31:57.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:31:57.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:31:57.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54230206299999995, 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:31:57.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:31:57.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54220532300000002, 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:31:57.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:31:57.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54217471800000006, 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:31:57.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:31:57.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:31:57.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:31:57.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54214739000000001, 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:31:57.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54212050300000003, 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:31:57.446 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54209319199999995, 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:31:57.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54175600800000001, 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:31:57.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.460 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54073892899999998, 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:31:57.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.465 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54062942000000003, 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:31:57.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54056293899999996, 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:31:57.470 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:31:57.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.54050315299999996, 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.475 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:31:57.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:31:57.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:57.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:31:57.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:31:57.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.479 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:57.479 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:57.479 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:57.481 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:31:57.482 INFO:teuthology.orchestra.run.smithi050.stdout:4391 trunc from 0x83d2350 to 0xbcf2745 2024-09-05T17:31:57.482 INFO:teuthology.orchestra.run.smithi050.stdout:4393 punch from 0x489a942 to 0x489d0bd, (0x277b bytes) 2024-09-05T17:31:57.482 INFO:teuthology.orchestra.run.smithi050.stdout:4394 write 0xba2448 thru 0xba618c (0x3d45 bytes) 2024-09-05T17:31:57.482 INFO:teuthology.orchestra.run.smithi050.stdout:4395 write 0xad404ee thru 0xad42f7b (0x2a8e bytes) 2024-09-05T17:31:57.482 INFO:teuthology.orchestra.run.smithi050.stdout:4397 read 0x5f5a011 thru 0x5f63cea (0x9cda bytes) 2024-09-05T17:31:57.482 INFO:teuthology.orchestra.run.smithi050.stdout:4398 flatten 2024-09-05T17:31:57.482 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:57.477+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:57.581 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:57.581+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:57.682 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:57.681+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:57.684 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:57.684 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:57.684 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:57.684 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:57.700 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:31:57.783 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:57.781+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:57.851 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:57.851 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:57.851 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:57.851 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:57.851 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:57.867 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:31:57.868 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.3 to 1 (10000) 2024-09-05T17:31:57.868 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:31:57.884 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:57.881+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:57.905 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-05T17:31:57.984 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:57.985+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:58.010 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:31:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:58.010 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 67.764744086999997, 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:31:58.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:31:58.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.243801237, 2024-09-05T17:31:58.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:31:58.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:31:58.019 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.039843337000001, 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:31:58.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:31:58.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:31:58.024 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.801848507999999, 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:31:58.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:31:58.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.788833967999999, 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.029 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.033 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.786570038000001, 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:31:58.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.784478264000001, 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:31:58.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51735 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'202, mlcod=54'198)", 2024-09-05T17:31:58.045 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.873164301999999, 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032394590000000001, 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137895+0000", 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4780000000000001e-06 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137904+0000", 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137926+0000", 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1013999999999999e-05 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137939+0000", 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.342e-05 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138024+0000", 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5167000000000006e-05 2024-09-05T17:31:58.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138055+0000", 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0982000000000003e-05 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.140997+0000", 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029416329999999999 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141133+0000", 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013600799999999999 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51736 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'203, mlcod=54'199)", 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.871498965000001, 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003209534, 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139560+0000", 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5629999999999999e-06 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139573+0000", 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2595999999999999e-05 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139599+0000", 2024-09-05T17:31:58.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6188999999999999e-05 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139616+0000", 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7356000000000001e-05 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139775+0000", 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158763 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139835+0000", 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.037e-05 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.142662+0000", 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00282636 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.142768+0000", 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106337 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.054 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.869689793999999, 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:31:58.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:31:58.059 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.477548806000001, 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:31:58.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54994 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'375, mlcod=60'373)", 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.461166167000002, 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032305459999999999, 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:31:58.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549893+0000", 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549906+0000", 2024-09-05T17:31:58.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2974e-05 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549936+0000", 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0079000000000001e-05 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549954+0000", 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7912999999999999e-05 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550156+0000", 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149400000000001 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550246+0000", 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0470000000000006e-05 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553025+0000", 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027789780000000001 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553122+0000", 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6804000000000004e-05 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.068 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.455910657, 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:31:58.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:31:58.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.879710776, 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.073 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:31:58.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.077 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.2267126610000001, 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:31:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.2261068129999999, 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:31:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:31:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.225540882, 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:31:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:31:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.2248859409999999, 2024-09-05T17:31:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:31:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.224185552, 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:31:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:31:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 1.2229169360000001, 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:31:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:31:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.106 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:58.107 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:31:58.108 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:31:58.105+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:31:58.208 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:31:58.205+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:31:58.288 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:58.289 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:58.289 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:31:58.289 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:58.304 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:31:58.347 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:58.349+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:58.409 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:31:58.410 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:31:58.409+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:31:58.426 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:58.426 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:31:58.426 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:31:58.426 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:31:58.426 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:58.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:31:58.511 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:58.509+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:58.571 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:31:58.571 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:31:58.590 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:31:58.591 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:31:58.612 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:58.613+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:58.613 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:31:58.613 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:31:58.628 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:31:58.628 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:31:58.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:31:58.628 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:31:58.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.628 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.420668603000003, 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:31:58.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.632 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.633 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.419647275999999, 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:31:58.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:31:58.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:31:58.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:31:58.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:31:58.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:31:58.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:31:58.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:31:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:31:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:31:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:31:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.640 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.418558777999998, 2024-09-05T17:31:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:31:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.641 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.642 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.642 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:31:58.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.642 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:58.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:31:58.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:31:58.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:31:58.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:31:58.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:31:58.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:31:58.648 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.648 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.648 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.648 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:31:58.648 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:31:58.648 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.417538266999998, 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.649 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:31:58.650 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.651 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:31:58.652 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.653 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.416511317999998, 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.654 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:31:58.655 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.656 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.657 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.414168719999999, 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.658 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.659 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:31:58.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.409216547, 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.663 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.664 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:31:58.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:31:58.667 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13418 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6023168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.408620646999999, 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14037719400000001, 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.668 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13418 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221572+0000", 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034026199999999998 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221584+0000", 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1321999999999999e-05 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221603+0000", 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9344e-05 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221615+0000", 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1565e-05 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361125+0000", 2024-09-05T17:31:58.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139510734 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361358+0000", 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023231599999999999 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361609+0000", 2024-09-05T17:31:58.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025165099999999998 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.408216564, 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:31:58.673 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:58.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:31:58.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.407611164999999, 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.678 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:58.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:31:58.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.406552036999997, 2024-09-05T17:31:58.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:58.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:31:58.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:31:58.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:31:58.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:31:58.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:31:58.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:31:58.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:31:58.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:31:58.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:31:58.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:31:58.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:31:58.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:31:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:31:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:31:58.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:31:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.693 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.405910753999997, 2024-09-05T17:31:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:31:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.694 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:31:58.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.696 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:58.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:31:58.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:31:58.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:31:58.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:31:58.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:31:58.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:31:58.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:31:58.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:31:58.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:31:58.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:31:58.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:31:58.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.703 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.405315860000002, 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.704 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:31:58.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:31:58.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:31:58.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.709 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.404250666000003, 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.710 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:31:58.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.403609975999998, 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.715 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.403159275999997, 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.720 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:31:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:31:58.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:58.725 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.402513532999997, 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:31:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.402141514999997, 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:31:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:31:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:31:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:31:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.401500460999998, 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:31:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:31:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.400901931999996, 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:31:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:31:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:31:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:31:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:31:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:31:58.746 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:31:58.747 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:31:58.747 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:31:58.748 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:31:58.749 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:31:58.749 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:31:58.749 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:31:58.750 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:31:58.750 INFO:teuthology.orchestra.run.smithi050.stdout:4399 writesame 0x29a66c5 thru 0x29afcb9 data_size 0x1(0x95f5 bytes) 2024-09-05T17:31:58.750 INFO:teuthology.orchestra.run.smithi050.stdout:4400 read 0x18d7a0b thru 0x18dd8ce (0x5ec4 bytes) 2024-09-05T17:31:58.750 INFO:teuthology.orchestra.run.smithi050.stdout:4401 writesame 0x20b125 thru 0x213d85 data_size 0x63(0x8c61 bytes) 2024-09-05T17:31:58.750 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:31:58.751 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:31:58.751 INFO:teuthology.orchestra.run.smithi050.stdout:4403 punch from 0x498590f to 0x4990d23, (0xb414 bytes) 2024-09-05T17:31:58.751 INFO:teuthology.orchestra.run.smithi050.stdout:4404 write 0x5d8d7d1 thru 0x5d98649 (0xae79 bytes) 2024-09-05T17:31:58.751 INFO:teuthology.orchestra.run.smithi050.stdout:4406 writesame 0x19e8cb2 thru 0x19f2b0e data_size 0x1(0x9e5d bytes) 2024-09-05T17:31:58.752 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:31:58.752 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:31:58.752 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.752 INFO:teuthology.orchestra.run.smithi050.stdout:4408 trunc from 0xbcf2745 to 0xe6a13e7 2024-09-05T17:31:58.753 INFO:teuthology.orchestra.run.smithi050.stdout:4410 read 0x8a55586 thru 0x8a58c78 (0x36f3 bytes) 2024-09-05T17:31:58.754 INFO:teuthology.orchestra.run.smithi050.stdout:4411 read 0x425df10 thru 0x425e2f4 (0x3e5 bytes) 2024-09-05T17:31:58.754 INFO:teuthology.orchestra.run.smithi050.stdout:4412 write 0x6893651 thru 0x689d3e3 (0x9d93 bytes) 2024-09-05T17:31:58.754 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:58.745+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:58.757 INFO:teuthology.orchestra.run.smithi050.stdout:4413 write 0x44ae5f9 thru 0x44b57c8 (0x71d0 bytes) 2024-09-05T17:31:58.774 INFO:teuthology.orchestra.run.smithi050.stdout:4414 write 0x14a1262 thru 0x14ae65a (0xd3f9 bytes) 2024-09-05T17:31:58.779 INFO:teuthology.orchestra.run.smithi050.stdout:4415 read 0x2735404 thru 0x274004d (0xac4a bytes) 2024-09-05T17:31:58.780 INFO:teuthology.orchestra.run.smithi050.stdout:4416 read 0xd1dfedd thru 0xd1ee9df (0xeb03 bytes) 2024-09-05T17:31:58.780 INFO:teuthology.orchestra.run.smithi050.stdout:4417 writesame 0x588830e thru 0x5892b8c data_size 0x1(0xa87f bytes) 2024-09-05T17:31:58.787 INFO:teuthology.orchestra.run.smithi050.stdout:4419 punch from 0x4eaae6 to 0x4ece28, (0x2342 bytes) 2024-09-05T17:31:58.787 INFO:teuthology.orchestra.run.smithi050.stdout:4420 write 0xcaf6a1f thru 0xcafe1ab (0x778d bytes) 2024-09-05T17:31:58.802 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.803 INFO:teuthology.orchestra.run.smithi050.stdout:4422 write 0x10c8e28 thru 0x10d503c (0xc215 bytes) 2024-09-05T17:31:58.818 INFO:teuthology.orchestra.run.smithi050.stdout:4423 writesame 0xbfacbd3 thru 0xbfb1cd2 data_size 0x12(0x5100 bytes) 2024-09-05T17:31:58.831 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.831 INFO:teuthology.orchestra.run.smithi050.stdout:4426 punch from 0x1106e03 to 0x1114595, (0xd792 bytes) 2024-09-05T17:31:58.831 INFO:teuthology.orchestra.run.smithi050.stdout:4427 write 0x946ec3f thru 0x947b397 (0xc759 bytes) 2024-09-05T17:31:58.846 INFO:teuthology.orchestra.run.smithi050.stdout:4428 write 0xc60dc6f thru 0xc60e75b (0xaed bytes) 2024-09-05T17:31:58.847 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:58.845+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:58.850 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.850 INFO:teuthology.orchestra.run.smithi050.stdout:4432 read 0x97b8c25 thru 0x97c7904 (0xece0 bytes) 2024-09-05T17:31:58.850 INFO:teuthology.orchestra.run.smithi050.stdout:4433 write 0x850eef2 thru 0x8514c97 (0x5da6 bytes) 2024-09-05T17:31:58.865 INFO:teuthology.orchestra.run.smithi050.stdout:4434 read 0x2a2827b thru 0x2a29f2e (0x1cb4 bytes) 2024-09-05T17:31:58.866 INFO:teuthology.orchestra.run.smithi050.stdout:4436 write 0xb243082 thru 0xb249abf (0x6a3e bytes) 2024-09-05T17:31:58.877 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.4 to 1 (10000) 2024-09-05T17:31:58.886 INFO:teuthology.orchestra.run.smithi050.stdout:4439 read 0x6e5b83d thru 0x6e62fd2 (0x7796 bytes) 2024-09-05T17:31:58.887 INFO:teuthology.orchestra.run.smithi050.stdout:4440 write 0xb6e6876 thru 0xb6f1fd3 (0xb75e bytes) 2024-09-05T17:31:58.891 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:58.892 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:58.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-05T17:31:58.905 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.905 INFO:teuthology.orchestra.run.smithi050.stdout:4442 writesame 0x7a6c00e thru 0x7a6d404 data_size 0x1(0x13f7 bytes) 2024-09-05T17:31:58.907 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:31:58.911 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.911 INFO:teuthology.orchestra.run.smithi050.stdout:4447 write 0x616c19c thru 0x6171d29 (0x5b8e bytes) 2024-09-05T17:31:58.914 INFO:teuthology.orchestra.run.smithi050.stdout:4448 write 0x60edf3d thru 0x60f6185 (0x8249 bytes) 2024-09-05T17:31:58.927 INFO:teuthology.orchestra.run.smithi050.stdout:4449 trunc from 0xe6a13e7 to 0x7c317a2 2024-09-05T17:31:58.954 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:58.953+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:58.962 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.962 INFO:teuthology.orchestra.run.smithi050.stdout:4451 writesame 0x42e0dd8 thru 0x42f0792 data_size 0x1(0xf9bb bytes) 2024-09-05T17:31:58.976 INFO:teuthology.orchestra.run.smithi050.stdout:4453 read 0x216d6f0 thru 0x216f02b (0x193c bytes) 2024-09-05T17:31:58.977 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.977 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:58.977 INFO:teuthology.orchestra.run.smithi050.stdout:4456 write 0x278fcc4 thru 0x2799d2f (0xa06c bytes) 2024-09-05T17:31:58.981 INFO:teuthology.orchestra.run.smithi050.stdout:4457 read 0x1d16c6d thru 0x1d187ee (0x1b82 bytes) 2024-09-05T17:31:58.981 INFO:teuthology.orchestra.run.smithi050.stdout:4458 punch from 0x3ceb9aa to 0x3cee068, (0x26be bytes) 2024-09-05T17:31:58.981 INFO:teuthology.orchestra.run.smithi050.stdout:4459 punch from 0x71f14bc to 0x71fc2da, (0xae1e bytes) 2024-09-05T17:31:58.981 INFO:teuthology.orchestra.run.smithi050.stdout:4460 write 0x143f704 thru 0x144b1dd (0xbada bytes) 2024-09-05T17:31:58.986 INFO:teuthology.orchestra.run.smithi050.stdout:4461 trunc from 0x7c317a2 to 0x81dce8f 2024-09-05T17:31:59.002 INFO:teuthology.orchestra.run.smithi050.stdout:4462 write 0xc006581 thru 0xc0128c3 (0xc343 bytes) 2024-09-05T17:31:59.020 INFO:teuthology.orchestra.run.smithi050.stdout:4463 punch from 0x1b1fa7c to 0x1b259d1, (0x5f55 bytes) 2024-09-05T17:31:59.020 INFO:teuthology.orchestra.run.smithi050.stdout:4465 writesame 0xcab589 thru 0xcb985f data_size 0xd(0xe2d7 bytes) 2024-09-05T17:31:59.026 INFO:teuthology.orchestra.run.smithi050.stdout:4466 read 0x4bbeb2d thru 0x4bc45c4 (0x5a98 bytes) 2024-09-05T17:31:59.026 INFO:teuthology.orchestra.run.smithi050.stdout:4467 read 0x5a09752 thru 0x5a0dc2f (0x44de bytes) 2024-09-05T17:31:59.026 INFO:teuthology.orchestra.run.smithi050.stdout:4468 read 0xb6faa59 thru 0xb6ff776 (0x4d1e bytes) 2024-09-05T17:31:59.027 INFO:teuthology.orchestra.run.smithi050.stdout:4469 punch from 0x4773efa to 0x477b3e8, (0x74ee bytes) 2024-09-05T17:31:59.027 INFO:teuthology.orchestra.run.smithi050.stdout:4470 write 0x2be229e thru 0x2be602e (0x3d91 bytes) 2024-09-05T17:31:59.031 INFO:teuthology.orchestra.run.smithi050.stdout:4471 writesame 0x54844db thru 0x5491d49 data_size 0x49(0xd86f bytes) 2024-09-05T17:31:59.049 INFO:teuthology.orchestra.run.smithi050.stdout:4474 read 0x2abdaf4 thru 0x2abeeba (0x13c7 bytes) 2024-09-05T17:31:59.049 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:59.049+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:59.053 INFO:teuthology.orchestra.run.smithi050.stdout:4475 trunc from 0xc0128c4 to 0xe74a9c0 2024-09-05T17:31:59.059 INFO:teuthology.orchestra.run.smithi050.stdout:4477 read 0x27e08bd thru 0x27ec67d (0xbdc1 bytes) 2024-09-05T17:31:59.060 INFO:teuthology.orchestra.run.smithi050.stdout:4478 punch from 0xb9f6c16 to 0xb9febf3, (0x7fdd bytes) 2024-09-05T17:31:59.060 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:31:59.060 INFO:teuthology.orchestra.run.smithi050.stdout:4480 read 0xc44e7a thru 0xc45882 (0xa09 bytes) 2024-09-05T17:31:59.060 INFO:teuthology.orchestra.run.smithi050.stdout:4481 punch from 0x68865a3 to 0x6889cf1, (0x374e bytes) 2024-09-05T17:31:59.061 INFO:teuthology.orchestra.run.smithi050.stdout:4482 clone 28 order 24 su 4194304 sc 10 2024-09-05T17:31:59.084 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:59.084 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:59.098 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:31:59.150 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:59.149+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:59.214 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:59.214 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:59.227 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:31:59.251 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:59.249+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:59.350 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:59.350 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:59.352 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:59.353+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:59.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:31:59.453 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:59.453+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:31:59.490 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:59.490 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:59.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:31:59.553 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:31:59.553+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:31:59.654 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:31:59.653+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:31:59.672 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:59.672 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:59.686 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:31:59.756 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:31:59.757+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:31:59.854 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:31:59.854 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:31:59.857 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:31:59.857+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:31:59.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:31:59.894 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.5 to 1 (10000) 2024-09-05T17:31:59.902 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:31:59.919 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-05T17:31:59.958 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:31:59.957+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:00.041 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:00.042 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:00.057 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:00.058 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:00.057+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:00.159 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:00.157+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:00.164 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-05T17:32:00.233 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:00.233 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:00.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:00.289 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:00.289+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:00.362 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:00.361+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:00.410 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:00.410 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:00.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:00.463 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:00.461+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:00.548 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:00.548 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:00.562 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:00.564 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:00.565+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:00.568 INFO:teuthology.orchestra.run.smithi050.stdout:4485 write 0xe12ae40 thru 0xe135a6e (0xac2f bytes) 2024-09-05T17:32:00.583 INFO:teuthology.orchestra.run.smithi050.stdout:4486 writesame 0x4569d82 thru 0x4576cdc data_size 0x1(0xcf5b bytes) 2024-09-05T17:32:00.642 INFO:teuthology.orchestra.run.smithi050.stdout:4487 trunc from 0xe74a9c0 to 0x7af8d6 2024-09-05T17:32:00.665 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:00.665+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:00.703 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:00.704 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:00.719 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:00.754 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:00.765 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:00.765+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:00.790 INFO:teuthology.orchestra.run.smithi050.stdout:4488 write 0xd374df1 thru 0xd37f5a9 (0xa7b9 bytes) 2024-09-05T17:32:00.796 INFO:teuthology.orchestra.run.smithi050.stdout:4489 read 0xa943d72 thru 0xa94c4c7 (0x8756 bytes) 2024-09-05T17:32:00.801 INFO:teuthology.orchestra.run.smithi050.stdout:4490 read 0x71c6707 thru 0x71d4141 (0xda3b bytes) 2024-09-05T17:32:00.801 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:00.815 INFO:teuthology.orchestra.run.smithi050.stdout:4492 trunc from 0xd37f5aa to 0x106a38b 2024-09-05T17:32:00.834 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:00.851 INFO:teuthology.orchestra.run.smithi050.stdout:4497 write 0x69aba28 thru 0x69afd28 (0x4301 bytes) 2024-09-05T17:32:00.856 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:00.856 INFO:teuthology.orchestra.run.smithi050.stdout:4499 punch from 0x212707e to 0x212f2af, (0x8231 bytes) 2024-09-05T17:32:00.856 INFO:teuthology.orchestra.run.smithi050.stdout:4500 read 0x33e51d thru 0x343acb (0x55af bytes) 2024-09-05T17:32:00.857 INFO:teuthology.orchestra.run.smithi050.stdout:4501 write 0x5bac05b thru 0x5bb0909 (0x48af bytes) 2024-09-05T17:32:00.863 INFO:teuthology.orchestra.run.smithi050.stdout:4502 writesame 0x3b5f82f thru 0x3b6615d data_size 0x1(0x692f bytes) 2024-09-05T17:32:00.866 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:00.864+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:00.873 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:00.874 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:00.887 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:00.889 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.6 to 1 (10000) 2024-09-05T17:32:00.892 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:32:00.901 INFO:teuthology.orchestra.run.smithi050.stdout:4503 read 0x5b32921 thru 0x5b3c576 (0x9c56 bytes) 2024-09-05T17:32:00.906 INFO:teuthology.orchestra.run.smithi050.stdout:4505 flatten 2024-09-05T17:32:00.919 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-05T17:32:00.928 INFO:teuthology.orchestra.run.smithi050.stdout:4506 trunc from 0x69afd29 to 0x2f3f4f0 2024-09-05T17:32:00.929 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:00.929 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:00.945 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:00.945 INFO:teuthology.orchestra.run.smithi050.stdout:4509 punch from 0xeceb20 to 0xed5000, (0x64e0 bytes) 2024-09-05T17:32:00.945 INFO:teuthology.orchestra.run.smithi050.stdout:4510 punch from 0x2eba275 to 0x2ec2a95, (0x8820 bytes) 2024-09-05T17:32:00.951 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:00.951 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:00.967 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:00.965+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:00.969 INFO:teuthology.orchestra.run.smithi050.stdout:4514 write 0xe6a4e49 thru 0xe6b2e2e (0xdfe6 bytes) 2024-09-05T17:32:00.972 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:00.972 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:00.975 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:00.994 INFO:teuthology.orchestra.run.smithi050.stdout:4516 trunc from 0xe6b2e2f to 0x1522c6a 2024-09-05T17:32:01.024 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:01.025 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:01.025 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:01.029 INFO:teuthology.orchestra.run.smithi050.stdout:4518 write 0x16039f0 thru 0x1607c5b (0x426c bytes) 2024-09-05T17:32:01.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:01.056 INFO:teuthology.orchestra.run.smithi050.stdout:4519 write 0x9869ab3 thru 0x9870729 (0x6c77 bytes) 2024-09-05T17:32:01.079 INFO:teuthology.orchestra.run.smithi050.stdout:4522 write 0xd91295d thru 0xd91ec3f (0xc2e3 bytes) 2024-09-05T17:32:01.079 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:01.076+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:01.094 INFO:teuthology.orchestra.run.smithi050.stdout:4523 trunc from 0xd91ec40 to 0x660c540 2024-09-05T17:32:01.118 INFO:teuthology.orchestra.run.smithi050.stdout:4524 punch from 0x5a6574 to 0x5aede8, (0x8874 bytes) 2024-09-05T17:32:01.118 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.118 INFO:teuthology.orchestra.run.smithi050.stdout:4526 punch from 0x5ce2e2c to 0x5cf0a0d, (0xdbe1 bytes) 2024-09-05T17:32:01.122 INFO:teuthology.orchestra.run.smithi050.stdout:4527 trunc from 0x660c540 to 0x92c67d3 2024-09-05T17:32:01.132 INFO:teuthology.orchestra.run.smithi050.stdout:4528 read 0x64c48fb thru 0x64c5939 (0x103f bytes) 2024-09-05T17:32:01.133 INFO:teuthology.orchestra.run.smithi050.stdout:4529 write 0x39125c8 thru 0x3916d67 (0x47a0 bytes) 2024-09-05T17:32:01.151 INFO:teuthology.orchestra.run.smithi050.stdout:4530 write 0xd5a46b1 thru 0xd5b22e3 (0xdc33 bytes) 2024-09-05T17:32:01.155 INFO:teuthology.orchestra.run.smithi050.stdout:4531 read 0x49512fb thru 0x4955cb2 (0x49b8 bytes) 2024-09-05T17:32:01.162 INFO:teuthology.orchestra.run.smithi050.stdout:4532 trunc from 0xd5b22e4 to 0x999976c 2024-09-05T17:32:01.168 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:01.169+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:01.183 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.183 INFO:teuthology.orchestra.run.smithi050.stdout:4534 read 0x13ec6db thru 0x13f90db (0xca01 bytes) 2024-09-05T17:32:01.186 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:01.186 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.104137721000001, 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.187 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:32:01.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:32:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:32:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:32:01.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.104109305000001, 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:32:01.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.196 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.104087378999999, 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.197 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.201 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.104065931999997, 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:32:01.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.104027641999998, 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.207 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:32:01.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:01.212 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.104012826000002, 2024-09-05T17:32:01.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:32:01.213 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.213 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:32:01.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:32:01.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:32:01.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:32:01.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:32:01.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:32:01.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:32:01.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:32:01.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:32:01.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:32:01.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:32:01.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:32:01.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:32:01.221 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.221 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.221 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.222 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.222 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:01.222 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.104001627000002, 2024-09-05T17:32:01.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:32:01.222 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.223 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.223 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.223 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.223 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.223 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:32:01.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.224 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:01.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:01.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:01.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:01.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:32:01.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:32:01.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:32:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:32:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:32:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:32:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:32:01.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:32:01.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:32:01.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:32:01.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:32:01.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:32:01.231 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.231 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.231 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.232 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.232 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.103990787999997, 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.233 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:01.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:32:01.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.237 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.103980311000001, 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:01.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.103969489000001, 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:01.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.103959089, 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.247 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:32:01.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.103940737000002, 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:32:01.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.103757113, 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.256 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:32:01.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:32:01.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:32:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:32:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:32:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:32:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:32:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:32:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:32:01.261 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.095097819000003, 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:32:01.262 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:01.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:32:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:32:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:32:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:32:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:32:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:32:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:32:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.269 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.095057277999999, 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.270 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:32:01.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.095017448999997, 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.275 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:32:01.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.094989974000001, 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.280 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.284 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.094951465000001, 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:32:01.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:32:01.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.094908725000003, 2024-09-05T17:32:01.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:32:01.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:32:01.293 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.693630510999999, 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.294 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:32:01.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:01.297 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:32:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:32:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:32:01.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.303 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.304 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:01.305 INFO:teuthology.orchestra.run.smithi050.stdout:4536 writesame 0xabe6d33 thru 0xabef250 data_size 0xb(0x851e bytes) 2024-09-05T17:32:01.305 INFO:teuthology.orchestra.run.smithi050.stdout:4537 read 0x8412214 thru 0x841235a (0x147 bytes) 2024-09-05T17:32:01.305 INFO:teuthology.orchestra.run.smithi050.stdout:4538 punch from 0x54975f9 to 0x54a04b7, (0x8ebe bytes) 2024-09-05T17:32:01.305 INFO:teuthology.orchestra.run.smithi050.stdout:4539 read 0x9c19192 thru 0x9c249d9 (0xb848 bytes) 2024-09-05T17:32:01.305 INFO:teuthology.orchestra.run.smithi050.stdout:4540 writesame 0x3aad659 thru 0x3aae053 data_size 0x7(0x9fb bytes) 2024-09-05T17:32:01.306 INFO:teuthology.orchestra.run.smithi050.stdout:4541 write 0x725bbd4 thru 0x725d251 (0x167e bytes) 2024-09-05T17:32:01.306 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:01.307 INFO:teuthology.orchestra.run.smithi050.stdout:4542 punch from 0x97bdbb8 to 0x97c537e, (0x77c6 bytes) 2024-09-05T17:32:01.307 INFO:teuthology.orchestra.run.smithi050.stdout:4544 read 0x8c7845c thru 0x8c7e66c (0x6211 bytes) 2024-09-05T17:32:01.307 INFO:teuthology.orchestra.run.smithi050.stdout:4545 punch from 0x8fe12fd to 0x8fe4032, (0x2d35 bytes) 2024-09-05T17:32:01.307 INFO:teuthology.orchestra.run.smithi050.stdout:4547 trunc from 0xabef251 to 0x7c2ebba 2024-09-05T17:32:01.308 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:01.308 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:4550 read 0x3c160c7 thru 0x3c1bea0 (0x5dda bytes) 2024-09-05T17:32:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:4555 write 0x539db2e thru 0x53a86d5 (0xaba8 bytes) 2024-09-05T17:32:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:4556 read 0x6495686 thru 0x64a1af7 (0xc472 bytes) 2024-09-05T17:32:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:4558 read 0x1a36141 thru 0x1a41d38 (0xbbf8 bytes) 2024-09-05T17:32:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:4560 punch from 0x12b55d8 to 0x12c03b2, (0xadda bytes) 2024-09-05T17:32:01.309 INFO:teuthology.orchestra.run.smithi050.stdout:4561 read 0x4293073 thru 0x429750e (0x449c bytes) 2024-09-05T17:32:01.310 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:01.310 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:01.310 INFO:teuthology.orchestra.run.smithi050.stdout:4562 write 0xaef67cf thru 0xaef7cca (0x14fc bytes) 2024-09-05T17:32:01.311 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:01.311 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:01.311 INFO:teuthology.orchestra.run.smithi050.stdout:4563 read 0x761abe4 thru 0x761b50e (0x92b bytes) 2024-09-05T17:32:01.311 INFO:teuthology.orchestra.run.smithi050.stdout:4564 trunc from 0xaef7ccb to 0x1898963 2024-09-05T17:32:01.312 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:01.312 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:01.312 INFO:teuthology.orchestra.run.smithi050.stdout:4565 read 0xb73444 thru 0xb7a368 (0x6f25 bytes) 2024-09-05T17:32:01.312 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:01.313 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:01.313 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:01.304+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:01.329 INFO:teuthology.orchestra.run.smithi050.stdout:4566 writesame 0xd39fea0 thru 0xd3a1247 data_size 0x25(0x13a8 bytes) 2024-09-05T17:32:01.330 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.330 INFO:teuthology.orchestra.run.smithi050.stdout:4568 read 0x687f45b thru 0x687f61d (0x1c3 bytes) 2024-09-05T17:32:01.337 INFO:teuthology.orchestra.run.smithi050.stdout:4569 trunc from 0xd3a1248 to 0x7ff353a 2024-09-05T17:32:01.350 INFO:teuthology.orchestra.run.smithi050.stdout:4570 read 0xdf4b4a thru 0xdfbbf5 (0x70ac bytes) 2024-09-05T17:32:01.351 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.351 INFO:teuthology.orchestra.run.smithi050.stdout:4572 write 0x22cc578 thru 0x22d10a9 (0x4b32 bytes) 2024-09-05T17:32:01.366 INFO:teuthology.orchestra.run.smithi050.stdout:4573 writesame 0x8b11f70 thru 0x8b18e6d data_size 0x1(0x6efe bytes) 2024-09-05T17:32:01.368 INFO:teuthology.orchestra.run.smithi050.stdout:4574 writesame 0x489fd5e thru 0x48a1a1a data_size 0x1(0x1cbd bytes) 2024-09-05T17:32:01.392 INFO:teuthology.orchestra.run.smithi050.stdout:4575 trunc from 0x8b18e6e to 0xd1294f 2024-09-05T17:32:01.406 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:01.404+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:01.418 INFO:teuthology.orchestra.run.smithi050.stdout:4577 trunc from 0xd1294f to 0x2e40ab0 2024-09-05T17:32:01.446 INFO:teuthology.orchestra.run.smithi050.stdout:4580 trunc from 0x2e40ab0 to 0xd447bbf 2024-09-05T17:32:01.459 INFO:teuthology.orchestra.run.smithi050.stdout:4581 read 0x201f1ea thru 0x20272ae (0x80c5 bytes) 2024-09-05T17:32:01.460 INFO:teuthology.orchestra.run.smithi050.stdout:4585 writesame 0x1cf1a2b thru 0x1cf52a0 data_size 0x49(0x3876 bytes) 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:96932 3.19 3:9d5792fb:::rbd_object_map.1140102563a7:head [call lock.assert_locked in=44b,call rbd.object_map_update in=38b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:01.462927+0000", 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.0026670650000000001, 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028019999999998, 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "waiting for sub ops", 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 96932 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.462927+0000", 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.462927+0000", 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.462928+0000", 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1379999999999999e-06 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.462934+0000", 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8270000000000003e-06 2024-09-05T17:32:01.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.462949+0000", 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4970999999999999e-05 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.462959+0000", 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0628000000000001e-05 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.463035+0000", 2024-09-05T17:32:01.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5626999999999999e-05 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.463142+0000", 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000107386 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.463574+0000", 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043185599999999999 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:01.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.464639+0000", 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0010651689999999999 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop_reply(client.4416.0:96932 3.19 e82/24 ondisk, result = 0)", 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:01.465527+0000", 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.7010999999999999e-05, 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017493399999999999, 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.469 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.465527+0000", 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.465527+0000", 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.465528+0000", 2024-09-05T17:32:01.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.753e-06 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.465537+0000", 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5059999999999995e-06 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.465565+0000", 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8558e-05 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.465578+0000", 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2880999999999999e-05 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.465644+0000", 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5920000000000006e-05 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:01.465652+0000", 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9319999999999996e-06 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.473 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.473 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:01.473 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 2 2024-09-05T17:32:01.473 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:01.474 INFO:teuthology.orchestra.run.smithi050.stdout:4587 write 0x3ec3dee thru 0x3ec859a (0x47ad bytes) 2024-09-05T17:32:01.474 INFO:teuthology.orchestra.run.smithi050.stdout:4590 read 0xac37289 thru 0xac468bf (0xf637 bytes) 2024-09-05T17:32:01.474 INFO:teuthology.orchestra.run.smithi050.stdout:4591 read 0x9db1f80 thru 0x9dbdde9 (0xbe6a bytes) 2024-09-05T17:32:01.474 INFO:teuthology.orchestra.run.smithi050.stdout:4592 writesame 0x46b823b thru 0x46c73be data_size 0x3a(0xf184 bytes) 2024-09-05T17:32:01.475 INFO:teuthology.orchestra.run.smithi050.stdout:4598 punch from 0x382f887 to 0x3838ab0, (0x9229 bytes) 2024-09-05T17:32:01.475 INFO:teuthology.orchestra.run.smithi050.stdout:4599 write 0xa6be5d5 thru 0xa6c91d4 (0xac00 bytes) 2024-09-05T17:32:01.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:01.482 INFO:teuthology.orchestra.run.smithi050.stdout:4600 read 0xc0bfd5c thru 0xc0c6a98 (0x6d3d bytes) 2024-09-05T17:32:01.483 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.483 INFO:teuthology.orchestra.run.smithi050.stdout:4602 punch from 0xbbff060 to 0xbc0c38a, (0xd32a bytes) 2024-09-05T17:32:01.503 INFO:teuthology.orchestra.run.smithi050.stdout:4605 trunc from 0xd447bbf to 0x1ac3b1a 2024-09-05T17:32:01.507 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:01.505+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:01.547 INFO:teuthology.orchestra.run.smithi050.stdout:4606 writesame 0x3e06b34 thru 0x3e13cfd data_size 0x3(0xd1ca bytes) 2024-09-05T17:32:01.572 INFO:teuthology.orchestra.run.smithi050.stdout:4607 write 0x96ea5a9 thru 0x96f9231 (0xec89 bytes) 2024-09-05T17:32:01.579 INFO:teuthology.orchestra.run.smithi050.stdout:4608 read 0x1e6b4b8 thru 0x1e703cd (0x4f16 bytes) 2024-09-05T17:32:01.581 INFO:teuthology.orchestra.run.smithi050.stdout:4610 read 0x1ab59e4 thru 0x1abd60d (0x7c2a bytes) 2024-09-05T17:32:01.581 INFO:teuthology.orchestra.run.smithi050.stdout:4612 read 0x311cec4 thru 0x3129d11 (0xce4e bytes) 2024-09-05T17:32:01.596 INFO:teuthology.orchestra.run.smithi050.stdout:4614 trunc from 0x96f9232 to 0x16a1104 2024-09-05T17:32:01.608 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:01.605+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:01.619 INFO:teuthology.orchestra.run.smithi050.stdout:4615 read 0x11b4665 thru 0x11b65e5 (0x1f81 bytes) 2024-09-05T17:32:01.619 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.619 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.628 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:01.628 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:01.628 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:01.628 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:01.628 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:01.644 INFO:teuthology.orchestra.run.smithi050.stdout:4619 write 0x8708cb3 thru 0x870bc8e (0x2fdc bytes) 2024-09-05T17:32:01.646 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:01.650 INFO:teuthology.orchestra.run.smithi050.stdout:4623 writesame 0x7b70bd thru 0x7c6974 data_size 0x2a(0xf8b8 bytes) 2024-09-05T17:32:01.674 INFO:teuthology.orchestra.run.smithi050.stdout:4624 write 0xddba37e thru 0xddc0def (0x6a72 bytes) 2024-09-05T17:32:01.680 INFO:teuthology.orchestra.run.smithi050.stdout:4625 write 0xa29180f thru 0xa295ad7 (0x42c9 bytes) 2024-09-05T17:32:01.685 INFO:teuthology.orchestra.run.smithi050.stdout:4626 punch from 0xc6e7ac to 0xc72f96, (0x47ea bytes) 2024-09-05T17:32:01.686 INFO:teuthology.orchestra.run.smithi050.stdout:4628 writesame 0xcf5bd92 thru 0xcf6ac5a data_size 0x1(0xeec9 bytes) 2024-09-05T17:32:01.709 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:01.709+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:01.762 INFO:teuthology.orchestra.run.smithi050.stdout:4629 read 0xe45279 thru 0xe45774 (0x4fc bytes) 2024-09-05T17:32:01.763 INFO:teuthology.orchestra.run.smithi050.stdout:4631 write 0x111b0c7 thru 0x1126dfc (0xbd36 bytes) 2024-09-05T17:32:01.778 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:01.778 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:01.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:01.778 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:01.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.778 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78320 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2920448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9408192700000004, 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064661845999999995, 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78320 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837282+0000", 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837285+0000", 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:01.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837296+0000", 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.11e-05 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837302+0000", 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6939999999999998e-06 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901848+0000", 2024-09-05T17:32:01.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064545672999999998 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901890+0000", 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1853000000000001e-05 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901943+0000", 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3362999999999997e-05 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.940765174, 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:01.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.788 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9407197150000002, 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:32:01.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:32:01.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9406915280000003, 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:01.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:32:01.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9406639170000002, 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.798 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:01.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:32:01.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9406372010000004, 2024-09-05T17:32:01.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:32:01.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9406082900000001, 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:32:01.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:32:01.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9405770589999998, 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.812 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:01.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.816 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.940547037, 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.820 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9405201410000004, 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.821 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:32:01.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9404234010000003, 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:32:01.825 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:32:01.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9403927960000003, 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:32:01.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:32:01.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9403654679999995, 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.834 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:01.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.838 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9403385809999998, 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:32:01.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:32:01.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9403112700000005, 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.843 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:01.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9399740860000003, 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:32:01.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.938957007, 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.856 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9388474980000003, 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:32:01.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9387810170000002, 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:32:01.861 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:32:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.9387212309999997, 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:01.866 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:01.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:32:01.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:01.870 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:01.871 INFO:teuthology.orchestra.run.smithi050.stdout:4632 trunc from 0xddc0df0 to 0x38ce8a5 2024-09-05T17:32:01.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:01.873 INFO:teuthology.orchestra.run.smithi050.stdout:4633 punch from 0x32f2bb2 to 0x32fb1c7, (0x8615 bytes) 2024-09-05T17:32:01.873 INFO:teuthology.orchestra.run.smithi050.stdout:4634 read 0x107807b thru 0x1080fe4 (0x8f6a bytes) 2024-09-05T17:32:01.873 INFO:teuthology.orchestra.run.smithi050.stdout:4635 writesame 0x6958ade thru 0x695ebc3 data_size 0x2(0x60e6 bytes) 2024-09-05T17:32:01.873 INFO:teuthology.orchestra.run.smithi050.stdout:4637 writesame 0x7fe0fac thru 0x7fe9988 data_size 0x1(0x89dd bytes) 2024-09-05T17:32:01.873 INFO:teuthology.orchestra.run.smithi050.stdout:4638 trunc from 0x7fe9989 to 0xb8e400e 2024-09-05T17:32:01.873 INFO:teuthology.orchestra.run.smithi050.stdout:4640 read 0x6e3f42f thru 0x6e4cdc9 (0xd99b bytes) 2024-09-05T17:32:01.874 INFO:teuthology.orchestra.run.smithi050.stdout:4641 punch from 0x5642d8 to 0x56922d, (0x4f55 bytes) 2024-09-05T17:32:01.874 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:01.869+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:01.891 INFO:teuthology.orchestra.run.smithi050.stdout:4642 write 0xdc88dd9 thru 0xdc94907 (0xbb2f bytes) 2024-09-05T17:32:01.896 INFO:teuthology.orchestra.run.smithi050.stdout:4643 punch from 0x4f462cb to 0x4f515d6, (0xb30b bytes) 2024-09-05T17:32:01.903 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.7 to 1 (10000) 2024-09-05T17:32:01.920 INFO:teuthology.orchestra.run.smithi050.stdout:4644 trunc from 0xdc94908 to 0x1db5789 2024-09-05T17:32:01.937 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-05T17:32:01.937 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:32:01.943 INFO:teuthology.orchestra.run.smithi050.stdout:4645 writesame 0x179ebca thru 0x17ab348 data_size 0x1(0xc77f bytes) 2024-09-05T17:32:01.972 INFO:teuthology.orchestra.run.smithi050.stdout:4647 writesame 0x1d516aa thru 0x1d5b97d data_size 0x22(0xa2d4 bytes) 2024-09-05T17:32:01.973 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:01.973+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:01.979 INFO:teuthology.orchestra.run.smithi050.stdout:4650 read 0xbc6033 thru 0xbcfd41 (0x9d0f bytes) 2024-09-05T17:32:01.979 INFO:teuthology.orchestra.run.smithi050.stdout:4651 writesame 0xdfaca6 thru 0xe02e4a data_size 0x17(0x81a5 bytes) 2024-09-05T17:32:01.983 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:01.991 INFO:teuthology.orchestra.run.smithi050.stdout:4653 trunc from 0x1db5789 to 0x685e746 2024-09-05T17:32:02.002 INFO:teuthology.orchestra.run.smithi050.stdout:4654 punch from 0x5515ba4 to 0x5519fb4, (0x4410 bytes) 2024-09-05T17:32:02.002 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:02.006 INFO:teuthology.orchestra.run.smithi050.stdout:4656 trunc from 0x685e746 to 0x3c77f3c 2024-09-05T17:32:02.021 INFO:teuthology.orchestra.run.smithi050.stdout:4658 writesame 0x721f80 thru 0x729e07 data_size 0x4(0x7e88 bytes) 2024-09-05T17:32:02.022 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:02.022 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:02.022 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:02.022 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:02.028 INFO:teuthology.orchestra.run.smithi050.stdout:4659 read 0x1d42c09 thru 0x1d4ae91 (0x8289 bytes) 2024-09-05T17:32:02.043 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:02.053 INFO:teuthology.orchestra.run.smithi050.stdout:4660 write 0xce5804b thru 0xce586ef (0x6a5 bytes) 2024-09-05T17:32:02.073 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:02.073+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:02.074 INFO:teuthology.orchestra.run.smithi050.stdout:4663 trunc from 0xce586f0 to 0x2ddf744 2024-09-05T17:32:02.097 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:02.097 INFO:teuthology.orchestra.run.smithi050.stdout:4666 read 0x22d9a52 thru 0x22e339c (0x994b bytes) 2024-09-05T17:32:02.097 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:02.097 INFO:teuthology.orchestra.run.smithi050.stdout:4669 read 0x12149ec thru 0x121ff01 (0xb516 bytes) 2024-09-05T17:32:02.098 INFO:teuthology.orchestra.run.smithi050.stdout:4670 read 0x2076619 thru 0x20776af (0x1097 bytes) 2024-09-05T17:32:02.098 INFO:teuthology.orchestra.run.smithi050.stdout:4673 read 0x15e2edb thru 0x15e4690 (0x17b6 bytes) 2024-09-05T17:32:02.098 INFO:teuthology.orchestra.run.smithi050.stdout:4677 read 0x1425697 thru 0x142bbb1 (0x651b bytes) 2024-09-05T17:32:02.098 INFO:teuthology.orchestra.run.smithi050.stdout:4679 read 0x1d16e6 thru 0x1e06bb (0xefd6 bytes) 2024-09-05T17:32:02.099 INFO:teuthology.orchestra.run.smithi050.stdout:4680 read 0x1102fc1 thru 0x110fb18 (0xcb58 bytes) 2024-09-05T17:32:02.127 INFO:teuthology.orchestra.run.smithi050.stdout:4681 write 0xc2b87ef thru 0xc2c576a (0xcf7c bytes) 2024-09-05T17:32:02.132 INFO:teuthology.orchestra.run.smithi050.stdout:4682 read 0x1efe4f3 thru 0x1f0e33e (0xfe4c bytes) 2024-09-05T17:32:02.133 INFO:teuthology.orchestra.run.smithi050.stdout:4683 read 0x7145161 thru 0x71482b5 (0x3155 bytes) 2024-09-05T17:32:02.133 INFO:teuthology.orchestra.run.smithi050.stdout:4684 clone 29 order 21 su 16384 sc 10 2024-09-05T17:32:02.174 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:02.172+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:02.179 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:02.179 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:02.194 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:02.271 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:32:02.272 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:32:02.275 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:02.273+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:02.290 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-05T17:32:01.901796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1009485613,"num_objects":1329,"num_object_clones":322,"num_object_copies":2658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1329,"num_whiteouts":261,"num_read":124985,"num_read_kb":297271,"num_write":17125,"num_write_kb":150135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":678,"num_bytes_recovered":22640023,"num_keys_recovered":72,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13204,"ondisk_log_size":13204,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":297572,"kb_used_data":34840,"kb_used_omap":10,"kb_used_meta":262581,"kb_avail":660305308,"statfs":{"total":676457349120,"available":676152635392,"internally_reserved":0,"allocated":35676160,"data_stored":207017007,"data_compressed":8181872,"data_compressed_allocated":17317888,"data_compressed_original":197024800,"omap_allocated":11156,"internal_metadata":268883052},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,39,39],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47382291,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":34333,"num_read_kb":59259,"num_write":2546,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029044"},"pg_stats":[{"pgid":"3.1f","version":"80'248","reported_seq":2201,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.038732+0000","last_change":"2024-09-05T17:31:40.516183+0000","last_active":"2024-09-05T17:31:59.038732+0000","last_peered":"2024-09-05T17:31:59.038732+0000","last_clean":"2024-09-05T17:31:59.038732+0000","last_became_active":"2024-09-05T17:31:40.513715+0000","last_became_peered":"2024-09-05T17:31:40.513715+0000","last_unstale":"2024-09-05T17:31:59.038732+0000","last_undegraded":"2024-09-05T17:31:59.038732+0000","last_fullsized":"2024-09-05T17:31:59.038732+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:09:48.932466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023314770000000002,"stat_sum":{"num_bytes":43511957,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":9,"num_read":2313,"num_read_kb":9684,"num_write":275,"num_write_kb":5764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":3163339,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"80'242","reported_seq":886,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.950779+0000","last_change":"2024-09-05T17:30:45.601580+0000","last_active":"2024-09-05T17:31:58.950779+0000","last_peered":"2024-09-05T17:31:58.950779+0000","last_clean":"2024-09-05T17:31:58.950779+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:31:58.950779+0000","last_undegraded":"2024-09-05T17:31:58.950779+0000","last_fullsized":"2024-09-05T17:31:58.950779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:23:33.144627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012442379999999999,"stat_sum":{"num_bytes":4103971,"num_objects":21,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":4,"num_read":1352,"num_read_kb":1875,"num_write":255,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"80'301","reported_seq":2141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.027418+0000","last_change":"2024-09-05T17:30:45.585378+0000","last_active":"2024-09-05T17:31:59.027418+0000","last_peered":"2024-09-05T17:31:59.027418+0000","last_clean":"2024-09-05T17:31:59.027418+0000","last_became_active":"2024-09-05T17:30:43.597087+0000","last_became_peered":"2024-09-05T17:30:43.597087+0000","last_unstale":"2024-09-05T17:31:59.027418+0000","last_undegraded":"2024-09-05T17:31:59.027418+0000","last_fullsized":"2024-09-05T17:31:59.027418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:15:12.947967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064572499999999999,"stat_sum":{"num_bytes":47652264,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":7,"num_read":2686,"num_read_kb":6743,"num_write":357,"num_write_kb":4073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"80'266","reported_seq":2079,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.061356+0000","last_change":"2024-09-05T17:30:45.586287+0000","last_active":"2024-09-05T17:31:59.061356+0000","last_peered":"2024-09-05T17:31:59.061356+0000","last_clean":"2024-09-05T17:31:59.061356+0000","last_became_active":"2024-09-05T17:30:43.604511+0000","last_became_peered":"2024-09-05T17:30:43.604511+0000","last_unstale":"2024-09-05T17:31:59.061356+0000","last_undegraded":"2024-09-05T17:31:59.061356+0000","last_fullsized":"2024-09-05T17:31:59.061356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:59.047923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015056150000000001,"stat_sum":{"num_bytes":12077781,"num_objects":42,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":5,"num_read":1770,"num_read_kb":3878,"num_write":277,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'240","reported_seq":801,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.044665+0000","last_change":"2024-09-05T17:31:40.517437+0000","last_active":"2024-09-05T17:31:59.044665+0000","last_peered":"2024-09-05T17:31:59.044665+0000","last_clean":"2024-09-05T17:31:59.044665+0000","last_became_active":"2024-09-05T17:31:40.514621+0000","last_became_peered":"2024-09-05T17:31:40.514621+0000","last_unstale":"2024-09-05T17:31:59.044665+0000","last_undegraded":"2024-09-05T17:31:59.044665+0000","last_fullsized":"2024-09-05T17:31:59.044665+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:58:24.913685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001548448,"stat_sum":{"num_bytes":53270359,"num_objects":36,"num_object_clones":9,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":6,"num_read":462,"num_read_kb":3827,"num_write":241,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1722378,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"80'516","reported_seq":3938,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.004884+0000","last_change":"2024-09-05T17:31:31.709738+0000","last_active":"2024-09-05T17:31:59.004884+0000","last_peered":"2024-09-05T17:31:59.004884+0000","last_clean":"2024-09-05T17:31:59.004884+0000","last_became_active":"2024-09-05T17:31:31.708688+0000","last_became_peered":"2024-09-05T17:31:31.708688+0000","last_unstale":"2024-09-05T17:31:59.004884+0000","last_undegraded":"2024-09-05T17:31:59.004884+0000","last_fullsized":"2024-09-05T17:31:59.004884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:23:50.366842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058024300000000003,"stat_sum":{"num_bytes":17898622,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":5575,"num_read_kb":7132,"num_write":616,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"80'268","reported_seq":5758,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.050462+0000","last_change":"2024-09-05T17:30:45.579337+0000","last_active":"2024-09-05T17:31:59.050462+0000","last_peered":"2024-09-05T17:31:59.050462+0000","last_clean":"2024-09-05T17:31:59.050462+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:31:59.050462+0000","last_undegraded":"2024-09-05T17:31:59.050462+0000","last_fullsized":"2024-09-05T17:31:59.050462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:14:04.774299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096919599999999997,"stat_sum":{"num_bytes":46340692,"num_objects":34,"num_object_clones":4,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":5,"num_read":5494,"num_read_kb":14844,"num_write":281,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"80'191","reported_seq":990,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.023135+0000","last_change":"2024-09-05T17:31:40.506212+0000","last_active":"2024-09-05T17:31:59.023135+0000","last_peered":"2024-09-05T17:31:59.023135+0000","last_clean":"2024-09-05T17:31:59.023135+0000","last_became_active":"2024-09-05T17:31:40.505420+0000","last_became_peered":"2024-09-05T17:31:40.505420+0000","last_unstale":"2024-09-05T17:31:59.023135+0000","last_undegraded":"2024-09-05T17:31:59.023135+0000","last_fullsized":"2024-09-05T17:31:59.023135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:21:44.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371232,"stat_sum":{"num_bytes":9131352,"num_objects":34,"num_object_clones":11,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":7,"num_read":587,"num_read_kb":4238,"num_write":198,"num_write_kb":4490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":49,"num_bytes_recovered":1454927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"80'433","reported_seq":1046,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.040979+0000","last_change":"2024-09-05T17:31:40.512725+0000","last_active":"2024-09-05T17:31:59.040979+0000","last_peered":"2024-09-05T17:31:59.040979+0000","last_clean":"2024-09-05T17:31:59.040979+0000","last_became_active":"2024-09-05T17:31:40.509920+0000","last_became_peered":"2024-09-05T17:31:40.509920+0000","last_unstale":"2024-09-05T17:31:59.040979+0000","last_undegraded":"2024-09-05T17:31:59.040979+0000","last_fullsized":"2024-09-05T17:31:59.040979+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:52:16.293828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024520119999999999,"stat_sum":{"num_bytes":12869744,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":3,"num_read":1654,"num_read_kb":1642,"num_write":577,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":64694,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"80'574","reported_seq":1328,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.987163+0000","last_change":"2024-09-05T17:30:45.586718+0000","last_active":"2024-09-05T17:31:58.987163+0000","last_peered":"2024-09-05T17:31:58.987163+0000","last_clean":"2024-09-05T17:31:58.987163+0000","last_became_active":"2024-09-05T17:30:43.604988+0000","last_became_peered":"2024-09-05T17:30:43.604988+0000","last_unstale":"2024-09-05T17:31:58.987163+0000","last_undegraded":"2024-09-05T17:31:58.987163+0000","last_fullsized":"2024-09-05T17:31:58.987163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:09:53.810429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017597120000000001,"stat_sum":{"num_bytes":18260193,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":2721,"num_read_kb":5121,"num_write":799,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"80'210","reported_seq":692,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.986308+0000","last_change":"2024-09-05T17:30:46.331830+0000","last_active":"2024-09-05T17:31:58.986308+0000","last_peered":"2024-09-05T17:31:58.986308+0000","last_clean":"2024-09-05T17:31:58.986308+0000","last_became_active":"2024-09-05T17:30:43.598646+0000","last_became_peered":"2024-09-05T17:30:43.598646+0000","last_unstale":"2024-09-05T17:31:58.986308+0000","last_undegraded":"2024-09-05T17:31:58.986308+0000","last_fullsized":"2024-09-05T17:31:58.986308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:59:48.641422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010679610000000001,"stat_sum":{"num_bytes":7686709,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":414,"num_read_kb":2246,"num_write":186,"num_write_kb":2013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"80'338","reported_seq":13037,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.062949+0000","last_change":"2024-09-05T17:31:31.709878+0000","last_active":"2024-09-05T17:31:59.062949+0000","last_peered":"2024-09-05T17:31:59.062949+0000","last_clean":"2024-09-05T17:31:59.062949+0000","last_became_active":"2024-09-05T17:31:31.707629+0000","last_became_peered":"2024-09-05T17:31:31.707629+0000","last_unstale":"2024-09-05T17:31:59.062949+0000","last_undegraded":"2024-09-05T17:31:59.062949+0000","last_fullsized":"2024-09-05T17:31:59.062949+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:07:45.057665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010724350000000001,"stat_sum":{"num_bytes":44068317,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":10,"num_read":13665,"num_read_kb":30691,"num_write":334,"num_write_kb":3348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.880021+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:31:58.880021+0000","last_peered":"2024-09-05T17:31:58.880021+0000","last_clean":"2024-09-05T17:31:58.880021+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:31:58.880021+0000","last_undegraded":"2024-09-05T17:31:58.880021+0000","last_fullsized":"2024-09-05T17:31:58.880021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"80'356","reported_seq":4844,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.028588+0000","last_change":"2024-09-05T17:31:40.515933+0000","last_active":"2024-09-05T17:31:59.028588+0000","last_peered":"2024-09-05T17:31:59.028588+0000","last_clean":"2024-09-05T17:31:59.028588+0000","last_became_active":"2024-09-05T17:31:40.515069+0000","last_became_peered":"2024-09-05T17:31:40.515069+0000","last_unstale":"2024-09-05T17:31:59.028588+0000","last_undegraded":"2024-09-05T17:31:59.028588+0000","last_fullsized":"2024-09-05T17:31:59.028588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:42:23.668567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024656499999999998,"stat_sum":{"num_bytes":34108550,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":9,"num_read":5833,"num_read_kb":18253,"num_write":347,"num_write_kb":6422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":4774793,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.887295+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:31:58.887295+0000","last_peered":"2024-09-05T17:31:58.887295+0000","last_clean":"2024-09-05T17:31:58.887295+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:31:58.887295+0000","last_undegraded":"2024-09-05T17:31:58.887295+0000","last_fullsized":"2024-09-05T17:31:58.887295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"80'332","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.032008+0000","last_change":"2024-09-05T17:31:18.499515+0000","last_active":"2024-09-05T17:31:59.032008+0000","last_peered":"2024-09-05T17:31:59.032008+0000","last_clean":"2024-09-05T17:31:59.032008+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:31:59.032008+0000","last_undegraded":"2024-09-05T17:31:59.032008+0000","last_fullsized":"2024-09-05T17:31:59.032008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:23:28.114361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062572599999999995,"stat_sum":{"num_bytes":18499839,"num_objects":30,"num_object_clones":4,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":5,"num_read":662,"num_read_kb":1875,"num_write":409,"num_write_kb":2352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.884615+0000","last_change":"2024-09-05T17:31:37.502979+0000","last_active":"2024-09-05T17:31:58.884615+0000","last_peered":"2024-09-05T17:31:58.884615+0000","last_clean":"2024-09-05T17:31:58.884615+0000","last_became_active":"2024-09-05T17:31:37.502514+0000","last_became_peered":"2024-09-05T17:31:37.502514+0000","last_unstale":"2024-09-05T17:31:58.884615+0000","last_undegraded":"2024-09-05T17:31:58.884615+0000","last_fullsized":"2024-09-05T17:31:58.884615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:26:03.249089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"80'483","reported_seq":2139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.017390+0000","last_change":"2024-09-05T17:30:45.579183+0000","last_active":"2024-09-05T17:31:59.017390+0000","last_peered":"2024-09-05T17:31:59.017390+0000","last_clean":"2024-09-05T17:31:59.017390+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:31:59.017390+0000","last_undegraded":"2024-09-05T17:31:59.017390+0000","last_fullsized":"2024-09-05T17:31:59.017390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:57:22.368350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075116199999999999,"stat_sum":{"num_bytes":20543784,"num_objects":35,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":6,"num_read":3608,"num_read_kb":4787,"num_write":672,"num_write_kb":2958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.887265+0000","last_change":"2024-09-05T17:31:37.508050+0000","last_active":"2024-09-05T17:31:58.887265+0000","last_peered":"2024-09-05T17:31:58.887265+0000","last_clean":"2024-09-05T17:31:58.887265+0000","last_became_active":"2024-09-05T17:31:37.507154+0000","last_became_peered":"2024-09-05T17:31:37.507154+0000","last_unstale":"2024-09-05T17:31:58.887265+0000","last_undegraded":"2024-09-05T17:31:58.887265+0000","last_fullsized":"2024-09-05T17:31:58.887265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:03:10.252281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"80'383","reported_seq":1104,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.027610+0000","last_change":"2024-09-05T17:30:45.585838+0000","last_active":"2024-09-05T17:31:59.027610+0000","last_peered":"2024-09-05T17:31:59.027610+0000","last_clean":"2024-09-05T17:31:59.027610+0000","last_became_active":"2024-09-05T17:30:43.586429+0000","last_became_peered":"2024-09-05T17:30:43.586429+0000","last_unstale":"2024-09-05T17:31:59.027610+0000","last_undegraded":"2024-09-05T17:31:59.027610+0000","last_fullsized":"2024-09-05T17:31:59.027610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:36:44.867596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010231579999999999,"stat_sum":{"num_bytes":40712571,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":8,"num_read":1589,"num_read_kb":12993,"num_write":436,"num_write_kb":10537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"80'322","reported_seq":5725,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.031433+0000","last_change":"2024-09-05T17:31:40.517833+0000","last_active":"2024-09-05T17:31:59.031433+0000","last_peered":"2024-09-05T17:31:59.031433+0000","last_clean":"2024-09-05T17:31:59.031433+0000","last_became_active":"2024-09-05T17:31:40.514987+0000","last_became_peered":"2024-09-05T17:31:40.514987+0000","last_unstale":"2024-09-05T17:31:59.031433+0000","last_undegraded":"2024-09-05T17:31:59.031433+0000","last_fullsized":"2024-09-05T17:31:59.031433+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:51:56.762547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077238000000000003,"stat_sum":{"num_bytes":15464463,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":7,"num_read":6045,"num_read_kb":12813,"num_write":355,"num_write_kb":5000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":2070576,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.884075+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:31:58.884075+0000","last_peered":"2024-09-05T17:31:58.884075+0000","last_clean":"2024-09-05T17:31:58.884075+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:31:58.884075+0000","last_undegraded":"2024-09-05T17:31:58.884075+0000","last_fullsized":"2024-09-05T17:31:58.884075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"80'1197","reported_seq":2786,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.050613+0000","last_change":"2024-09-05T17:30:45.580126+0000","last_active":"2024-09-05T17:31:59.050613+0000","last_peered":"2024-09-05T17:31:59.050613+0000","last_clean":"2024-09-05T17:31:59.050613+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:31:59.050613+0000","last_undegraded":"2024-09-05T17:31:59.050613+0000","last_fullsized":"2024-09-05T17:31:59.050613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1197,"log_dups_size":0,"ondisk_log_size":1197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:42:50.644393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093389999999999999,"stat_sum":{"num_bytes":25247426,"num_objects":55,"num_object_clones":15,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":14,"num_read":7228,"num_read_kb":8067,"num_write":2029,"num_write_kb":4782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.891799+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:31:58.891799+0000","last_peered":"2024-09-05T17:31:58.891799+0000","last_clean":"2024-09-05T17:31:58.891799+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:31:58.891799+0000","last_undegraded":"2024-09-05T17:31:58.891799+0000","last_fullsized":"2024-09-05T17:31:58.891799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'429","reported_seq":7417,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.062735+0000","last_change":"2024-09-05T17:31:40.514252+0000","last_active":"2024-09-05T17:31:59.062735+0000","last_peered":"2024-09-05T17:31:59.062735+0000","last_clean":"2024-09-05T17:31:59.062735+0000","last_became_active":"2024-09-05T17:31:40.513375+0000","last_became_peered":"2024-09-05T17:31:40.513375+0000","last_unstale":"2024-09-05T17:31:59.062735+0000","last_undegraded":"2024-09-05T17:31:59.062735+0000","last_fullsized":"2024-09-05T17:31:59.062735+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:20:13.187694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001490367,"stat_sum":{"num_bytes":38571520,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":8769,"num_read_kb":16427,"num_write":501,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":2048426,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.883863+0000","last_change":"2024-09-05T17:31:03.554542+0000","last_active":"2024-09-05T17:31:58.883863+0000","last_peered":"2024-09-05T17:31:58.883863+0000","last_clean":"2024-09-05T17:31:58.883863+0000","last_became_active":"2024-09-05T17:31:03.554149+0000","last_became_peered":"2024-09-05T17:31:03.554149+0000","last_unstale":"2024-09-05T17:31:58.883863+0000","last_undegraded":"2024-09-05T17:31:58.883863+0000","last_fullsized":"2024-09-05T17:31:58.883863+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:00:28.398696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"80'1491","reported_seq":4497,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.020724+0000","last_change":"2024-09-05T17:30:45.600843+0000","last_active":"2024-09-05T17:31:59.020724+0000","last_peered":"2024-09-05T17:31:59.020724+0000","last_clean":"2024-09-05T17:31:59.020724+0000","last_became_active":"2024-09-05T17:30:43.587691+0000","last_became_peered":"2024-09-05T17:30:43.587691+0000","last_unstale":"2024-09-05T17:31:59.020724+0000","last_undegraded":"2024-09-05T17:31:59.020724+0000","last_fullsized":"2024-09-05T17:31:59.020724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1491,"log_dups_size":0,"ondisk_log_size":1491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:37:29.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069190400000000002,"stat_sum":{"num_bytes":58193177,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":10182,"num_read_kb":13681,"num_write":2627,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.883991+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:31:58.883991+0000","last_peered":"2024-09-05T17:31:58.883991+0000","last_clean":"2024-09-05T17:31:58.883991+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:31:58.883991+0000","last_undegraded":"2024-09-05T17:31:58.883991+0000","last_fullsized":"2024-09-05T17:31:58.883991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":239,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.883879+0000","last_change":"2024-09-05T17:31:37.511716+0000","last_active":"2024-09-05T17:31:58.883879+0000","last_peered":"2024-09-05T17:31:58.883879+0000","last_clean":"2024-09-05T17:31:58.883879+0000","last_became_active":"2024-09-05T17:31:37.504681+0000","last_became_peered":"2024-09-05T17:31:37.504681+0000","last_unstale":"2024-09-05T17:31:58.883879+0000","last_undegraded":"2024-09-05T17:31:58.883879+0000","last_fullsized":"2024-09-05T17:31:58.883879+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:56:00.807964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"80'265","reported_seq":1756,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.938578+0000","last_change":"2024-09-05T17:30:45.601218+0000","last_active":"2024-09-05T17:31:58.938578+0000","last_peered":"2024-09-05T17:31:58.938578+0000","last_clean":"2024-09-05T17:31:58.938578+0000","last_became_active":"2024-09-05T17:30:43.584933+0000","last_became_peered":"2024-09-05T17:30:43.584933+0000","last_unstale":"2024-09-05T17:31:58.938578+0000","last_undegraded":"2024-09-05T17:31:58.938578+0000","last_fullsized":"2024-09-05T17:31:58.938578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:35:11.795884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097333599999999999,"stat_sum":{"num_bytes":69251858,"num_objects":48,"num_object_clones":13,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":1511,"num_read_kb":10347,"num_write":294,"num_write_kb":10031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"80'481","reported_seq":3652,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.987315+0000","last_change":"2024-09-05T17:30:45.577452+0000","last_active":"2024-09-05T17:31:58.987315+0000","last_peered":"2024-09-05T17:31:58.987315+0000","last_clean":"2024-09-05T17:31:58.987315+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:31:58.987315+0000","last_undegraded":"2024-09-05T17:31:58.987315+0000","last_fullsized":"2024-09-05T17:31:58.987315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:17:22.185835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00119338,"stat_sum":{"num_bytes":28571526,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":6,"num_read":5492,"num_read_kb":11372,"num_write":666,"num_write_kb":3494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"80'333","reported_seq":3228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.028425+0000","last_change":"2024-09-05T17:30:45.806921+0000","last_active":"2024-09-05T17:31:59.028425+0000","last_peered":"2024-09-05T17:31:59.028425+0000","last_clean":"2024-09-05T17:31:59.028425+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:31:59.028425+0000","last_undegraded":"2024-09-05T17:31:59.028425+0000","last_fullsized":"2024-09-05T17:31:59.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:53.071655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092165900000000002,"stat_sum":{"num_bytes":26097545,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":3133,"num_read_kb":12194,"num_write":373,"num_write_kb":3143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"80'876","reported_seq":9858,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.062489+0000","last_change":"2024-09-05T17:31:40.517130+0000","last_active":"2024-09-05T17:31:59.062489+0000","last_peered":"2024-09-05T17:31:59.062489+0000","last_clean":"2024-09-05T17:31:59.062489+0000","last_became_active":"2024-09-05T17:31:40.516020+0000","last_became_peered":"2024-09-05T17:31:40.516020+0000","last_unstale":"2024-09-05T17:31:59.062489+0000","last_undegraded":"2024-09-05T17:31:59.062489+0000","last_fullsized":"2024-09-05T17:31:59.062489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:06:21.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053415,"stat_sum":{"num_bytes":66367555,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":8,"num_read":12842,"num_read_kb":26127,"num_write":1314,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":3050131,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"80'226","reported_seq":487,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.051839+0000","last_change":"2024-09-05T17:30:45.586557+0000","last_active":"2024-09-05T17:31:59.051839+0000","last_peered":"2024-09-05T17:31:59.051839+0000","last_clean":"2024-09-05T17:31:59.051839+0000","last_became_active":"2024-09-05T17:30:43.586452+0000","last_became_peered":"2024-09-05T17:30:43.586452+0000","last_unstale":"2024-09-05T17:31:59.051839+0000","last_undegraded":"2024-09-05T17:31:59.051839+0000","last_fullsized":"2024-09-05T17:31:59.051839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:45:37.683164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012305,"stat_sum":{"num_bytes":20526442,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":11,"num_read":165,"num_read_kb":2941,"num_write":218,"num_write_kb":2295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"80'251","reported_seq":567,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.957101+0000","last_change":"2024-09-05T17:30:46.333102+0000","last_active":"2024-09-05T17:31:58.957101+0000","last_peered":"2024-09-05T17:31:58.957101+0000","last_clean":"2024-09-05T17:31:58.957101+0000","last_became_active":"2024-09-05T17:30:43.600919+0000","last_became_peered":"2024-09-05T17:30:43.600919+0000","last_unstale":"2024-09-05T17:31:58.957101+0000","last_undegraded":"2024-09-05T17:31:58.957101+0000","last_fullsized":"2024-09-05T17:31:58.957101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:01:40.578288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002229342,"stat_sum":{"num_bytes":41874463,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":237,"num_read_kb":3999,"num_write":255,"num_write_kb":2641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"79'149","reported_seq":750,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.884125+0000","last_change":"2024-09-05T17:30:46.333307+0000","last_active":"2024-09-05T17:31:58.884125+0000","last_peered":"2024-09-05T17:31:58.884125+0000","last_clean":"2024-09-05T17:31:58.884125+0000","last_became_active":"2024-09-05T17:30:43.600952+0000","last_became_peered":"2024-09-05T17:30:43.600952+0000","last_unstale":"2024-09-05T17:31:58.884125+0000","last_undegraded":"2024-09-05T17:31:58.884125+0000","last_fullsized":"2024-09-05T17:31:58.884125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.707356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019952949999999998,"stat_sum":{"num_bytes":29819662,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":6,"num_read":512,"num_read_kb":10155,"num_write":157,"num_write_kb":13072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"80'342","reported_seq":3229,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.031439+0000","last_change":"2024-09-05T17:30:46.332586+0000","last_active":"2024-09-05T17:31:59.031439+0000","last_peered":"2024-09-05T17:31:59.031439+0000","last_clean":"2024-09-05T17:31:59.031439+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:31:59.031439+0000","last_undegraded":"2024-09-05T17:31:59.031439+0000","last_fullsized":"2024-09-05T17:31:59.031439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:47:25.800171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001698326,"stat_sum":{"num_bytes":18343959,"num_objects":47,"num_object_clones":12,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":3721,"num_read_kb":5570,"num_write":391,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"80'415","reported_seq":3154,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.050348+0000","last_change":"2024-09-05T17:31:40.512427+0000","last_active":"2024-09-05T17:31:59.050348+0000","last_peered":"2024-09-05T17:31:59.050348+0000","last_clean":"2024-09-05T17:31:59.050348+0000","last_became_active":"2024-09-05T17:31:40.510272+0000","last_became_peered":"2024-09-05T17:31:40.510272+0000","last_unstale":"2024-09-05T17:31:59.050348+0000","last_undegraded":"2024-09-05T17:31:59.050348+0000","last_fullsized":"2024-09-05T17:31:59.050348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:58:33.098629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000919516,"stat_sum":{"num_bytes":28684615,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":3436,"num_read_kb":7208,"num_write":563,"num_write_kb":3210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":956848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"80'232","reported_seq":666,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.027612+0000","last_change":"2024-09-05T17:30:46.332397+0000","last_active":"2024-09-05T17:31:59.027612+0000","last_peered":"2024-09-05T17:31:59.027612+0000","last_clean":"2024-09-05T17:31:59.027612+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:31:59.027612+0000","last_undegraded":"2024-09-05T17:31:59.027612+0000","last_fullsized":"2024-09-05T17:31:59.027612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:34:40.651236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015389449999999999,"stat_sum":{"num_bytes":24870861,"num_objects":44,"num_object_clones":7,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":6,"num_read":355,"num_read_kb":2378,"num_write":236,"num_write_kb":1971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"80'460","reported_seq":7890,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.030903+0000","last_change":"2024-09-05T17:31:40.508329+0000","last_active":"2024-09-05T17:31:59.030903+0000","last_peered":"2024-09-05T17:31:59.030903+0000","last_clean":"2024-09-05T17:31:59.030903+0000","last_became_active":"2024-09-05T17:31:40.506264+0000","last_became_peered":"2024-09-05T17:31:40.506264+0000","last_unstale":"2024-09-05T17:31:59.030903+0000","last_undegraded":"2024-09-05T17:31:59.030903+0000","last_fullsized":"2024-09-05T17:31:59.030903+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:31:29.969294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164483,"stat_sum":{"num_bytes":64305364,"num_objects":51,"num_object_clones":18,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":15,"num_read":8861,"num_read_kb":18741,"num_write":517,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":2551062,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"80'279","reported_seq":1161,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.028581+0000","last_change":"2024-09-05T17:30:46.331733+0000","last_active":"2024-09-05T17:31:59.028581+0000","last_peered":"2024-09-05T17:31:59.028581+0000","last_clean":"2024-09-05T17:31:59.028581+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:31:59.028581+0000","last_undegraded":"2024-09-05T17:31:59.028581+0000","last_fullsized":"2024-09-05T17:31:59.028581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:01:07.956890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099853899999999989,"stat_sum":{"num_bytes":21968085,"num_objects":46,"num_object_clones":10,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":9,"num_read":2045,"num_read_kb":5367,"num_write":266,"num_write_kb":3020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1008895226,"num_objects":1325,"num_object_clones":322,"num_object_copies":2650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1325,"num_whiteouts":261,"num_read":124919,"num_read_kb":297216,"num_write":17022,"num_write_kb":148505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":676,"num_bytes_recovered":22049655,"num_keys_recovered":72,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32325632,"data_stored":235148532,"data_compressed":9065680,"data_compressed_allocated":19529728,"data_compressed_original":227496702,"omap_allocated":0,"internal_metadata":0},"log_size":13129,"ondisk_log_size":13129,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":17596,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":5580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":5713920,"data_stored":33570070,"data_compressed":1286953,"data_compressed_allocated":2691072,"data_compressed_original":31912735,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37996,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333844,"statfs":{"total":96636764160,"available":96597856256,"internally_reserved":0,"allocated":2707456,"data_stored":11013979,"data_compressed":443534,"data_compressed_allocated":978944,"data_compressed_original":10121216,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,39,39],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54560,"kb_used_data":5324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94317280,"statfs":{"total":96636764160,"available":96580894720,"internally_reserved":0,"allocated":5451776,"data_stored":32537269,"data_compressed":1402799,"data_compressed_allocated":2768896,"data_compressed_original":31049351,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39340,"kb_used_data":8148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332500,"statfs":{"total":96636764160,"available":96596480000,"internally_reserved":0,"allocated":8343552,"data_stored":56783341,"data_compressed":1958645,"data_compressed_allocated":4440064,"data_compressed_original":54573466,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60240,"kb_used_data":6848,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311600,"statfs":{"total":96636764160,"available":96575078400,"internally_reserved":0,"allocated":7012352,"data_stored":41163604,"data_compressed":1888958,"data_compressed_allocated":3829760,"data_compressed_original":39397482,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41920,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329920,"statfs":{"total":96636764160,"available":96593838080,"internally_reserved":0,"allocated":2473984,"data_stored":9318004,"data_compressed":420111,"data_compressed_allocated":819200,"data_compressed_original":8468773,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30904,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340936,"statfs":{"total":96636764160,"available":96605118464,"internally_reserved":0,"allocated":3973120,"data_stored":22630740,"data_compressed":780872,"data_compressed_allocated":1789952,"data_compressed_original":21501777,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":60129542166,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3162112,"data_stored":32212042,"data_compressed":895810,"data_compressed_allocated":2285568,"data_compressed_original":31635166,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3031040,"data_stored":22203482,"data_compressed":780872,"data_compressed_allocated":1789952,"data_compressed_original":21501777,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1552384,"data_stored":8898996,"data_compressed":420111,"data_compressed_allocated":819200,"data_compressed_original":8468773,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6074368,"data_stored":40736365,"data_compressed":1888958,"data_compressed_allocated":3829760,"data_compressed_original":39397482,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7405568,"data_stored":56356102,"data_compressed":1958645,"data_compressed_allocated":4440064,"data_compressed_original":54573466,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":32192710,"data_compressed":1402799,"data_compressed_allocated":2768896,"data_compressed_original":31049351,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":9996372,"data_compressed":437126,"data_compressed_allocated":942080,"data_compressed_original":9531392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4718592,"data_stored":32552463,"data_compressed":1281359,"data_compressed_allocated":2654208,"data_compressed_original":31339295,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:32:02.293 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:32:02.362 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:02.362 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:02.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:02.362 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:02.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.362 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:32:02.362 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:02.362 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.116634378000001, 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:32:02.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.595691528000003, 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:32:02.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.372 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:32:02.372 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:02.372 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.391733627999997, 2024-09-05T17:32:02.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.153738799000003, 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:02.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:32:02.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:32:02.382 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.140724259000002, 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:32:02.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:32:02.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:32:02.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.138460328999997, 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:32:02.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.136368554999997, 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:32:02.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:32:02.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.397 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51735 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'202, mlcod=54'198)", 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.225054593000003, 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032394590000000001, 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137895+0000", 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4780000000000001e-06 2024-09-05T17:32:02.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137904+0000", 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137926+0000", 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1013999999999999e-05 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137939+0000", 2024-09-05T17:32:02.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.342e-05 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138024+0000", 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5167000000000006e-05 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138055+0000", 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0982000000000003e-05 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.140997+0000", 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029416329999999999 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141133+0000", 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013600799999999999 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51736 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'203, mlcod=54'199)", 2024-09-05T17:32:02.402 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.223389255999997, 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003209534, 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139559+0000", 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139560+0000", 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5629999999999999e-06 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139573+0000", 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2595999999999999e-05 2024-09-05T17:32:02.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139599+0000", 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6188999999999999e-05 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139616+0000", 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7356000000000001e-05 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139775+0000", 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000158763 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.139835+0000", 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.037e-05 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.142662+0000", 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00282636 2024-09-05T17:32:02.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.142768+0000", 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106337 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.221580084999999, 2024-09-05T17:32:02.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:32:02.408 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.408 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:02.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:32:02.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:02.412 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.829439097000002, 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:32:02.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:32:02.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:32:02.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:32:02.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:32:02.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:32:02.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.417 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54994 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'375, mlcod=60'373)", 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.813056457999998, 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032305459999999999, 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549893+0000", 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549906+0000", 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2974e-05 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549936+0000", 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0079000000000001e-05 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549954+0000", 2024-09-05T17:32:02.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7912999999999999e-05 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550156+0000", 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149400000000001 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550246+0000", 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0470000000000006e-05 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553025+0000", 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027789780000000001 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553122+0000", 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6804000000000004e-05 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.807800948000001, 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:32:02.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.231601067, 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:32:02.427 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:02.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:32:02.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:32:02.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:02.432 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.5786029519999998, 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:32:02.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:32:02.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.437 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.5779971039999996, 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:32:02.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:32:02.442 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.5774311729999999, 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:02.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:32:02.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.5767762320000003, 2024-09-05T17:32:02.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:32:02.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.5760758429999999, 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:32:02.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.574807227, 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:02.457 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:32:02.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:32:02.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:02.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:02.461 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:02.463 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:02.463 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:02.461+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:02.564 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:02.564+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:02.624 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:02.624 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:02.624 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:02.624 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:02.633 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:32:02.634 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:32:02.639 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:02.654 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-05T17:32:01.901796+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1009485613,"num_objects":1329,"num_object_clones":322,"num_object_copies":2658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1329,"num_whiteouts":261,"num_read":124985,"num_read_kb":297271,"num_write":17125,"num_write_kb":150135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":678,"num_bytes_recovered":22640023,"num_keys_recovered":72,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13204,"ondisk_log_size":13204,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":297572,"kb_used_data":34840,"kb_used_omap":10,"kb_used_meta":262581,"kb_avail":660305308,"statfs":{"total":676457349120,"available":676152635392,"internally_reserved":0,"allocated":35676160,"data_stored":207017007,"data_compressed":8181872,"data_compressed_allocated":17317888,"data_compressed_original":197024800,"omap_allocated":11156,"internal_metadata":268883052},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,39,39],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47382291,"num_objects":351,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":351,"num_whiteouts":0,"num_read":34333,"num_read_kb":59259,"num_write":2546,"num_write_kb":17948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029044"},"pg_stats":[{"pgid":"3.1f","version":"80'248","reported_seq":2201,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.038732+0000","last_change":"2024-09-05T17:31:40.516183+0000","last_active":"2024-09-05T17:31:59.038732+0000","last_peered":"2024-09-05T17:31:59.038732+0000","last_clean":"2024-09-05T17:31:59.038732+0000","last_became_active":"2024-09-05T17:31:40.513715+0000","last_became_peered":"2024-09-05T17:31:40.513715+0000","last_unstale":"2024-09-05T17:31:59.038732+0000","last_undegraded":"2024-09-05T17:31:59.038732+0000","last_fullsized":"2024-09-05T17:31:59.038732+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:09:48.932466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023314770000000002,"stat_sum":{"num_bytes":43511957,"num_objects":45,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":9,"num_read":2313,"num_read_kb":9684,"num_write":275,"num_write_kb":5764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":3163339,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"80'242","reported_seq":886,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.950779+0000","last_change":"2024-09-05T17:30:45.601580+0000","last_active":"2024-09-05T17:31:58.950779+0000","last_peered":"2024-09-05T17:31:58.950779+0000","last_clean":"2024-09-05T17:31:58.950779+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:31:58.950779+0000","last_undegraded":"2024-09-05T17:31:58.950779+0000","last_fullsized":"2024-09-05T17:31:58.950779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:23:33.144627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012442379999999999,"stat_sum":{"num_bytes":4103971,"num_objects":21,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":4,"num_read":1352,"num_read_kb":1875,"num_write":255,"num_write_kb":3832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"80'301","reported_seq":2141,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.027418+0000","last_change":"2024-09-05T17:30:45.585378+0000","last_active":"2024-09-05T17:31:59.027418+0000","last_peered":"2024-09-05T17:31:59.027418+0000","last_clean":"2024-09-05T17:31:59.027418+0000","last_became_active":"2024-09-05T17:30:43.597087+0000","last_became_peered":"2024-09-05T17:30:43.597087+0000","last_unstale":"2024-09-05T17:31:59.027418+0000","last_undegraded":"2024-09-05T17:31:59.027418+0000","last_fullsized":"2024-09-05T17:31:59.027418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:15:12.947967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064572499999999999,"stat_sum":{"num_bytes":47652264,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":7,"num_read":2686,"num_read_kb":6743,"num_write":357,"num_write_kb":4073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"80'266","reported_seq":2079,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.061356+0000","last_change":"2024-09-05T17:30:45.586287+0000","last_active":"2024-09-05T17:31:59.061356+0000","last_peered":"2024-09-05T17:31:59.061356+0000","last_clean":"2024-09-05T17:31:59.061356+0000","last_became_active":"2024-09-05T17:30:43.604511+0000","last_became_peered":"2024-09-05T17:30:43.604511+0000","last_unstale":"2024-09-05T17:31:59.061356+0000","last_undegraded":"2024-09-05T17:31:59.061356+0000","last_fullsized":"2024-09-05T17:31:59.061356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:42:59.047923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015056150000000001,"stat_sum":{"num_bytes":12077781,"num_objects":42,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":5,"num_read":1770,"num_read_kb":3878,"num_write":277,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'240","reported_seq":801,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.044665+0000","last_change":"2024-09-05T17:31:40.517437+0000","last_active":"2024-09-05T17:31:59.044665+0000","last_peered":"2024-09-05T17:31:59.044665+0000","last_clean":"2024-09-05T17:31:59.044665+0000","last_became_active":"2024-09-05T17:31:40.514621+0000","last_became_peered":"2024-09-05T17:31:40.514621+0000","last_unstale":"2024-09-05T17:31:59.044665+0000","last_undegraded":"2024-09-05T17:31:59.044665+0000","last_fullsized":"2024-09-05T17:31:59.044665+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:58:24.913685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001548448,"stat_sum":{"num_bytes":53270359,"num_objects":36,"num_object_clones":9,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":6,"num_read":462,"num_read_kb":3827,"num_write":241,"num_write_kb":4167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1722378,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"80'516","reported_seq":3938,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.004884+0000","last_change":"2024-09-05T17:31:31.709738+0000","last_active":"2024-09-05T17:31:59.004884+0000","last_peered":"2024-09-05T17:31:59.004884+0000","last_clean":"2024-09-05T17:31:59.004884+0000","last_became_active":"2024-09-05T17:31:31.708688+0000","last_became_peered":"2024-09-05T17:31:31.708688+0000","last_unstale":"2024-09-05T17:31:59.004884+0000","last_undegraded":"2024-09-05T17:31:59.004884+0000","last_fullsized":"2024-09-05T17:31:59.004884+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:23:50.366842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058024300000000003,"stat_sum":{"num_bytes":17898622,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":5575,"num_read_kb":7132,"num_write":616,"num_write_kb":3266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"80'268","reported_seq":5758,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.050462+0000","last_change":"2024-09-05T17:30:45.579337+0000","last_active":"2024-09-05T17:31:59.050462+0000","last_peered":"2024-09-05T17:31:59.050462+0000","last_clean":"2024-09-05T17:31:59.050462+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:31:59.050462+0000","last_undegraded":"2024-09-05T17:31:59.050462+0000","last_fullsized":"2024-09-05T17:31:59.050462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:14:04.774299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096919599999999997,"stat_sum":{"num_bytes":46340692,"num_objects":34,"num_object_clones":4,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":5,"num_read":5494,"num_read_kb":14844,"num_write":281,"num_write_kb":2955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"80'191","reported_seq":990,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.023135+0000","last_change":"2024-09-05T17:31:40.506212+0000","last_active":"2024-09-05T17:31:59.023135+0000","last_peered":"2024-09-05T17:31:59.023135+0000","last_clean":"2024-09-05T17:31:59.023135+0000","last_became_active":"2024-09-05T17:31:40.505420+0000","last_became_peered":"2024-09-05T17:31:40.505420+0000","last_unstale":"2024-09-05T17:31:59.023135+0000","last_undegraded":"2024-09-05T17:31:59.023135+0000","last_fullsized":"2024-09-05T17:31:59.023135+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:21:44.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371232,"stat_sum":{"num_bytes":9131352,"num_objects":34,"num_object_clones":11,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":7,"num_read":587,"num_read_kb":4238,"num_write":198,"num_write_kb":4490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":49,"num_bytes_recovered":1454927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"80'433","reported_seq":1046,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.040979+0000","last_change":"2024-09-05T17:31:40.512725+0000","last_active":"2024-09-05T17:31:59.040979+0000","last_peered":"2024-09-05T17:31:59.040979+0000","last_clean":"2024-09-05T17:31:59.040979+0000","last_became_active":"2024-09-05T17:31:40.509920+0000","last_became_peered":"2024-09-05T17:31:40.509920+0000","last_unstale":"2024-09-05T17:31:59.040979+0000","last_undegraded":"2024-09-05T17:31:59.040979+0000","last_fullsized":"2024-09-05T17:31:59.040979+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:52:16.293828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024520119999999999,"stat_sum":{"num_bytes":12869744,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":3,"num_read":1654,"num_read_kb":1642,"num_write":577,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":52,"num_bytes_recovered":64694,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"80'574","reported_seq":1328,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.987163+0000","last_change":"2024-09-05T17:30:45.586718+0000","last_active":"2024-09-05T17:31:58.987163+0000","last_peered":"2024-09-05T17:31:58.987163+0000","last_clean":"2024-09-05T17:31:58.987163+0000","last_became_active":"2024-09-05T17:30:43.604988+0000","last_became_peered":"2024-09-05T17:30:43.604988+0000","last_unstale":"2024-09-05T17:31:58.987163+0000","last_undegraded":"2024-09-05T17:31:58.987163+0000","last_fullsized":"2024-09-05T17:31:58.987163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:09:53.810429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017597120000000001,"stat_sum":{"num_bytes":18260193,"num_objects":51,"num_object_clones":14,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":2721,"num_read_kb":5121,"num_write":799,"num_write_kb":3054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"80'210","reported_seq":692,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.986308+0000","last_change":"2024-09-05T17:30:46.331830+0000","last_active":"2024-09-05T17:31:58.986308+0000","last_peered":"2024-09-05T17:31:58.986308+0000","last_clean":"2024-09-05T17:31:58.986308+0000","last_became_active":"2024-09-05T17:30:43.598646+0000","last_became_peered":"2024-09-05T17:30:43.598646+0000","last_unstale":"2024-09-05T17:31:58.986308+0000","last_undegraded":"2024-09-05T17:31:58.986308+0000","last_fullsized":"2024-09-05T17:31:58.986308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:59:48.641422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010679610000000001,"stat_sum":{"num_bytes":7686709,"num_objects":41,"num_object_clones":12,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":11,"num_read":414,"num_read_kb":2246,"num_write":186,"num_write_kb":2013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"80'338","reported_seq":13037,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.062949+0000","last_change":"2024-09-05T17:31:31.709878+0000","last_active":"2024-09-05T17:31:59.062949+0000","last_peered":"2024-09-05T17:31:59.062949+0000","last_clean":"2024-09-05T17:31:59.062949+0000","last_became_active":"2024-09-05T17:31:31.707629+0000","last_became_peered":"2024-09-05T17:31:31.707629+0000","last_unstale":"2024-09-05T17:31:59.062949+0000","last_undegraded":"2024-09-05T17:31:59.062949+0000","last_fullsized":"2024-09-05T17:31:59.062949+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:07:45.057665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010724350000000001,"stat_sum":{"num_bytes":44068317,"num_objects":46,"num_object_clones":12,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":10,"num_read":13665,"num_read_kb":30691,"num_write":334,"num_write_kb":3348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.880021+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:31:58.880021+0000","last_peered":"2024-09-05T17:31:58.880021+0000","last_clean":"2024-09-05T17:31:58.880021+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:31:58.880021+0000","last_undegraded":"2024-09-05T17:31:58.880021+0000","last_fullsized":"2024-09-05T17:31:58.880021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"80'356","reported_seq":4844,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.028588+0000","last_change":"2024-09-05T17:31:40.515933+0000","last_active":"2024-09-05T17:31:59.028588+0000","last_peered":"2024-09-05T17:31:59.028588+0000","last_clean":"2024-09-05T17:31:59.028588+0000","last_became_active":"2024-09-05T17:31:40.515069+0000","last_became_peered":"2024-09-05T17:31:40.515069+0000","last_unstale":"2024-09-05T17:31:59.028588+0000","last_undegraded":"2024-09-05T17:31:59.028588+0000","last_fullsized":"2024-09-05T17:31:59.028588+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:42:23.668567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024656499999999998,"stat_sum":{"num_bytes":34108550,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":9,"num_read":5833,"num_read_kb":18253,"num_write":347,"num_write_kb":6422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":4774793,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.887295+0000","last_change":"2024-09-05T17:30:34.074353+0000","last_active":"2024-09-05T17:31:58.887295+0000","last_peered":"2024-09-05T17:31:58.887295+0000","last_clean":"2024-09-05T17:31:58.887295+0000","last_became_active":"2024-09-05T17:30:32.048756+0000","last_became_peered":"2024-09-05T17:30:32.048756+0000","last_unstale":"2024-09-05T17:31:58.887295+0000","last_undegraded":"2024-09-05T17:31:58.887295+0000","last_fullsized":"2024-09-05T17:31:58.887295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:32:42.952279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094457299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"80'332","reported_seq":631,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.032008+0000","last_change":"2024-09-05T17:31:18.499515+0000","last_active":"2024-09-05T17:31:59.032008+0000","last_peered":"2024-09-05T17:31:59.032008+0000","last_clean":"2024-09-05T17:31:59.032008+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:31:59.032008+0000","last_undegraded":"2024-09-05T17:31:59.032008+0000","last_fullsized":"2024-09-05T17:31:59.032008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:23:28.114361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062572599999999995,"stat_sum":{"num_bytes":18499839,"num_objects":30,"num_object_clones":4,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":5,"num_read":662,"num_read_kb":1875,"num_write":409,"num_write_kb":2352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.884615+0000","last_change":"2024-09-05T17:31:37.502979+0000","last_active":"2024-09-05T17:31:58.884615+0000","last_peered":"2024-09-05T17:31:58.884615+0000","last_clean":"2024-09-05T17:31:58.884615+0000","last_became_active":"2024-09-05T17:31:37.502514+0000","last_became_peered":"2024-09-05T17:31:37.502514+0000","last_unstale":"2024-09-05T17:31:58.884615+0000","last_undegraded":"2024-09-05T17:31:58.884615+0000","last_fullsized":"2024-09-05T17:31:58.884615+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:26:03.249089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"80'483","reported_seq":2139,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.017390+0000","last_change":"2024-09-05T17:30:45.579183+0000","last_active":"2024-09-05T17:31:59.017390+0000","last_peered":"2024-09-05T17:31:59.017390+0000","last_clean":"2024-09-05T17:31:59.017390+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:31:59.017390+0000","last_undegraded":"2024-09-05T17:31:59.017390+0000","last_fullsized":"2024-09-05T17:31:59.017390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:57:22.368350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075116199999999999,"stat_sum":{"num_bytes":20543784,"num_objects":35,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":6,"num_read":3608,"num_read_kb":4787,"num_write":672,"num_write_kb":2958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.887265+0000","last_change":"2024-09-05T17:31:37.508050+0000","last_active":"2024-09-05T17:31:58.887265+0000","last_peered":"2024-09-05T17:31:58.887265+0000","last_clean":"2024-09-05T17:31:58.887265+0000","last_became_active":"2024-09-05T17:31:37.507154+0000","last_became_peered":"2024-09-05T17:31:37.507154+0000","last_unstale":"2024-09-05T17:31:58.887265+0000","last_undegraded":"2024-09-05T17:31:58.887265+0000","last_fullsized":"2024-09-05T17:31:58.887265+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:03:10.252281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"80'383","reported_seq":1104,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.027610+0000","last_change":"2024-09-05T17:30:45.585838+0000","last_active":"2024-09-05T17:31:59.027610+0000","last_peered":"2024-09-05T17:31:59.027610+0000","last_clean":"2024-09-05T17:31:59.027610+0000","last_became_active":"2024-09-05T17:30:43.586429+0000","last_became_peered":"2024-09-05T17:30:43.586429+0000","last_unstale":"2024-09-05T17:31:59.027610+0000","last_undegraded":"2024-09-05T17:31:59.027610+0000","last_fullsized":"2024-09-05T17:31:59.027610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:36:44.867596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010231579999999999,"stat_sum":{"num_bytes":40712571,"num_objects":50,"num_object_clones":11,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":8,"num_read":1589,"num_read_kb":12993,"num_write":436,"num_write_kb":10537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"80'322","reported_seq":5725,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.031433+0000","last_change":"2024-09-05T17:31:40.517833+0000","last_active":"2024-09-05T17:31:59.031433+0000","last_peered":"2024-09-05T17:31:59.031433+0000","last_clean":"2024-09-05T17:31:59.031433+0000","last_became_active":"2024-09-05T17:31:40.514987+0000","last_became_peered":"2024-09-05T17:31:40.514987+0000","last_unstale":"2024-09-05T17:31:59.031433+0000","last_undegraded":"2024-09-05T17:31:59.031433+0000","last_fullsized":"2024-09-05T17:31:59.031433+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:51:56.762547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077238000000000003,"stat_sum":{"num_bytes":15464463,"num_objects":38,"num_object_clones":12,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":7,"num_read":6045,"num_read_kb":12813,"num_write":355,"num_write_kb":5000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":2070576,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":138,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.884075+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:31:58.884075+0000","last_peered":"2024-09-05T17:31:58.884075+0000","last_clean":"2024-09-05T17:31:58.884075+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:31:58.884075+0000","last_undegraded":"2024-09-05T17:31:58.884075+0000","last_fullsized":"2024-09-05T17:31:58.884075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"80'1197","reported_seq":2786,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.050613+0000","last_change":"2024-09-05T17:30:45.580126+0000","last_active":"2024-09-05T17:31:59.050613+0000","last_peered":"2024-09-05T17:31:59.050613+0000","last_clean":"2024-09-05T17:31:59.050613+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:31:59.050613+0000","last_undegraded":"2024-09-05T17:31:59.050613+0000","last_fullsized":"2024-09-05T17:31:59.050613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1197,"log_dups_size":0,"ondisk_log_size":1197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:42:50.644393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093389999999999999,"stat_sum":{"num_bytes":25247426,"num_objects":55,"num_object_clones":15,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":14,"num_read":7228,"num_read_kb":8067,"num_write":2029,"num_write_kb":4782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":136,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.891799+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:31:58.891799+0000","last_peered":"2024-09-05T17:31:58.891799+0000","last_clean":"2024-09-05T17:31:58.891799+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:31:58.891799+0000","last_undegraded":"2024-09-05T17:31:58.891799+0000","last_fullsized":"2024-09-05T17:31:58.891799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"80'429","reported_seq":7417,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.062735+0000","last_change":"2024-09-05T17:31:40.514252+0000","last_active":"2024-09-05T17:31:59.062735+0000","last_peered":"2024-09-05T17:31:59.062735+0000","last_clean":"2024-09-05T17:31:59.062735+0000","last_became_active":"2024-09-05T17:31:40.513375+0000","last_became_peered":"2024-09-05T17:31:40.513375+0000","last_unstale":"2024-09-05T17:31:59.062735+0000","last_undegraded":"2024-09-05T17:31:59.062735+0000","last_fullsized":"2024-09-05T17:31:59.062735+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:20:13.187694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001490367,"stat_sum":{"num_bytes":38571520,"num_objects":50,"num_object_clones":12,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":8769,"num_read_kb":16427,"num_write":501,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":2048426,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.883863+0000","last_change":"2024-09-05T17:31:03.554542+0000","last_active":"2024-09-05T17:31:58.883863+0000","last_peered":"2024-09-05T17:31:58.883863+0000","last_clean":"2024-09-05T17:31:58.883863+0000","last_became_active":"2024-09-05T17:31:03.554149+0000","last_became_peered":"2024-09-05T17:31:03.554149+0000","last_unstale":"2024-09-05T17:31:58.883863+0000","last_undegraded":"2024-09-05T17:31:58.883863+0000","last_fullsized":"2024-09-05T17:31:58.883863+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:00:28.398696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"80'1491","reported_seq":4497,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.020724+0000","last_change":"2024-09-05T17:30:45.600843+0000","last_active":"2024-09-05T17:31:59.020724+0000","last_peered":"2024-09-05T17:31:59.020724+0000","last_clean":"2024-09-05T17:31:59.020724+0000","last_became_active":"2024-09-05T17:30:43.587691+0000","last_became_peered":"2024-09-05T17:30:43.587691+0000","last_unstale":"2024-09-05T17:31:59.020724+0000","last_undegraded":"2024-09-05T17:31:59.020724+0000","last_fullsized":"2024-09-05T17:31:59.020724+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1491,"log_dups_size":0,"ondisk_log_size":1491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:37:29.190252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069190400000000002,"stat_sum":{"num_bytes":58193177,"num_objects":47,"num_object_clones":14,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":10182,"num_read_kb":13681,"num_write":2627,"num_write_kb":4390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":137,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.883991+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:31:58.883991+0000","last_peered":"2024-09-05T17:31:58.883991+0000","last_clean":"2024-09-05T17:31:58.883991+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:31:58.883991+0000","last_undegraded":"2024-09-05T17:31:58.883991+0000","last_fullsized":"2024-09-05T17:31:58.883991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":239,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.883879+0000","last_change":"2024-09-05T17:31:37.511716+0000","last_active":"2024-09-05T17:31:58.883879+0000","last_peered":"2024-09-05T17:31:58.883879+0000","last_clean":"2024-09-05T17:31:58.883879+0000","last_became_active":"2024-09-05T17:31:37.504681+0000","last_became_peered":"2024-09-05T17:31:37.504681+0000","last_unstale":"2024-09-05T17:31:58.883879+0000","last_undegraded":"2024-09-05T17:31:58.883879+0000","last_fullsized":"2024-09-05T17:31:58.883879+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:56:00.807964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"80'265","reported_seq":1756,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.938578+0000","last_change":"2024-09-05T17:30:45.601218+0000","last_active":"2024-09-05T17:31:58.938578+0000","last_peered":"2024-09-05T17:31:58.938578+0000","last_clean":"2024-09-05T17:31:58.938578+0000","last_became_active":"2024-09-05T17:30:43.584933+0000","last_became_peered":"2024-09-05T17:30:43.584933+0000","last_unstale":"2024-09-05T17:31:58.938578+0000","last_undegraded":"2024-09-05T17:31:58.938578+0000","last_fullsized":"2024-09-05T17:31:58.938578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:35:11.795884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097333599999999999,"stat_sum":{"num_bytes":69251858,"num_objects":48,"num_object_clones":13,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":12,"num_read":1511,"num_read_kb":10347,"num_write":294,"num_write_kb":10031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"80'481","reported_seq":3652,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.987315+0000","last_change":"2024-09-05T17:30:45.577452+0000","last_active":"2024-09-05T17:31:58.987315+0000","last_peered":"2024-09-05T17:31:58.987315+0000","last_clean":"2024-09-05T17:31:58.987315+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:31:58.987315+0000","last_undegraded":"2024-09-05T17:31:58.987315+0000","last_fullsized":"2024-09-05T17:31:58.987315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:17:22.185835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00119338,"stat_sum":{"num_bytes":28571526,"num_objects":45,"num_object_clones":10,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":6,"num_read":5492,"num_read_kb":11372,"num_write":666,"num_write_kb":3494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"80'333","reported_seq":3228,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.028425+0000","last_change":"2024-09-05T17:30:45.806921+0000","last_active":"2024-09-05T17:31:59.028425+0000","last_peered":"2024-09-05T17:31:59.028425+0000","last_clean":"2024-09-05T17:31:59.028425+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:31:59.028425+0000","last_undegraded":"2024-09-05T17:31:59.028425+0000","last_fullsized":"2024-09-05T17:31:59.028425+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:53.071655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092165900000000002,"stat_sum":{"num_bytes":26097545,"num_objects":41,"num_object_clones":8,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":3133,"num_read_kb":12194,"num_write":373,"num_write_kb":3143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"80'876","reported_seq":9858,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.062489+0000","last_change":"2024-09-05T17:31:40.517130+0000","last_active":"2024-09-05T17:31:59.062489+0000","last_peered":"2024-09-05T17:31:59.062489+0000","last_clean":"2024-09-05T17:31:59.062489+0000","last_became_active":"2024-09-05T17:31:40.516020+0000","last_became_peered":"2024-09-05T17:31:40.516020+0000","last_unstale":"2024-09-05T17:31:59.062489+0000","last_undegraded":"2024-09-05T17:31:59.062489+0000","last_fullsized":"2024-09-05T17:31:59.062489+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:06:21.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053415,"stat_sum":{"num_bytes":66367555,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":8,"num_read":12842,"num_read_kb":26127,"num_write":1314,"num_write_kb":8822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":3050131,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"80'226","reported_seq":487,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.051839+0000","last_change":"2024-09-05T17:30:45.586557+0000","last_active":"2024-09-05T17:31:59.051839+0000","last_peered":"2024-09-05T17:31:59.051839+0000","last_clean":"2024-09-05T17:31:59.051839+0000","last_became_active":"2024-09-05T17:30:43.586452+0000","last_became_peered":"2024-09-05T17:30:43.586452+0000","last_unstale":"2024-09-05T17:31:59.051839+0000","last_undegraded":"2024-09-05T17:31:59.051839+0000","last_fullsized":"2024-09-05T17:31:59.051839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:45:37.683164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012305,"stat_sum":{"num_bytes":20526442,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":11,"num_read":165,"num_read_kb":2941,"num_write":218,"num_write_kb":2295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"80'251","reported_seq":567,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.957101+0000","last_change":"2024-09-05T17:30:46.333102+0000","last_active":"2024-09-05T17:31:58.957101+0000","last_peered":"2024-09-05T17:31:58.957101+0000","last_clean":"2024-09-05T17:31:58.957101+0000","last_became_active":"2024-09-05T17:30:43.600919+0000","last_became_peered":"2024-09-05T17:30:43.600919+0000","last_unstale":"2024-09-05T17:31:58.957101+0000","last_undegraded":"2024-09-05T17:31:58.957101+0000","last_fullsized":"2024-09-05T17:31:58.957101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:01:40.578288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002229342,"stat_sum":{"num_bytes":41874463,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":237,"num_read_kb":3999,"num_write":255,"num_write_kb":2641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"79'149","reported_seq":750,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:58.884125+0000","last_change":"2024-09-05T17:30:46.333307+0000","last_active":"2024-09-05T17:31:58.884125+0000","last_peered":"2024-09-05T17:31:58.884125+0000","last_clean":"2024-09-05T17:31:58.884125+0000","last_became_active":"2024-09-05T17:30:43.600952+0000","last_became_peered":"2024-09-05T17:30:43.600952+0000","last_unstale":"2024-09-05T17:31:58.884125+0000","last_undegraded":"2024-09-05T17:31:58.884125+0000","last_fullsized":"2024-09-05T17:31:58.884125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:50:33.707356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019952949999999998,"stat_sum":{"num_bytes":29819662,"num_objects":32,"num_object_clones":8,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":6,"num_read":512,"num_read_kb":10155,"num_write":157,"num_write_kb":13072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"80'342","reported_seq":3229,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.031439+0000","last_change":"2024-09-05T17:30:46.332586+0000","last_active":"2024-09-05T17:31:59.031439+0000","last_peered":"2024-09-05T17:31:59.031439+0000","last_clean":"2024-09-05T17:31:59.031439+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:31:59.031439+0000","last_undegraded":"2024-09-05T17:31:59.031439+0000","last_fullsized":"2024-09-05T17:31:59.031439+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:47:25.800171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001698326,"stat_sum":{"num_bytes":18343959,"num_objects":47,"num_object_clones":12,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":3721,"num_read_kb":5570,"num_write":391,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"80'415","reported_seq":3154,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.050348+0000","last_change":"2024-09-05T17:31:40.512427+0000","last_active":"2024-09-05T17:31:59.050348+0000","last_peered":"2024-09-05T17:31:59.050348+0000","last_clean":"2024-09-05T17:31:59.050348+0000","last_became_active":"2024-09-05T17:31:40.510272+0000","last_became_peered":"2024-09-05T17:31:40.510272+0000","last_unstale":"2024-09-05T17:31:59.050348+0000","last_undegraded":"2024-09-05T17:31:59.050348+0000","last_fullsized":"2024-09-05T17:31:59.050348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:58:33.098629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000919516,"stat_sum":{"num_bytes":28684615,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":3436,"num_read_kb":7208,"num_write":563,"num_write_kb":3210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":71,"num_bytes_recovered":956848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"80'232","reported_seq":666,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.027612+0000","last_change":"2024-09-05T17:30:46.332397+0000","last_active":"2024-09-05T17:31:59.027612+0000","last_peered":"2024-09-05T17:31:59.027612+0000","last_clean":"2024-09-05T17:31:59.027612+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:31:59.027612+0000","last_undegraded":"2024-09-05T17:31:59.027612+0000","last_fullsized":"2024-09-05T17:31:59.027612+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:34:40.651236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015389449999999999,"stat_sum":{"num_bytes":24870861,"num_objects":44,"num_object_clones":7,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":6,"num_read":355,"num_read_kb":2378,"num_write":236,"num_write_kb":1971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"80'460","reported_seq":7890,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.030903+0000","last_change":"2024-09-05T17:31:40.508329+0000","last_active":"2024-09-05T17:31:59.030903+0000","last_peered":"2024-09-05T17:31:59.030903+0000","last_clean":"2024-09-05T17:31:59.030903+0000","last_became_active":"2024-09-05T17:31:40.506264+0000","last_became_peered":"2024-09-05T17:31:40.506264+0000","last_unstale":"2024-09-05T17:31:59.030903+0000","last_undegraded":"2024-09-05T17:31:59.030903+0000","last_fullsized":"2024-09-05T17:31:59.030903+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:31:29.969294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164483,"stat_sum":{"num_bytes":64305364,"num_objects":51,"num_object_clones":18,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":15,"num_read":8861,"num_read_kb":18741,"num_write":517,"num_write_kb":8527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":76,"num_bytes_recovered":2551062,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"80'279","reported_seq":1161,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-05T17:31:59.028581+0000","last_change":"2024-09-05T17:30:46.331733+0000","last_active":"2024-09-05T17:31:59.028581+0000","last_peered":"2024-09-05T17:31:59.028581+0000","last_clean":"2024-09-05T17:31:59.028581+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:31:59.028581+0000","last_undegraded":"2024-09-05T17:31:59.028581+0000","last_fullsized":"2024-09-05T17:31:59.028581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:01:07.956890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099853899999999989,"stat_sum":{"num_bytes":21968085,"num_objects":46,"num_object_clones":10,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":9,"num_read":2045,"num_read_kb":5367,"num_write":266,"num_write_kb":3020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1008895226,"num_objects":1325,"num_object_clones":322,"num_object_copies":2650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1325,"num_whiteouts":261,"num_read":124919,"num_read_kb":297216,"num_write":17022,"num_write_kb":148505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":676,"num_bytes_recovered":22049655,"num_keys_recovered":72,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32325632,"data_stored":235148532,"data_compressed":9065680,"data_compressed_allocated":19529728,"data_compressed_original":227496702,"omap_allocated":0,"internal_metadata":0},"log_size":13129,"ondisk_log_size":13129,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":17596,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":5580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":5713920,"data_stored":33570070,"data_compressed":1286953,"data_compressed_allocated":2691072,"data_compressed_original":31912735,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37996,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333844,"statfs":{"total":96636764160,"available":96597856256,"internally_reserved":0,"allocated":2707456,"data_stored":11013979,"data_compressed":443534,"data_compressed_allocated":978944,"data_compressed_original":10121216,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,39,39],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542166,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54560,"kb_used_data":5324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94317280,"statfs":{"total":96636764160,"available":96580894720,"internally_reserved":0,"allocated":5451776,"data_stored":32537269,"data_compressed":1402799,"data_compressed_allocated":2768896,"data_compressed_original":31049351,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542165,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39340,"kb_used_data":8148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332500,"statfs":{"total":96636764160,"available":96596480000,"internally_reserved":0,"allocated":8343552,"data_stored":56783341,"data_compressed":1958645,"data_compressed_allocated":4440064,"data_compressed_original":54573466,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60240,"kb_used_data":6848,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311600,"statfs":{"total":96636764160,"available":96575078400,"internally_reserved":0,"allocated":7012352,"data_stored":41163604,"data_compressed":1888958,"data_compressed_allocated":3829760,"data_compressed_original":39397482,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41920,"kb_used_data":2416,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329920,"statfs":{"total":96636764160,"available":96593838080,"internally_reserved":0,"allocated":2473984,"data_stored":9318004,"data_compressed":420111,"data_compressed_allocated":819200,"data_compressed_original":8468773,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30904,"kb_used_data":3880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340936,"statfs":{"total":96636764160,"available":96605118464,"internally_reserved":0,"allocated":3973120,"data_stored":22630740,"data_compressed":780872,"data_compressed_allocated":1789952,"data_compressed_original":21501777,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":60129542166,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3162112,"data_stored":32212042,"data_compressed":895810,"data_compressed_allocated":2285568,"data_compressed_original":31635166,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3031040,"data_stored":22203482,"data_compressed":780872,"data_compressed_allocated":1789952,"data_compressed_original":21501777,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1552384,"data_stored":8898996,"data_compressed":420111,"data_compressed_allocated":819200,"data_compressed_original":8468773,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6074368,"data_stored":40736365,"data_compressed":1888958,"data_compressed_allocated":3829760,"data_compressed_original":39397482,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7405568,"data_stored":56356102,"data_compressed":1958645,"data_compressed_allocated":4440064,"data_compressed_original":54573466,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4653056,"data_stored":32192710,"data_compressed":1402799,"data_compressed_allocated":2768896,"data_compressed_original":31049351,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1728512,"data_stored":9996372,"data_compressed":437126,"data_compressed_allocated":942080,"data_compressed_original":9531392,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4718592,"data_stored":32552463,"data_compressed":1281359,"data_compressed_allocated":2654208,"data_compressed_original":31339295,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:32:02.657 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-05T17:32:02.657 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:32:02.657 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.5458190809354084 2024-09-05T17:32:02.658 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.5458190809354084 2024-09-05T17:32:02.664 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:02.661+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:02.765 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:02.764+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:02.816 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:02.816 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:02.832 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:02.880 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:02.880+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:02.921 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:32:02.967 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:02.965+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:03.012 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:03.012 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:03.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:03.012 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:03.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.012 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.012 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.803497077999999, 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.013 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.802475751000003, 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:03.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.801387253000001, 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.024 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:03.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:03.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:03.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:03.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:03.029 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.800366742000001, 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.799339793000001, 2024-09-05T17:32:03.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:03.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:32:03.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:03.039 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.796997195000003, 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:03.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:32:03.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:32:03.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.792045022000003, 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.044 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13418 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6023168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.791449122000003, 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14037719400000001, 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.049 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13418 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221572+0000", 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034026199999999998 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221584+0000", 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1321999999999999e-05 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221603+0000", 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9344e-05 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221615+0000", 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1565e-05 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361125+0000", 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139510734 2024-09-05T17:32:03.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361358+0000", 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023231599999999999 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361609+0000", 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025165099999999998 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.053 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.791045038999997, 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.054 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:03.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:03.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.790439640000002, 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.059 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:03.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:03.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:03.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:03.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.789380512000001, 2024-09-05T17:32:03.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:03.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:03.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.067 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:03.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:03.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.067 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.067 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:03.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:03.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:03.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:03.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:03.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:03.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:03.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:03.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:03.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:03.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.072 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.072 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:03.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:03.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.072 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.073 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.073 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:03.073 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.788739229000001, 2024-09-05T17:32:03.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:32:03.074 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.074 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.074 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.074 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.075 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:32:03.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.075 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:03.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:03.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.077 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:32:03.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:32:03.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:32:03.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:32:03.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:32:03.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:32:03.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:32:03.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:32:03.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:32:03.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:32:03.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:32:03.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:32:03.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:32:03.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:32:03.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.083 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.083 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.083 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.083 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.788144334999998, 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.084 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.085 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:32:03.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:32:03.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.787079141, 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:03.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:03.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.093 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.786438451000002, 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.094 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:32:03.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.098 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.785987751, 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:03.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:03.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.785342008000001, 2024-09-05T17:32:03.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:03.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.78496999, 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.109 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:03.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:03.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.115 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.115 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:03.115 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.784328936000001, 2024-09-05T17:32:03.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:32:03.115 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:03.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:03.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:32:03.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:32:03.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:32:03.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:32:03.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:32:03.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:32:03.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:32:03.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:32:03.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:32:03.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:32:03.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:32:03.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:32:03.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:03.122 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 63.783730407, 2024-09-05T17:32:03.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:32:03.123 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:03.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:03.123 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:03.123 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:03.123 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:03.123 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:03.123 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:03.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:03.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:03.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:03.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:32:03.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:32:03.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:03.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:32:03.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:32:03.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:03.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:32:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:32:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:32:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:32:03.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:03.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:03.130 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:03.131 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:03.132 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:03.129+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:03.173 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-05T17:32:03.232 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:03.232+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:03.266 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:03.266 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:03.266 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:03.266 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:03.280 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:03.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:03.333 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:03.332+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:03.412 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:03.413 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:03.413 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:03.413 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:03.413 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:03.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:03.473 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:03.473+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:03.477 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:03.477 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:03.495 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:03.495 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:03.513 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:03.514 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:03.532 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:03.532 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:03.534 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:03.533+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:03.553 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:03.553 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:03.553 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:03.553 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:03.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:32:03.573 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:03.574 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:03.592 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:03.593 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:03.612 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:03.613 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:03.651 INFO:teuthology.orchestra.run.smithi050.stdout:4685 read 0x9e939f2 thru 0x9e96f83 (0x3592 bytes) 2024-09-05T17:32:03.652 INFO:teuthology.orchestra.run.smithi050.stdout:4686 read 0x694f1b8 thru 0x69549b7 (0x5800 bytes) 2024-09-05T17:32:03.661 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:03.661+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:03.665 INFO:teuthology.orchestra.run.smithi050.stdout:4687 writesame 0xd5bb7bf thru 0xd5bf616 data_size 0x69(0x3e58 bytes) 2024-09-05T17:32:03.676 INFO:teuthology.orchestra.run.smithi050.stdout:4688 trunc from 0xd5bf617 to 0x69a2b60 2024-09-05T17:32:03.736 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:03.736+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:03.748 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:03.748 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:03.751 INFO:teuthology.orchestra.run.smithi050.stdout:4689 read 0x38fa2df thru 0x3900a74 (0x6796 bytes) 2024-09-05T17:32:03.762 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:32:03.780 INFO:teuthology.orchestra.run.smithi050.stdout:4690 writesame 0xed49254 thru 0xed4ff02 data_size 0x1(0x6caf bytes) 2024-09-05T17:32:03.780 INFO:teuthology.orchestra.run.smithi050.stdout:4691 write 0xa58157a thru 0xa58a206 (0x8c8d bytes) 2024-09-05T17:32:03.786 INFO:teuthology.orchestra.run.smithi050.stdout:4692 write 0x21a587f thru 0x21ab59f (0x5d21 bytes) 2024-09-05T17:32:03.824 INFO:teuthology.orchestra.run.smithi050.stdout:4693 writesame 0x41fe9cc thru 0x420ad13 data_size 0xc(0xc348 bytes) 2024-09-05T17:32:03.838 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:03.836+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:4694 punch from 0x74569b3 to 0x745709a, (0x6e7 bytes) 2024-09-05T17:32:03.866 INFO:teuthology.orchestra.run.smithi050.stdout:4697 write 0xc6e9f22 thru 0xc6f884c (0xe92b bytes) 2024-09-05T17:32:03.875 INFO:teuthology.orchestra.run.smithi050.stdout:4698 read 0x870472f thru 0x870541f (0xcf1 bytes) 2024-09-05T17:32:03.876 INFO:teuthology.orchestra.run.smithi050.stdout:4699 writesame 0x2db3448 thru 0x2db3b80 data_size 0x1(0x739 bytes) 2024-09-05T17:32:03.895 INFO:teuthology.orchestra.run.smithi050.stdout:4702 writesame 0x5e36bf3 thru 0x5e39683 data_size 0x1(0x2a91 bytes) 2024-09-05T17:32:03.918 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.1 to 0.545819 (8bba) 2024-09-05T17:32:03.918 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:32:03.933 INFO:teuthology.orchestra.run.smithi050.stdout:4703 write 0xcdfafeb thru 0xce00e24 (0x5e3a bytes) 2024-09-05T17:32:03.938 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:03.937+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:03.939 INFO:teuthology.orchestra.run.smithi050.stdout:4704 read 0x8f18d16 thru 0x8f1fe8c (0x7177 bytes) 2024-09-05T17:32:03.942 INFO:teuthology.orchestra.run.smithi050.stdout:4706 trunc from 0xed4ff03 to 0xce1cd40 2024-09-05T17:32:03.950 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:03.950 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:03.951 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:03.952 INFO:teuthology.orchestra.run.smithi050.stdout:4708 writesame 0x37d0cfc thru 0x37d56d5 data_size 0x2e(0x49da bytes) 2024-09-05T17:32:03.967 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:32:03.976 INFO:teuthology.orchestra.run.smithi050.stdout:4710 read 0x297fd1 thru 0x2a641c (0xe44c bytes) 2024-09-05T17:32:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:4711 read 0x9f874e1 thru 0x9f88ada (0x15fa bytes) 2024-09-05T17:32:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:4713 punch from 0x8cc001a to 0x8cce0c0, (0xe0a6 bytes) 2024-09-05T17:32:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:4714 punch from 0x9af59c9 to 0x9b00ae2, (0xb119 bytes) 2024-09-05T17:32:03.979 INFO:teuthology.orchestra.run.smithi050.stdout:4715 read 0xccdf119 thru 0xcce61f6 (0x70de bytes) 2024-09-05T17:32:03.980 INFO:teuthology.orchestra.run.smithi050.stdout:4716 read 0xc05b60d thru 0xc062a4a (0x743e bytes) 2024-09-05T17:32:03.980 INFO:teuthology.orchestra.run.smithi050.stdout:4717 write 0x9e6e711 thru 0x9e7e1f5 (0xfae5 bytes) 2024-09-05T17:32:03.988 INFO:teuthology.orchestra.run.smithi050.stdout:4718 read 0x238403f thru 0x2390de0 (0xcda2 bytes) 2024-09-05T17:32:03.989 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:03.989 INFO:teuthology.orchestra.run.smithi050.stdout:4720 write 0x1c25f7b thru 0x1c33d09 (0xdd8f bytes) 2024-09-05T17:32:04.010 INFO:teuthology.orchestra.run.smithi050.stdout:4721 write 0x1dee449 thru 0x1df3296 (0x4e4e bytes) 2024-09-05T17:32:04.039 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:04.036+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:04.128 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:04.128 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:04.140 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:04.137+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:04.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:04.241 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:04.241+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:04.306 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:04.307 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:04.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:04.342 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:04.340+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:04.443 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:04.441+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:04.489 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:04.489 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:04.503 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:04.545 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:04.544+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:04.645 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:04.644+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:04.669 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:04.669 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:04.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:04.746 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:04.744+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:04.807 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:04.807 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:04.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:04.847 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:04.844+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:04.948 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:04.948 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:04.948 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:04.945+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:04.963 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:05.049 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:05.048+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:05.127 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:05.127 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:05.141 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:05.188 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:05.188+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:05.250 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:05.248+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:05.276 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:05.276 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:05.290 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:05.376 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:05.376+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:05.452 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:05.449+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:05.462 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:05.462 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:05.476 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:05.564 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:05.564+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:05.631 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:05.650 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:05.650 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:05.653 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:05.652+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:05.665 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:05.755 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:05.753+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:05.775 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:05.775 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:05.792 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:05.792 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:05.810 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:05.810 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:05.828 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:05.828 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:05.835 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:05.836 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:05.836 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:05.849 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:05.849 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:05.850 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:05.855 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:05.853+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:05.870 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:05.870 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:05.890 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:05.891 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:05.911 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:05.912 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:05.939 INFO:teuthology.orchestra.run.smithi050.stdout:4723 read 0xb0afc13 thru 0xb0b8444 (0x8832 bytes) 2024-09-05T17:32:05.939 INFO:teuthology.orchestra.run.smithi050.stdout:4726 punch from 0x454e776 to 0x455ad25, (0xc5af bytes) 2024-09-05T17:32:05.939 INFO:teuthology.orchestra.run.smithi050.stdout:4727 punch from 0x208b05a to 0x2095e14, (0xadba bytes) 2024-09-05T17:32:05.939 INFO:teuthology.orchestra.run.smithi050.stdout:4729 write 0xc75aa70 thru 0xc762c64 (0x81f5 bytes) 2024-09-05T17:32:05.956 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:05.953+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:05.957 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:32:05.980 INFO:teuthology.orchestra.run.smithi050.stdout:4731 trunc from 0xce1cd40 to 0x159288f 2024-09-05T17:32:05.994 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:05.994 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:05.995 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:06.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:06.057 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:06.057+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:06.072 INFO:teuthology.orchestra.run.smithi050.stdout:4732 read 0xc328a9 thru 0xc40018 (0xd770 bytes) 2024-09-05T17:32:06.073 INFO:teuthology.orchestra.run.smithi050.stdout:4733 punch from 0xf1ed28 to 0xf29eb4, (0xb18c bytes) 2024-09-05T17:32:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:4734 punch from 0x8ef1e to 0x93c57, (0x4d39 bytes) 2024-09-05T17:32:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:4735 punch from 0xf9f398 to 0xfacd85, (0xd9ed bytes) 2024-09-05T17:32:06.074 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:06.081 INFO:teuthology.orchestra.run.smithi050.stdout:4739 write 0x1e3ad36 thru 0x1e3edf8 (0x40c3 bytes) 2024-09-05T17:32:06.104 INFO:teuthology.orchestra.run.smithi050.stdout:4740 write 0xb158da3 thru 0xb1634a1 (0xa6ff bytes) 2024-09-05T17:32:06.117 INFO:teuthology.orchestra.run.smithi050.stdout:4742 punch from 0x32fbb60 to 0x3300efe, (0x539e bytes) 2024-09-05T17:32:06.125 INFO:teuthology.orchestra.run.smithi050.stdout:4743 trunc from 0xb1634a2 to 0x44a9945 2024-09-05T17:32:06.158 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:06.156+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:06.158 INFO:teuthology.orchestra.run.smithi050.stdout:4744 write 0xb063bdb thru 0xb06e8bb (0xace1 bytes) 2024-09-05T17:32:06.182 INFO:teuthology.orchestra.run.smithi050.stdout:4745 write 0xd079adc thru 0xd07c69d (0x2bc2 bytes) 2024-09-05T17:32:06.190 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78320 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2920448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.190 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3538446870000005, 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064661845999999995, 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78320 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837282+0000", 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837285+0000", 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837296+0000", 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.11e-05 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837302+0000", 2024-09-05T17:32:06.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6939999999999998e-06 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901848+0000", 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064545672999999998 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901890+0000", 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1853000000000001e-05 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901943+0000", 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3362999999999997e-05 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3537905909999992, 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:32:06.195 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3537451320000002, 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.200 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:32:06.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3537169450000004, 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.205 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:32:06.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3536893340000002, 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.209 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:32:06.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:32:06.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.213 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3536626179999995, 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:32:06.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:32:06.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:32:06.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3536337070000002, 2024-09-05T17:32:06.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:32:06.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.222 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3536024760000007, 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.223 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:32:06.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:32:06.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.353572454, 2024-09-05T17:32:06.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:32:06.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:32:06.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:32:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:32:06.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:32:06.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3535455580000004, 2024-09-05T17:32:06.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:06.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:32:06.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3534488180000004, 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:32:06.239 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:32:06.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3534182129999994, 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.244 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:32:06.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.248 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3533908849999996, 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:32:06.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:32:06.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:32:06.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.253 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3533639980000007, 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:32:06.254 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.255 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.256 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:32:06.257 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3533366870000005, 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.258 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:32:06.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3529995029999995, 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:32:06.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.265 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:32:06.266 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3519824239999991, 2024-09-05T17:32:06.267 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.271 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3518729149999995, 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.272 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:32:06.275 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3518064340000002, 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:32:06.276 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:06.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.280 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.3517466480000007, 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:06.281 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.282 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:32:06.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.285 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:06.286 INFO:teuthology.orchestra.run.smithi050.stdout:4746 write 0x8b23f2d thru 0x8b30d60 (0xce34 bytes) 2024-09-05T17:32:06.286 INFO:teuthology.orchestra.run.smithi050.stdout:4748 punch from 0x2ae233e to 0x2aeb313, (0x8fd5 bytes) 2024-09-05T17:32:06.286 INFO:teuthology.orchestra.run.smithi050.stdout:4749 read 0x9cb6270 thru 0x9cc51ff (0xef90 bytes) 2024-09-05T17:32:06.286 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:06.287 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:06.288 INFO:teuthology.orchestra.run.smithi050.stdout:4751 trunc from 0xd07c69e to 0x568949b 2024-09-05T17:32:06.288 INFO:teuthology.orchestra.run.smithi050.stdout:4752 punch from 0x42cd9c to 0x43aeea, (0xe14e bytes) 2024-09-05T17:32:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:4755 trunc from 0x568949b to 0xdb45982 2024-09-05T17:32:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:4757 write 0xc09c4c9 thru 0xc0a3efa (0x7a32 bytes) 2024-09-05T17:32:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:4759 trunc from 0xdb45982 to 0xd278e96 2024-09-05T17:32:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:4760 punch from 0x286118a to 0x286c474, (0xb2ea bytes) 2024-09-05T17:32:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:4762 punch from 0x9e29682 to 0x9e33e80, (0xa7fe bytes) 2024-09-05T17:32:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:4763 punch from 0xa984c94 to 0xa990b16, (0xbe82 bytes) 2024-09-05T17:32:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:4764 punch from 0x87796fa to 0x877d3c1, (0x3cc7 bytes) 2024-09-05T17:32:06.289 INFO:teuthology.orchestra.run.smithi050.stdout:4765 trunc from 0xd278e96 to 0x2e7561 2024-09-05T17:32:06.290 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:06.289+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:06.391 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:06.388+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:06.454 INFO:teuthology.orchestra.run.smithi050.stdout:4768 trunc from 0x2e7561 to 0x1b9e9d0 2024-09-05T17:32:06.468 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:06.468 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:06.469 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:06.476 INFO:teuthology.orchestra.run.smithi050.stdout:4769 write 0x470eb70 thru 0x47112aa (0x273b bytes) 2024-09-05T17:32:06.482 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:06.482 INFO:teuthology.orchestra.run.smithi050.stdout:4771 write 0x1176e69 thru 0x1184b69 (0xdd01 bytes) 2024-09-05T17:32:06.485 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:06.498 INFO:teuthology.orchestra.run.smithi050.stdout:4773 writesame 0x5a09f08 thru 0x5a0df8b data_size 0x2(0x4084 bytes) 2024-09-05T17:32:06.498 INFO:teuthology.orchestra.run.smithi050.stdout:4774 write 0x16c956e thru 0x16d09a3 (0x7436 bytes) 2024-09-05T17:32:06.498 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:06.496+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:06.505 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:06.517 INFO:teuthology.orchestra.run.smithi050.stdout:4776 trunc from 0x5a0df8c to 0x9cae31 2024-09-05T17:32:06.539 INFO:teuthology.orchestra.run.smithi050.stdout:4777 read 0x262518 thru 0x26cb91 (0xa67a bytes) 2024-09-05T17:32:06.541 INFO:teuthology.orchestra.run.smithi050.stdout:4779 read 0x179724 thru 0x18514c (0xba29 bytes) 2024-09-05T17:32:06.569 INFO:teuthology.orchestra.run.smithi050.stdout:4780 writesame 0x90920b6 thru 0x90959bc data_size 0x1(0x3907 bytes) 2024-09-05T17:32:06.569 INFO:teuthology.orchestra.run.smithi050.stdout:4781 punch from 0x29058c6 to 0x2911c2d, (0xc367 bytes) 2024-09-05T17:32:06.570 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:06.570 INFO:teuthology.orchestra.run.smithi050.stdout:4783 read 0x4924943 thru 0x492def4 (0x95b2 bytes) 2024-09-05T17:32:06.570 INFO:teuthology.orchestra.run.smithi050.stdout:4785 write 0x23ffb45 thru 0x2409ead (0xa369 bytes) 2024-09-05T17:32:06.583 INFO:teuthology.orchestra.run.smithi050.stdout:4786 write 0x585904 thru 0x58c84f (0x6f4c bytes) 2024-09-05T17:32:06.587 INFO:teuthology.orchestra.run.smithi050.stdout:4787 punch from 0x144fe17 to 0x1457bba, (0x7da3 bytes) 2024-09-05T17:32:06.587 INFO:teuthology.orchestra.run.smithi050.stdout:4788 read 0x5086839 thru 0x508b704 (0x4ecc bytes) 2024-09-05T17:32:06.593 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:06.592+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:06.597 INFO:teuthology.orchestra.run.smithi050.stdout:4789 trunc from 0x90959bd to 0xd93dc49 2024-09-05T17:32:06.611 INFO:teuthology.orchestra.run.smithi050.stdout:4792 trunc from 0xd93dc49 to 0xe43258a 2024-09-05T17:32:06.622 INFO:teuthology.orchestra.run.smithi050.stdout:4793 read 0x980ac9f thru 0x9811e9b (0x71fd bytes) 2024-09-05T17:32:06.622 INFO:teuthology.orchestra.run.smithi050.stdout:4795 punch from 0xb69fa94 to 0xb6ae114, (0xe680 bytes) 2024-09-05T17:32:06.622 INFO:teuthology.orchestra.run.smithi050.stdout:4798 read 0x4e8dba2 thru 0x4e95afa (0x7f59 bytes) 2024-09-05T17:32:06.623 INFO:teuthology.orchestra.run.smithi050.stdout:4799 trunc from 0xe43258a to 0xd63886f 2024-09-05T17:32:06.630 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:06.630 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:06.630 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:06.630 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:06.630 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:06.635 INFO:teuthology.orchestra.run.smithi050.stdout:4800 write 0x2a5fc7f thru 0x2a60fa4 (0x1326 bytes) 2024-09-05T17:32:06.645 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:06.646 INFO:teuthology.orchestra.run.smithi050.stdout:4801 read 0x2e83709 thru 0x2e900eb (0xc9e3 bytes) 2024-09-05T17:32:06.646 INFO:teuthology.orchestra.run.smithi050.stdout:4802 read 0x1d5e94 thru 0x1e098b (0xaaf8 bytes) 2024-09-05T17:32:06.649 INFO:teuthology.orchestra.run.smithi050.stdout:4804 trunc from 0xd63886f to 0xae5a01f 2024-09-05T17:32:06.672 INFO:teuthology.orchestra.run.smithi050.stdout:4806 write 0xdc5585b thru 0xdc5dd79 (0x851f bytes) 2024-09-05T17:32:06.694 INFO:teuthology.orchestra.run.smithi050.stdout:4807 trunc from 0xdc5dd7a to 0x794e51a 2024-09-05T17:32:06.694 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:06.693+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:06.715 INFO:teuthology.orchestra.run.smithi050.stdout:4808 punch from 0x157ccbb to 0x1586d4b, (0xa090 bytes) 2024-09-05T17:32:06.715 INFO:teuthology.orchestra.run.smithi050.stdout:4810 writesame 0xd1c8cc thru 0xd2c6ba data_size 0x5d(0xfdef bytes) 2024-09-05T17:32:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:4811 read 0x5786b02 thru 0x5788be6 (0x20e5 bytes) 2024-09-05T17:32:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:06.721 INFO:teuthology.orchestra.run.smithi050.stdout:4815 read 0xc6ea6c thru 0xc77689 (0x8c1e bytes) 2024-09-05T17:32:06.722 INFO:teuthology.orchestra.run.smithi050.stdout:4817 punch from 0x35405e8 to 0x354b86a, (0xb282 bytes) 2024-09-05T17:32:06.722 INFO:teuthology.orchestra.run.smithi050.stdout:4818 punch from 0x1403c8 to 0x14f24c, (0xee84 bytes) 2024-09-05T17:32:06.722 INFO:teuthology.orchestra.run.smithi050.stdout:4820 punch from 0x738981b to 0x739380b, (0x9ff0 bytes) 2024-09-05T17:32:06.722 INFO:teuthology.orchestra.run.smithi050.stdout:4822 writesame 0x58de108 thru 0x58e1864 data_size 0x1(0x375d bytes) 2024-09-05T17:32:06.739 INFO:teuthology.orchestra.run.smithi050.stdout:4823 punch from 0x202806d to 0x202b8e2, (0x3875 bytes) 2024-09-05T17:32:06.740 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:06.740 INFO:teuthology.orchestra.run.smithi050.stdout:4826 writesame 0x4622323 thru 0x4625c32 data_size 0x2c(0x3910 bytes) 2024-09-05T17:32:06.761 INFO:teuthology.orchestra.run.smithi050.stdout:4827 write 0x83c8392 thru 0x83d5d6a (0xd9d9 bytes) 2024-09-05T17:32:06.775 INFO:teuthology.orchestra.run.smithi050.stdout:4828 write 0x62bb719 thru 0x62be237 (0x2b1f bytes) 2024-09-05T17:32:06.779 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.534396409999999, 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:32:06.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:32:06.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:32:06.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:06.784 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.013453560000002, 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:06.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.809495660000003, 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:32:06.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:32:06.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.571500831000002, 2024-09-05T17:32:06.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:06.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:32:06.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.558486291000001, 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:32:06.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:32:06.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:32:06.802 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.556222361000003, 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:32:06.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.554130587000003, 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:32:06.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:32:06.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51735 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'202, mlcod=54'198)", 2024-09-05T17:32:06.811 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.642816625000002, 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032394590000000001, 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137895+0000", 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4780000000000001e-06 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137904+0000", 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137926+0000", 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1013999999999999e-05 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137939+0000", 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.342e-05 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138024+0000", 2024-09-05T17:32:06.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5167000000000006e-05 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138055+0000", 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0982000000000003e-05 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.140997+0000", 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029416329999999999 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141133+0000", 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013600799999999999 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.639342116999998, 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.816 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:32:06.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:32:06.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.247201129, 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:32:06.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:32:06.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54994 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'375, mlcod=60'373)", 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.230818490000001, 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032305459999999999, 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549893+0000", 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549906+0000", 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2974e-05 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549936+0000", 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0079000000000001e-05 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549954+0000", 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7912999999999999e-05 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550156+0000", 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149400000000001 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550246+0000", 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0470000000000006e-05 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553025+0000", 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027789780000000001 2024-09-05T17:32:06.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553122+0000", 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6804000000000004e-05 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 28.225562979999999, 2024-09-05T17:32:06.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.833 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.649363098999999, 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.834 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.838 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9963649839999995, 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:32:06.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.843 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9957591360000002, 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:32:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:32:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.851 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9951932049999996, 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9945382639999991, 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.856 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:32:06.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:32:06.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9938378750000005, 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:06.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:32:06.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.9925692589999997, 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.865 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:32:06.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:32:06.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:100058 3.18 e87/86 3:1ad21172:::rbd_data.1140b9781f.0000000000000010:head v 87'192, mlcod=0'0)", 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.84337340199999999, 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003565824, 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:06.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937337+0000", 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7899999999999997e-07 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:06.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938048+0000", 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00071111099999999995 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938066+0000", 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7958e-05 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938078+0000", 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1592e-05 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938155+0000", 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7541999999999997e-05 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938186+0000", 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0756000000000002e-05 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940856+0000", 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026697460000000002 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:06.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940902+0000", 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.634e-05 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:06.874 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:06.875 INFO:teuthology.orchestra.run.smithi050.stdout:4829 write 0x9524e76 thru 0x9528c11 (0x3d9c bytes) 2024-09-05T17:32:06.876 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:06.876 INFO:teuthology.orchestra.run.smithi050.stdout:4830 trunc from 0x9528c12 to 0x1b1d8f9 2024-09-05T17:32:06.877 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:06.873+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:06.878 INFO:teuthology.orchestra.run.smithi050.stdout:4835 write 0x816aec5 thru 0x8174068 (0x91a4 bytes) 2024-09-05T17:32:06.892 INFO:teuthology.orchestra.run.smithi050.stdout:4836 punch from 0x99d8c5 to 0x9a1272, (0x39ad bytes) 2024-09-05T17:32:06.893 INFO:teuthology.orchestra.run.smithi050.stdout:4837 read 0x70c329a thru 0x70c665d (0x33c4 bytes) 2024-09-05T17:32:06.893 INFO:teuthology.orchestra.run.smithi050.stdout:4838 read 0x5236206 thru 0x5238a4e (0x2849 bytes) 2024-09-05T17:32:06.913 INFO:teuthology.orchestra.run.smithi050.stdout:4839 writesame 0xc125941 thru 0xc132114 data_size 0x1d(0xc7d4 bytes) 2024-09-05T17:32:06.913 INFO:teuthology.orchestra.run.smithi050.stdout:4841 write 0x4dd4f0c thru 0x4dd5679 (0x76e bytes) 2024-09-05T17:32:06.920 INFO:teuthology.orchestra.run.smithi050.stdout:4842 write 0x8c37a34 thru 0x8c4480e (0xcddb bytes) 2024-09-05T17:32:06.939 INFO:teuthology.orchestra.run.smithi050.stdout:4843 punch from 0x3cdf025 to 0x3cea076, (0xb051 bytes) 2024-09-05T17:32:06.942 INFO:teuthology.orchestra.run.smithi050.stdout:4844 trunc from 0xc132115 to 0xab50daa 2024-09-05T17:32:06.953 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:32:06.959 INFO:teuthology.orchestra.run.smithi050.stdout:4845 trunc from 0xab50daa to 0x9a718b6 2024-09-05T17:32:06.976 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:06.976+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:06.990 INFO:teuthology.orchestra.run.smithi050.stdout:4847 write 0xc44e279 thru 0xc45aa49 (0xc7d1 bytes) 2024-09-05T17:32:07.021 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:07.021 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:07.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.021 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3.90a4da8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:32:07.021 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.019891738999999999, 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.019913286999999998, 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "waiting for peered", 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:32:07.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:32:07.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.026 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.026 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.026 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:07.026 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 1 2024-09-05T17:32:07.026 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:07.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:07.080 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:07.080+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:07.179 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:07.177+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:07.205 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:07.205 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:07.205 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:07.205 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:07.205 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:07.219 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:07.280 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:07.277+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:07.343 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:07.343 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:07.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:07.343 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:07.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.343 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.343 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:07.343 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.133553969000005, 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.344 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:32:07.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.348 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.132532642000001, 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:07.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:07.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.131444144, 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.357 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.130423633000007, 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:32:07.361 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.129396684, 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.362 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.127054086000001, 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:32:07.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.122101912999995, 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:32:07.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13418 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6023168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:32:07.375 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.121506013000001, 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14037719400000001, 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13418 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:32:07.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221232+0000", 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221572+0000", 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00034026199999999998 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221584+0000", 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1321999999999999e-05 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221603+0000", 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9344e-05 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221615+0000", 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1565e-05 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361125+0000", 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139510734 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361358+0000", 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023231599999999999 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361609+0000", 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025165099999999998 2024-09-05T17:32:07.379 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.121101929999995, 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:07.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:07.384 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.120496531000001, 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:07.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:07.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.119437403000006, 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:07.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.118796119999999, 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:32:07.393 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.118201225999996, 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:32:07.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.117136032000005, 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:07.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.116495341999993, 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.407 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:32:07.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:32:07.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.116044642000006, 2024-09-05T17:32:07.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:07.415 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.115398898999999, 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.416 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:07.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.115026881000006, 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:07.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.114385827000007, 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:32:07.425 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:32:07.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:32:07.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 68.113787298000005, 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:32:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:32:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:32:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:07.434 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:07.435 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:07.436 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:07.433+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:07.537 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:07.536+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:07.566 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:07.566 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:07.567 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:07.567 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:07.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:07.638 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:07.636+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:07.711 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:07.711 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:07.711 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:07.715 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:07.739 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:07.736+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:07.840 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:07.837+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:07.844 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:07.844 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.140225065000003, 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:32:07.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:32:07.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.140177680999997, 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:32:07.849 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:32:07.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.853 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.140133009000003, 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:32:07.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.140087667000003, 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:32:07.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:32:07.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.140018656999999, 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:32:07.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.139970220000002, 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:32:07.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.139923862000003, 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.876 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:32:07.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.139261271999999, 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:32:07.880 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:32:07.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.884 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.139169926000001, 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:32:07.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:07.889 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.139108446000002, 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:07.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:32:07.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.139051545999997, 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.894 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:07.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.898 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.138958305000003, 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.138898777000001, 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.903 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:32:07.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.131742815000003, 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:32:07.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:32:07.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.131681348000001, 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.129813378999998, 2024-09-05T17:32:07.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:32:07.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.129772869, 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:32:07.923 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:32:07.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.129734403, 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.932 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.129676296, 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:32:07.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.129618995000001, 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:07.937 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:07.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:32:07.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:32:07.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:07.942 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:07.942 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:07.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:07.944 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:32:07.944 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:07.940+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:07.961 INFO:teuthology.orchestra.run.smithi050.stdout:4848 read 0x81418c1 thru 0x8142da5 (0x14e5 bytes) 2024-09-05T17:32:07.966 INFO:teuthology.orchestra.run.smithi050.stdout:4849 read 0x1edad55 thru 0x1ee6d02 (0xbfae bytes) 2024-09-05T17:32:07.970 INFO:teuthology.orchestra.run.smithi050.stdout:4852 punch from 0xc131f78 to 0xc13e4be, (0xc546 bytes) 2024-09-05T17:32:07.970 INFO:teuthology.orchestra.run.smithi050.stdout:4853 read 0xb380894 thru 0xb38f370 (0xeadd bytes) 2024-09-05T17:32:07.970 INFO:teuthology.orchestra.run.smithi050.stdout:4854 read 0x17b25b6 thru 0x17bdcd9 (0xb724 bytes) 2024-09-05T17:32:07.971 INFO:teuthology.orchestra.run.smithi050.stdout:4856 write 0x1be4e75 thru 0x1be73cd (0x2559 bytes) 2024-09-05T17:32:07.991 INFO:teuthology.orchestra.run.smithi050.stdout:4857 write 0xd6b201d thru 0xd6b3196 (0x117a bytes) 2024-09-05T17:32:08.000 INFO:teuthology.orchestra.run.smithi050.stdout:4858 read 0x2d7721d thru 0x2d85cd4 (0xeab8 bytes) 2024-09-05T17:32:08.001 INFO:teuthology.orchestra.run.smithi050.stdout:4859 read 0x63ef51c thru 0x63f4ec9 (0x59ae bytes) 2024-09-05T17:32:08.001 INFO:teuthology.orchestra.run.smithi050.stdout:4860 read 0x60f470c thru 0x60f6957 (0x224c bytes) 2024-09-05T17:32:08.001 INFO:teuthology.orchestra.run.smithi050.stdout:4862 writesame 0xb86f389 thru 0xb877c0b data_size 0x3(0x8883 bytes) 2024-09-05T17:32:08.020 INFO:teuthology.orchestra.run.smithi050.stdout:4864 trunc from 0xd6b3197 to 0x7278e52 2024-09-05T17:32:08.044 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:08.041+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:08.065 INFO:teuthology.orchestra.run.smithi050.stdout:4866 write 0xa43d8b6 thru 0xa44cb8b (0xf2d6 bytes) 2024-09-05T17:32:08.080 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:08.080 INFO:teuthology.orchestra.run.smithi050.stdout:4868 punch from 0x80c2d19 to 0x80cc377, (0x965e bytes) 2024-09-05T17:32:08.080 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:08.080 INFO:teuthology.orchestra.run.smithi050.stdout:4870 trunc from 0xa44cb8c to 0xa69bf08 2024-09-05T17:32:08.086 INFO:teuthology.orchestra.run.smithi050.stdout:4871 read 0x349feb1 thru 0x34a246e (0x25be bytes) 2024-09-05T17:32:08.098 INFO:teuthology.orchestra.run.smithi050.stdout:4872 write 0xe276464 thru 0xe281e15 (0xb9b2 bytes) 2024-09-05T17:32:08.106 INFO:teuthology.orchestra.run.smithi050.stdout:4873 punch from 0x4ca7676 to 0x4cae35a, (0x6ce4 bytes) 2024-09-05T17:32:08.110 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:08.110 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:08.124 INFO:teuthology.orchestra.run.smithi050.stdout:4874 trunc from 0xe281e16 to 0x1866445 2024-09-05T17:32:08.125 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:08.125 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:08.129 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:08.129 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:08.142 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:32:08.149 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:08.149 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:08.149 INFO:teuthology.orchestra.run.smithi050.stdout:4875 trunc from 0x1866445 to 0x680a6ed 2024-09-05T17:32:08.156 INFO:teuthology.orchestra.run.smithi050.stdout:4876 read 0x1d2a697 thru 0x1d367b4 (0xc11e bytes) 2024-09-05T17:32:08.156 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:08.156 INFO:teuthology.orchestra.run.smithi050.stdout:4878 read 0x617157f thru 0x618138c (0xfe0e bytes) 2024-09-05T17:32:08.156 INFO:teuthology.orchestra.run.smithi050.stdout:4882 read 0x26d1bdf thru 0x26d993e (0x7d60 bytes) 2024-09-05T17:32:08.157 INFO:teuthology.orchestra.run.smithi050.stdout:4883 read 0x18fa904 thru 0x18fb9f3 (0x10f0 bytes) 2024-09-05T17:32:08.157 INFO:teuthology.orchestra.run.smithi050.stdout:4884 punch from 0x54b2979 to 0x54bc95a, (0x9fe1 bytes) 2024-09-05T17:32:08.157 INFO:teuthology.orchestra.run.smithi050.stdout:4886 write 0x37537a5 thru 0x375b50e (0x7d6a bytes) 2024-09-05T17:32:08.168 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:08.168 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:08.181 INFO:teuthology.orchestra.run.smithi050.stdout:4887 write 0xe02990b thru 0xe03470f (0xae05 bytes) 2024-09-05T17:32:08.185 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:08.185+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:08.187 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:08.187 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:08.200 INFO:teuthology.orchestra.run.smithi050.stdout:4888 trunc from 0xe034710 to 0x7b47f0f 2024-09-05T17:32:08.208 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:08.208 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:08.213 INFO:teuthology.orchestra.run.smithi050.stdout:4889 read 0x56edce9 thru 0x56fbe00 (0xe118 bytes) 2024-09-05T17:32:08.214 INFO:teuthology.orchestra.run.smithi050.stdout:4890 write 0x8af9c5 thru 0x8b9493 (0x9acf bytes) 2024-09-05T17:32:08.216 INFO:teuthology.orchestra.run.smithi050.stdout:4891 write 0x2fb7549 thru 0x2fc4f63 (0xda1b bytes) 2024-09-05T17:32:08.227 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:08.227 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:08.227 INFO:teuthology.orchestra.run.smithi050.stdout:4892 trunc from 0x7b47f0f to 0x69a47cf 2024-09-05T17:32:08.239 INFO:teuthology.orchestra.run.smithi050.stdout:4893 trunc from 0x69a47cf to 0xab17042 2024-09-05T17:32:08.246 INFO:teuthology.orchestra.run.smithi050.stdout:4895 writesame 0x39f8105 thru 0x3a02021 data_size 0x17(0x9f1d bytes) 2024-09-05T17:32:08.246 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:08.245+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:08.248 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:08.248 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:08.261 INFO:teuthology.orchestra.run.smithi050.stdout:4898 write 0xec9ad4a thru 0xec9e00c (0x32c3 bytes) 2024-09-05T17:32:08.286 INFO:teuthology.orchestra.run.smithi050.stdout:4899 trunc from 0xec9e00d to 0xaf193b 2024-09-05T17:32:08.308 INFO:teuthology.orchestra.run.smithi050.stdout:4901 read 0x3af2ef thru 0x3b3ed7 (0x4be9 bytes) 2024-09-05T17:32:08.309 INFO:teuthology.orchestra.run.smithi050.stdout:4902 clone 30 order 19 su 16384 sc 6 2024-09-05T17:32:08.322 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:08.322 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:08.336 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:32:08.377 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:08.377+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:08.448 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:08.448+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:08.497 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:08.497 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:08.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:08.548 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:08.548+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:08.636 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:08.636 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:08.650 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:08.650 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:08.648+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:08.751 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:08.749+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:08.769 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:08.769 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:08.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:08.852 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:08.852+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:08.952 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:08.952 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:08.953 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:08.952+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:08.956 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:32:08.956 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:32:08.956 INFO:tasks.thrashosds.thrasher:Adding osd 0 2024-09-05T17:32:08.956 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 0 2024-09-05T17:32:08.967 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:08.981 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:32:09.053 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:09.052+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:09.060 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone29 from 0xaf193b (overlap 0x2e7561) to 0x0 2024-09-05T17:32:09.106 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:09.106 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:09.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:09.144 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-05T17:32:09.154 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:09.152+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:09.236 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:09.236 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:09.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:09.254 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:09.252+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:09.301 INFO:tasks.ceph.mon.a.smithi050.stderr:2024-09-05T17:32:09.300+0000 7fc56f901640 -1 mon.a@0(leader).osd e90 definitely_dead 0 2024-09-05T17:32:09.356 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:09.352+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:09.375 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:09.375 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:09.389 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:09.457 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:09.457+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:09.499 INFO:teuthology.orchestra.run.smithi050.stdout:4904 write 0x2ff52d1 thru 0x3003c5e (0xe98e bytes) 2024-09-05T17:32:09.513 INFO:teuthology.orchestra.run.smithi050.stdout:4905 writesame 0x1ebf307 thru 0x1ec28bb data_size 0x1(0x35b5 bytes) 2024-09-05T17:32:09.520 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:09.520 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:09.535 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:09.543 INFO:teuthology.orchestra.run.smithi050.stdout:4907 writesame 0x403b169 thru 0x4047287 data_size 0x1(0xc11f bytes) 2024-09-05T17:32:09.543 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.544 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.555 INFO:teuthology.orchestra.run.smithi050.stdout:4910 write 0x5c9e4f9 thru 0x5cadfdc (0xfae4 bytes) 2024-09-05T17:32:09.557 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:09.556+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:09.570 INFO:teuthology.orchestra.run.smithi050.stdout:4912 trunc from 0x5cadfdd to 0x5d2baba 2024-09-05T17:32:09.578 INFO:teuthology.orchestra.run.smithi050.stdout:4915 read 0x2667d1d thru 0x266af5f (0x3243 bytes) 2024-09-05T17:32:09.595 INFO:teuthology.orchestra.run.smithi050.stdout:4916 write 0xbd2d7cd thru 0xbd3557f (0x7db3 bytes) 2024-09-05T17:32:09.606 INFO:teuthology.orchestra.run.smithi050.stdout:4918 write 0xae1833f thru 0xae1d55c (0x521e bytes) 2024-09-05T17:32:09.615 INFO:teuthology.orchestra.run.smithi050.stdout:4919 write 0x8728877 thru 0x8729c18 (0x13a2 bytes) 2024-09-05T17:32:09.621 INFO:teuthology.orchestra.run.smithi050.stdout:4920 writesame 0xb9d0f6f thru 0xb9d3cdf data_size 0x1(0x2d71 bytes) 2024-09-05T17:32:09.640 INFO:teuthology.orchestra.run.smithi050.stdout:4922 read 0x6dda355 thru 0x6ddaed5 (0xb81 bytes) 2024-09-05T17:32:09.649 INFO:teuthology.orchestra.run.smithi050.stdout:4926 trunc from 0xbd35580 to 0x6b9ecf4 2024-09-05T17:32:09.658 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:09.657+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:09.664 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:09.665 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:09.676 INFO:teuthology.orchestra.run.smithi050.stdout:4927 read 0x1caa489 thru 0x1cb4943 (0xa4bb bytes) 2024-09-05T17:32:09.676 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.680 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:09.697 INFO:teuthology.orchestra.run.smithi050.stdout:4929 write 0x9e50fbb thru 0x9e60e3a (0xfe80 bytes) 2024-09-05T17:32:09.716 INFO:teuthology.orchestra.run.smithi050.stdout:4930 write 0x1afda62 thru 0x1b000da (0x2679 bytes) 2024-09-05T17:32:09.724 INFO:teuthology.orchestra.run.smithi050.stdout:4931 read 0x3c23624 thru 0x3c3243c (0xee19 bytes) 2024-09-05T17:32:09.729 INFO:teuthology.orchestra.run.smithi050.stdout:4932 trunc from 0x9e60e3b to 0xc33790c 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:4937 writesame 0xe994312 thru 0xe9a2cb9 data_size 0x4(0xe9a8 bytes) 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:4939 punch from 0x26fa9b7 to 0x27005f9, (0x5c42 bytes) 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:4943 read 0x60b66be thru 0x60bb6cb (0x500e bytes) 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:4944 punch from 0xb5747b2 to 0xb57b2dc, (0x6b2a bytes) 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.753 INFO:teuthology.orchestra.run.smithi050.stdout:4947 read 0x5ba325c thru 0x5bab24f (0x7ff4 bytes) 2024-09-05T17:32:09.754 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.754 INFO:teuthology.orchestra.run.smithi050.stdout:4951 read 0x4c8160b thru 0x4c81630 (0x26 bytes) 2024-09-05T17:32:09.759 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:09.756+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:09.771 INFO:teuthology.orchestra.run.smithi050.stdout:4953 trunc from 0xe9a2cba to 0x4e78e33 2024-09-05T17:32:09.795 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.796 INFO:teuthology.orchestra.run.smithi050.stdout:4955 punch from 0x2bc2de1 to 0x2bc432c, (0x154b bytes) 2024-09-05T17:32:09.812 INFO:teuthology.orchestra.run.smithi050.stdout:4957 write 0x70c1bdf thru 0x70c63a3 (0x47c5 bytes) 2024-09-05T17:32:09.845 INFO:teuthology.orchestra.run.smithi050.stdout:4959 write 0xeac17ad thru 0xeac3c54 (0x24a8 bytes) 2024-09-05T17:32:09.853 INFO:teuthology.orchestra.run.smithi050.stdout:4961 write 0x3f0f9e8 thru 0x3f19914 (0x9f2d bytes) 2024-09-05T17:32:09.860 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:09.857+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:09.865 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:09.865 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:09.866 INFO:teuthology.orchestra.run.smithi050.stdout:4962 write 0x37ca2ea thru 0x37d354c (0x9263 bytes) 2024-09-05T17:32:09.879 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.879 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.879 INFO:teuthology.orchestra.run.smithi050.stdout:4965 read 0x3a82630 thru 0x3a90f5d (0xe92e bytes) 2024-09-05T17:32:09.879 INFO:teuthology.orchestra.run.smithi050.stdout:4966 write 0x5ada6f1 thru 0x5adfd3c (0x564c bytes) 2024-09-05T17:32:09.880 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:09.888 INFO:teuthology.orchestra.run.smithi050.stdout:4967 write 0x86fe8b9 thru 0x8703760 (0x4ea8 bytes) 2024-09-05T17:32:09.897 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.897 INFO:teuthology.orchestra.run.smithi050.stdout:4971 punch from 0x2c2c2ba to 0x2c35a66, (0x97ac bytes) 2024-09-05T17:32:09.897 INFO:teuthology.orchestra.run.smithi050.stdout:4972 punch from 0x7446f8 to 0x750a60, (0xc368 bytes) 2024-09-05T17:32:09.897 INFO:teuthology.orchestra.run.smithi050.stdout:4973 trunc from 0xeac3c55 to 0xe4a8119 2024-09-05T17:32:09.914 INFO:teuthology.orchestra.run.smithi050.stdout:4974 read 0x714f2da thru 0x715efc5 (0xfcec bytes) 2024-09-05T17:32:09.928 INFO:teuthology.orchestra.run.smithi050.stdout:4976 trunc from 0xe4a8119 to 0x59764cb 2024-09-05T17:32:09.949 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:09.949 INFO:teuthology.orchestra.run.smithi050.stdout:4980 punch from 0x368ff0c to 0x3691d41, (0x1e35 bytes) 2024-09-05T17:32:09.949 INFO:teuthology.orchestra.run.smithi050.stdout:4981 write 0x558022c thru 0x558df8c (0xdd61 bytes) 2024-09-05T17:32:09.961 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:09.960+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:09.966 INFO:teuthology.orchestra.run.smithi050.stdout:4982 punch from 0x1ba5526 to 0x1ba7ff4, (0x2ace bytes) 2024-09-05T17:32:09.967 INFO:teuthology.orchestra.run.smithi050.stdout:4984 punch from 0x537288e to 0x537e4e0, (0xbc52 bytes) 2024-09-05T17:32:09.967 INFO:teuthology.orchestra.run.smithi050.stdout:4985 punch from 0x132ef6d to 0x1339864, (0xa8f7 bytes) 2024-09-05T17:32:09.967 INFO:teuthology.orchestra.run.smithi050.stdout:4986 trunc from 0x59764cb to 0x56f64d4 2024-09-05T17:32:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:marked in osd.0. 2024-09-05T17:32:09.968 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:32:10.000 INFO:tasks.thrashosds.thrasher:Added osd 0 2024-09-05T17:32:10.031 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:10.031 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:10.045 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:10.063 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:10.061+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:10.164 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:10.165+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:10.211 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:10.211 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:10.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:10.267 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:10.261+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:10.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:10.346 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:10.347 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:10.362 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:10.365 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:10.365+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:10.418 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:10.418 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:10.435 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:10.436 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:10.452 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:10.453 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:10.465 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:10.465+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:10.471 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:10.471 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:10.483 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:10.484 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:10.484 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:10.492 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:10.492 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:10.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:10.514 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:10.514 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:10.536 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:10.536 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:10.557 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:10.558 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:10.566 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:10.565+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:10.616 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:10.616 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:10.616 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:10.616 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:10.616 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:10.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:10.672 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:10.672+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:10.768 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:10.768+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:10.801 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:10.801 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:10.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:10.801 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:10.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.801 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:32:10.802 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:10.802 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.554247898, 2024-09-05T17:32:10.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:32:10.802 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.802 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.806 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 51.033305048000003, 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:32:10.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.829347147999997, 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.811 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:32:10.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.815 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.591352319000002, 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:32:10.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.578337779000002, 2024-09-05T17:32:10.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:10.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:32:10.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.824 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.576073848999997, 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.825 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.829 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.573982075000004, 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:32:10.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51735 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'202, mlcod=54'198)", 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.662668113000002, 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032394590000000001, 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.834 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137895+0000", 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4780000000000001e-06 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137904+0000", 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137926+0000", 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1013999999999999e-05 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137939+0000", 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.342e-05 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138024+0000", 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5167000000000006e-05 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138055+0000", 2024-09-05T17:32:10.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0982000000000003e-05 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.140997+0000", 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029416329999999999 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141133+0000", 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013600799999999999 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.659193604999999, 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:32:10.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.267052616999997, 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:32:10.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:32:10.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54994 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'375, mlcod=60'373)", 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.250669977999998, 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032305459999999999, 2024-09-05T17:32:10.847 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549891+0000", 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549893+0000", 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8339999999999999e-06 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549906+0000", 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2974e-05 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549936+0000", 2024-09-05T17:32:10.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0079000000000001e-05 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.549954+0000", 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7912999999999999e-05 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550156+0000", 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020149400000000001 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.550246+0000", 2024-09-05T17:32:10.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0470000000000006e-05 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553025+0000", 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027789780000000001 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.553122+0000", 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.6804000000000004e-05 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.245414468, 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.669214586999999, 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:32:10.856 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:32:10.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.860 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.016216472, 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:32:10.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.015610624000001, 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:32:10.865 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:32:10.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.869 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.015044693, 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:32:10.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:32:10.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.014389752, 2024-09-05T17:32:10.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:10.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:32:10.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:32:10.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:32:10.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:32:10.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.013689362999999, 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:32:10.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:32:10.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.012420747, 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:10.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.891 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:100058 3.18 e87/86 3:1ad21172:::rbd_data.1140b9781f.0000000000000010:head v 87'192, mlcod=0'0)", 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.8632248899999997, 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003565824, 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937337+0000", 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7899999999999997e-07 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938048+0000", 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00071111099999999995 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938066+0000", 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7958e-05 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938078+0000", 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1592e-05 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938155+0000", 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7541999999999997e-05 2024-09-05T17:32:10.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938186+0000", 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0756000000000002e-05 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940856+0000", 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026697460000000002 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940902+0000", 2024-09-05T17:32:10.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.634e-05 2024-09-05T17:32:10.896 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.896 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.896 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.896 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:10.896 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:10.896 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:10.898 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:10.899 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:10.896+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:10.998 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:10.996+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:11.080 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:11.080 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:11.080 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:11.080 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:11.095 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:11.136 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:11.136+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:11.201 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:11.197+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:11.259 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:11.259 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:11.259 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:11.259 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:11.259 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:11.273 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:11.301 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:11.301+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:11.400 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.191146520999993, 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:32:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.190125194000004, 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.189036696000002, 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.188016184999995, 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:32:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.186989236000002, 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.184646638000004, 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:32:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:32:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.179694464999997, 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:32:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.178694481999997, 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.178089083000003, 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.177029954999995, 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.176388672000002, 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:32:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.175793777999999, 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:32:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.174728583999993, 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:11.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.174087893999996, 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.462 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:11.466 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.173637193999994, 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:11.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:11.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:11.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.172991451000001, 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:32:11.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.475 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.172619432999994, 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:11.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:11.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.171978378999995, 2024-09-05T17:32:11.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:32:11.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.171379849999994, 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:11.485 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:11.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:32:11.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.3967658189999996, 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:32:11.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:11.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:32:11.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:11.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:11.496 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:11.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:11.498 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:11.496+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:11.599 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:11.596+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:11.630 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:11.630 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:11.630 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:11.630 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:11.644 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:11.700 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:11.700+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:11.767 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:11.767 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:11.767 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:11.767 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:11.767 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:11.781 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:11.801 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:11.800+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:11.901 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:11.900+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:11.903 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:11.903 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:11.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:11.903 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:11.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.903 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.903 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:11.903 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.199227311000001, 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:32:11.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.199179927000003, 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.908 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.199135255000002, 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:11.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:32:11.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.199089912999995, 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.918 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:32:11.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:32:11.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.199020903000005, 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:32:11.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.198972466000001, 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.931 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.198926107999995, 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:32:11.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:32:11.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.198263518000005, 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:32:11.936 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:32:11.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.198172172, 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:32:11.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.945 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.198110692, 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:32:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.198053791999996, 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.950 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:11.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.954 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.197960550999994, 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:32:11.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.959 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.197901023, 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:32:11.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.190745061000001, 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.965 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:32:11.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:11.969 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.190683594000006, 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.970 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:32:11.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.188815625000004, 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:32:11.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:11.979 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.188775114999999, 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:11.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:32:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.188736649000006, 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:32:11.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.988 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.188678542000005, 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:32:11.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.188621241000007, 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:11.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:11.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:11.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:11.997 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:11.998 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:32:11.999 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:32:12.003 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:12.000+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:12.103 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:12.100+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:12.130 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:12.130 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:12.130 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:12.130 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:12.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:32:12.205 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:12.203+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:12.266 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:12.266 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:12.266 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:12.266 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:12.266 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:12.280 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:32:12.325 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:12.325+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:12.405 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:12.405 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:12.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:12.405 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:12.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.660264681999998, 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:32:12.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:12.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:32:12.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:32:12.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.660206488999997, 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:32:12.411 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:32:12.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:32:12.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.660145171000003, 2024-09-05T17:32:12.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:12.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:32:12.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:32:12.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:32:12.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:32:12.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.421 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.660078704, 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.422 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:32:12.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.660002546999998, 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:12.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:32:12.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.65993958, 2024-09-05T17:32:12.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:32:12.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659877848999997, 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:32:12.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:32:12.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:32:12.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659794822000002, 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:12.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659736148, 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:32:12.443 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:32:12.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.447 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659679201000003, 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.451 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659614726000001, 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:32:12.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659544072999999, 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659467083000003, 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:32:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659408321999997, 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659345651000002, 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:32:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659283520000002, 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:32:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659164445000002, 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.659109993999998, 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.658947554000001, 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:32:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:32:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 58.657763166999999, 2024-09-05T17:32:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:12.493 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:12.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:12.495 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:12.491+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:12.580 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:12.625 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:12.623+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:12.663 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:12.663 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:12.663 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:12.663 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:12.677 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:12.697 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:12.695+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:12.740 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:12.740 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:12.756 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:12.756 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:12.773 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:12.773 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:12.790 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:12.790 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:12.796 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:12.796 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:12.796 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:12.796 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:12.796 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:12.797 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:12.795+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:12.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:12.810 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:12.811 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:12.830 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:12.830 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:12.850 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:12.850 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:12.880 INFO:teuthology.orchestra.run.smithi050.stdout:4987 write 0x2dc8051 thru 0x2dd468d (0xc63d bytes) 2024-09-05T17:32:12.884 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:12.885 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:12.889 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:12.890 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:12.890 INFO:teuthology.orchestra.run.smithi050.stdout:4991 read 0x4898ab6 thru 0x489ffe4 (0x752f bytes) 2024-09-05T17:32:12.890 INFO:teuthology.orchestra.run.smithi050.stdout:4992 read 0x4e4284a thru 0x4e452b4 (0x2a6b bytes) 2024-09-05T17:32:12.890 INFO:teuthology.orchestra.run.smithi050.stdout:4993 punch from 0x494adcb to 0x495375d, (0x8992 bytes) 2024-09-05T17:32:12.890 INFO:teuthology.orchestra.run.smithi050.stdout:4994 punch from 0x1926e92 to 0x19366a7, (0xf815 bytes) 2024-09-05T17:32:12.890 INFO:teuthology.orchestra.run.smithi050.stdout:4995 read 0x2952df5 thru 0x2954d86 (0x1f92 bytes) 2024-09-05T17:32:12.890 INFO:teuthology.orchestra.run.smithi050.stdout:4997 punch from 0x4f0c206 to 0x4f1a641, (0xe43b bytes) 2024-09-05T17:32:12.900 INFO:teuthology.orchestra.run.smithi050.stdout:4998 write 0x69067c6 thru 0x691180f (0xb04a bytes) 2024-09-05T17:32:12.901 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:12.899+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:12.913 INFO:teuthology.orchestra.run.smithi050.stdout:4999 write 0x6f71768 thru 0x6f7a957 (0x91f0 bytes) 2024-09-05T17:32:12.921 INFO:teuthology.orchestra.run.smithi050.stdout:5001 read 0x5f2d422 thru 0x5f348db (0x74ba bytes) 2024-09-05T17:32:12.921 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:12.921 INFO:teuthology.orchestra.run.smithi050.stdout:5003 read 0xf5a359 thru 0xf66911 (0xc5b9 bytes) 2024-09-05T17:32:12.921 INFO:teuthology.orchestra.run.smithi050.stdout:5005 punch from 0x5db31f4 to 0x5dbb72c, (0x8538 bytes) 2024-09-05T17:32:12.941 INFO:teuthology.orchestra.run.smithi050.stdout:5006 write 0xe3e226e thru 0xe3f09e1 (0xe774 bytes) 2024-09-05T17:32:12.942 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:12.943 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:12.954 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:12.955 INFO:teuthology.orchestra.run.smithi050.stdout:5008 write 0x15007f5 thru 0x1501208 (0xa14 bytes) 2024-09-05T17:32:12.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:5009 read 0x4dc2fdd thru 0x4dcb3f5 (0x8419 bytes) 2024-09-05T17:32:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:5010 read 0xa92e5d1 thru 0xa935998 (0x73c8 bytes) 2024-09-05T17:32:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:5014 punch from 0x7e2d6eb to 0x7e37576, (0x9e8b bytes) 2024-09-05T17:32:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:5015 read 0xdae6207 thru 0xdae8b08 (0x2902 bytes) 2024-09-05T17:32:12.962 INFO:teuthology.orchestra.run.smithi050.stdout:5016 clone 31 order 23 su 131072 sc 2 2024-09-05T17:32:12.987 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:32:13.009 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:13.009+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:13.088 INFO:teuthology.orchestra.run.smithi050.stdout:leaving image image_client.0-clone30 intact 2024-09-05T17:32:13.094 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:13.094 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:13.103 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:13.099+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:13.108 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:13.205 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:13.203+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:13.293 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:13.293 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:13.306 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:13.303+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:13.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:13.327 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-05T17:32:13.329 INFO:teuthology.orchestra.run.smithi050.stdout:5017 write 0x7a6c78a thru 0x7a7c598 (0xfe0f bytes) 2024-09-05T17:32:13.344 INFO:teuthology.orchestra.run.smithi050.stdout:5019 read 0x4547eda thru 0x45515f1 (0x9718 bytes) 2024-09-05T17:32:13.344 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.344 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.344 INFO:teuthology.orchestra.run.smithi050.stdout:5026 punch from 0xad22d39 to 0xad29cbf, (0x6f86 bytes) 2024-09-05T17:32:13.345 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.345 INFO:teuthology.orchestra.run.smithi050.stdout:5028 write 0xb192a53 thru 0xb19ef69 (0xc517 bytes) 2024-09-05T17:32:13.350 INFO:teuthology.orchestra.run.smithi050.stdout:5029 write 0x716637b thru 0x7168c40 (0x28c6 bytes) 2024-09-05T17:32:13.352 INFO:teuthology.orchestra.run.smithi050.stdout:5030 punch from 0x6ac06a9 to 0x6ac07af, (0x106 bytes) 2024-09-05T17:32:13.352 INFO:teuthology.orchestra.run.smithi050.stdout:5031 writesame 0xbb54b64 thru 0xbb62129 data_size 0xe(0xd5c6 bytes) 2024-09-05T17:32:13.359 INFO:teuthology.orchestra.run.smithi050.stdout:5032 write 0xa0b308b thru 0xa0b3ecd (0xe43 bytes) 2024-09-05T17:32:13.366 INFO:teuthology.orchestra.run.smithi050.stdout:5033 read 0xc3fc81a thru 0xc40259b (0x5d82 bytes) 2024-09-05T17:32:13.366 INFO:teuthology.orchestra.run.smithi050.stdout:5035 read 0xa92f281 thru 0xa93a341 (0xb0c1 bytes) 2024-09-05T17:32:13.367 INFO:teuthology.orchestra.run.smithi050.stdout:5036 read 0x9462301 thru 0x946c50c (0xa20c bytes) 2024-09-05T17:32:13.367 INFO:teuthology.orchestra.run.smithi050.stdout:5037 write 0x8c4b7c4 thru 0x8c588c3 (0xd100 bytes) 2024-09-05T17:32:13.376 INFO:teuthology.orchestra.run.smithi050.stdout:5038 trunc from 0xe3f09e2 to 0xca291ff 2024-09-05T17:32:13.392 INFO:teuthology.orchestra.run.smithi050.stdout:5039 flatten 2024-09-05T17:32:13.407 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:13.403+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:13.454 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:13.454 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:13.480 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:13.502 INFO:teuthology.orchestra.run.smithi050.stdout:5040 punch from 0xa999160 to 0xa9a6d63, (0xdc03 bytes) 2024-09-05T17:32:13.502 INFO:teuthology.orchestra.run.smithi050.stdout:5041 punch from 0x74c3fd3 to 0x74d017a, (0xc1a7 bytes) 2024-09-05T17:32:13.507 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:13.503+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:13.518 INFO:teuthology.orchestra.run.smithi050.stdout:5042 trunc from 0xca291ff to 0x32f9725 2024-09-05T17:32:13.545 INFO:teuthology.orchestra.run.smithi050.stdout:5043 write 0x382ed47 thru 0x3834495 (0x574f bytes) 2024-09-05T17:32:13.548 INFO:teuthology.orchestra.run.smithi050.stdout:5044 read 0x2e3c643 thru 0x2e3d032 (0x9f0 bytes) 2024-09-05T17:32:13.549 INFO:teuthology.orchestra.run.smithi050.stdout:5045 read 0xa05511 thru 0xa10666 (0xb156 bytes) 2024-09-05T17:32:13.549 INFO:teuthology.orchestra.run.smithi050.stdout:5046 read 0x1286ce4 thru 0x12882fb (0x1618 bytes) 2024-09-05T17:32:13.549 INFO:teuthology.orchestra.run.smithi050.stdout:5047 read 0x301e54c thru 0x3025e66 (0x791b bytes) 2024-09-05T17:32:13.572 INFO:teuthology.orchestra.run.smithi050.stdout:5048 writesame 0xc27300d thru 0xc27ff23 data_size 0x5(0xcf17 bytes) 2024-09-05T17:32:13.572 INFO:teuthology.orchestra.run.smithi050.stdout:5049 read 0x3632c65 thru 0x3636827 (0x3bc3 bytes) 2024-09-05T17:32:13.573 INFO:teuthology.orchestra.run.smithi050.stdout:5052 trunc from 0xc27ff24 to 0xc2272a5 2024-09-05T17:32:13.584 INFO:teuthology.orchestra.run.smithi050.stdout:5053 read 0x84871b3 thru 0x8487fab (0xdf9 bytes) 2024-09-05T17:32:13.584 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.601 INFO:teuthology.orchestra.run.smithi050.stdout:5055 write 0xdd38004 thru 0xdd45dc9 (0xddc6 bytes) 2024-09-05T17:32:13.607 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.607 INFO:teuthology.orchestra.run.smithi050.stdout:5060 read 0xd27770e thru 0xd27ed7c (0x766f bytes) 2024-09-05T17:32:13.608 INFO:teuthology.orchestra.run.smithi050.stdout:5061 write 0x74fe003 thru 0x75090af (0xb0ad bytes) 2024-09-05T17:32:13.608 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:13.607+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:13.631 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:13.631 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:13.637 INFO:teuthology.orchestra.run.smithi050.stdout:5062 write 0xeaf9d4b thru 0xeb08e05 (0xf0bb bytes) 2024-09-05T17:32:13.646 INFO:teuthology.orchestra.run.smithi050.stdout:5063 trunc from 0xeb08e06 to 0xe9ef214 2024-09-05T17:32:13.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:13.664 INFO:teuthology.orchestra.run.smithi050.stdout:5064 trunc from 0xe9ef214 to 0xd8785eb 2024-09-05T17:32:13.685 INFO:teuthology.orchestra.run.smithi050.stdout:5065 read 0x11e7823 thru 0x11f6c57 (0xf435 bytes) 2024-09-05T17:32:13.686 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.704 INFO:teuthology.orchestra.run.smithi050.stdout:5068 trunc from 0xd8785eb to 0x24a23bc 2024-09-05T17:32:13.709 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:13.707+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:13.757 INFO:teuthology.orchestra.run.smithi050.stdout:5069 write 0xae77c5b thru 0xae7ae65 (0x320b bytes) 2024-09-05T17:32:13.765 INFO:teuthology.orchestra.run.smithi050.stdout:5070 read 0x346c51f thru 0x3477c95 (0xb777 bytes) 2024-09-05T17:32:13.765 INFO:teuthology.orchestra.run.smithi050.stdout:5071 read 0x335918a thru 0x335eead (0x5d24 bytes) 2024-09-05T17:32:13.765 INFO:teuthology.orchestra.run.smithi050.stdout:5072 punch from 0x6b681e1 to 0x6b693a5, (0x11c4 bytes) 2024-09-05T17:32:13.765 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.765 INFO:teuthology.orchestra.run.smithi050.stdout:5074 write 0xac2d46 thru 0xad29c5 (0xfc80 bytes) 2024-09-05T17:32:13.767 INFO:teuthology.orchestra.run.smithi050.stdout:5075 punch from 0x76cd1c4 to 0x76d60a3, (0x8edf bytes) 2024-09-05T17:32:13.768 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.778 INFO:teuthology.orchestra.run.smithi050.stdout:5079 trunc from 0xae7ae66 to 0x37b014d 2024-09-05T17:32:13.801 INFO:teuthology.orchestra.run.smithi050.stdout:5080 read 0x16cb455 thru 0x16cf183 (0x3d2f bytes) 2024-09-05T17:32:13.801 INFO:teuthology.orchestra.run.smithi050.stdout:5082 read 0x1c8f35c thru 0x1c9b8de (0xc583 bytes) 2024-09-05T17:32:13.802 INFO:teuthology.orchestra.run.smithi050.stdout:5084 read 0xbe4eb5 thru 0xbeddf8 (0x8f44 bytes) 2024-09-05T17:32:13.803 INFO:teuthology.orchestra.run.smithi050.stdout:5086 read 0x2730526 thru 0x273f47a (0xef55 bytes) 2024-09-05T17:32:13.804 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.804 INFO:teuthology.orchestra.run.smithi050.stdout:5089 punch from 0x19d394 to 0x1a38c2, (0x652e bytes) 2024-09-05T17:32:13.806 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:13.806 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:13.809 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:13.807+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:13.824 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:13.824 INFO:teuthology.orchestra.run.smithi050.stdout:5090 write 0x618ec72 thru 0x619afd7 (0xc366 bytes) 2024-09-05T17:32:13.831 INFO:teuthology.orchestra.run.smithi050.stdout:5091 read 0x5f0e2b4 thru 0x5f1042b (0x2178 bytes) 2024-09-05T17:32:13.831 INFO:teuthology.orchestra.run.smithi050.stdout:5092 punch from 0x5300b17 to 0x530119b, (0x684 bytes) 2024-09-05T17:32:13.831 INFO:teuthology.orchestra.run.smithi050.stdout:5095 punch from 0x54bdf63 to 0x54c3012, (0x50af bytes) 2024-09-05T17:32:13.832 INFO:teuthology.orchestra.run.smithi050.stdout:5100 read 0x477a4ee thru 0x478079f (0x62b2 bytes) 2024-09-05T17:32:13.843 INFO:teuthology.orchestra.run.smithi050.stdout:5101 trunc from 0x619afd8 to 0xd7f295d 2024-09-05T17:32:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:5102 punch from 0x8f10d6d to 0x8f19510, (0x87a3 bytes) 2024-09-05T17:32:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:5105 punch from 0x520fc8 to 0x525667, (0x469f bytes) 2024-09-05T17:32:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:5106 read 0xc43af85 thru 0xc43c558 (0x15d4 bytes) 2024-09-05T17:32:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:5107 punch from 0xa87421b to 0xa880155, (0xbf3a bytes) 2024-09-05T17:32:13.855 INFO:teuthology.orchestra.run.smithi050.stdout:5108 write 0x696fa37 thru 0x697c1b9 (0xc783 bytes) 2024-09-05T17:32:13.863 INFO:teuthology.orchestra.run.smithi050.stdout:5109 writesame 0x169b9dc thru 0x169ffb8 data_size 0x31(0x45dd bytes) 2024-09-05T17:32:13.880 INFO:teuthology.orchestra.run.smithi050.stdout:5110 write 0xdae29d9 thru 0xdaee9ea (0xc012 bytes) 2024-09-05T17:32:13.888 INFO:teuthology.orchestra.run.smithi050.stdout:5111 read 0x5713baa thru 0x571bbd3 (0x802a bytes) 2024-09-05T17:32:13.888 INFO:teuthology.orchestra.run.smithi050.stdout:5113 read 0x70ed440 thru 0x70fbea7 (0xea68 bytes) 2024-09-05T17:32:13.888 INFO:teuthology.orchestra.run.smithi050.stdout:5115 read 0x78b99e5 thru 0x78bd981 (0x3f9d bytes) 2024-09-05T17:32:13.888 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.888 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.888 INFO:teuthology.orchestra.run.smithi050.stdout:5119 writesame 0xcbe4684 thru 0xcbf12e6 data_size 0x6b(0xcc63 bytes) 2024-09-05T17:32:13.896 INFO:teuthology.orchestra.run.smithi050.stdout:5120 write 0x39ceaf thru 0x3a783f (0xa991 bytes) 2024-09-05T17:32:13.901 INFO:teuthology.orchestra.run.smithi050.stdout:5121 write 0xd0428d5 thru 0xd04ec7d (0xc3a9 bytes) 2024-09-05T17:32:13.909 INFO:teuthology.orchestra.run.smithi050.stdout:5123 read 0x5e0049a thru 0x5e02c56 (0x27bd bytes) 2024-09-05T17:32:13.909 INFO:teuthology.orchestra.run.smithi050.stdout:5124 write 0x86a06b5 thru 0x86a4fda (0x4926 bytes) 2024-09-05T17:32:13.909 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:13.909+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:13.917 INFO:teuthology.orchestra.run.smithi050.stdout:5128 read 0x2cb2806 thru 0x2cc09e6 (0xe1e1 bytes) 2024-09-05T17:32:13.917 INFO:teuthology.orchestra.run.smithi050.stdout:5129 write 0x5e2e25a thru 0x5e30ba1 (0x2948 bytes) 2024-09-05T17:32:13.938 INFO:teuthology.orchestra.run.smithi050.stdout:5130 writesame 0xdc6df51 thru 0xdc72d79 data_size 0x11(0x4e29 bytes) 2024-09-05T17:32:13.949 INFO:teuthology.orchestra.run.smithi050.stdout:5131 trunc from 0xdc72d7a to 0x8a24b63 2024-09-05T17:32:13.971 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:13.971 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:13.975 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:13.975 INFO:teuthology.orchestra.run.smithi050.stdout:5133 read 0x31a12fb thru 0x31ae6fa (0xd400 bytes) 2024-09-05T17:32:13.975 INFO:teuthology.orchestra.run.smithi050.stdout:5134 read 0x6a8e071 thru 0x6a95e67 (0x7df7 bytes) 2024-09-05T17:32:13.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:14.010 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:14.009+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:14.111 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:14.107+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:14.167 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:14.167 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:14.184 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:14.228 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:14.227+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:14.312 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:14.309+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:14.364 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:14.364 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:14.382 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:14.428 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:14.427+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:14.515 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:14.513+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:14.523 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:14.523 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:14.539 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:14.625 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:14.623+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:14.717 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:14.715+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:14.719 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:14.719 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:14.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:14.818 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:14.817+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:14.911 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:14.919 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:14.917+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:14.932 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:14.932 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:14.951 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:15.000 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:32:15.001 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:32:15.001 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-05T17:32:15.001 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-05T17:32:15.018 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:32:15.022 INFO:teuthology.orchestra.run.smithi050.stdout:5136 write 0xc2350cd thru 0xc237258 (0x218c bytes) 2024-09-05T17:32:15.022 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:15.019+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:15.038 INFO:teuthology.orchestra.run.smithi050.stdout:5138 trunc from 0xc237259 to 0x62f2fd0 2024-09-05T17:32:15.110 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:15.111 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:15.121 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:15.119+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:15.132 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:15.132 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:15.160 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:15.160 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:15.167 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:15.167 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:15.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:15.187 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:15.187 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:15.219 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:15.219 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:15.220 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:15.219+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:15.257 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:15.257 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:15.293 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:15.294 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:15.311 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:15.311 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:15.311 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:15.311 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:15.322 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:15.319+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:15.327 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:15.330 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:15.331 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:15.423 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:15.419+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:15.443 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:32:15.443 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 96, 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "229efc05-fdc4-4e1f-8246-413b49f3eeda", 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2024-09-05T17:30:12.762369+0000", 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2024-09-05T17:32:14.997488+0000", 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2024-09-05T17:30:23.981355+0000", 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2024-09-05T17:32:09.963211+0000", 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5804032, 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "nodeep-scrub", 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2024-09-05T17:32:15.444 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 5, 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.94999998807907104, 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 3, 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "luminous", 2024-09-05T17:32:15.445 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "squid", 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:25.818485+0000", 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:32:15.446 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:32:15.447 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "18", 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2024-09-05T17:32:15.448 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:32:15.449 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:32:15.450 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:32:15.451 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:32:15.451 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:32:15.451 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:32:15.452 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:32:15.452 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2024-09-05T17:32:15.452 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2024-09-05T17:32:15.452 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2024-09-05T17:32:15.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.452 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:32:15.452 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2024-09-05T17:32:15.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.90918922424316406, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.9100000262260437 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:30.943478+0000", 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:32:15.454 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:32:15.455 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "22", 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 2, 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 22, 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:32:15.456 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:32:15.457 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:32:15.458 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:32:15.459 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:32:15.460 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 2, 2024-09-05T17:32:15.460 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 2, 2024-09-05T17:32:15.460 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2024-09-05T17:32:15.460 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2024-09-05T17:32:15.460 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2024-09-05T17:32:15.461 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.90918922424316406, 2024-09-05T17:32:15.461 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-05T17:32:15.461 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.9100000262260437 2024-09-05T17:32:15.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.462 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:32:15.462 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "pool_client.0", 2024-09-05T17:32:15.462 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:42.082168+0000", 2024-09-05T17:32:15.462 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2024-09-05T17:32:15.463 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.464 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "94", 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 33, 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 94, 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:32:15.465 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:32:15.466 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:32:15.467 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.75, 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.75, 2024-09-05T17:32:15.468 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 1, 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.90918922424316406, 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.9100000262260437 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:32:15.469 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "38dd1565-a37f-4055-acb3-aa82457cf9e7", 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 95, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:15.471 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.472 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:15.473 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.473 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.473 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2024-09-05T17:32:15.473 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.478 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6825/1446480840", 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6827/1446480840", 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/1446480840", 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6829/1446480840", 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f5ef5f03-d714-4329-b14b-1881ad1e7358", 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:15.480 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 0.545806884765625, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 94, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:15.481 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2024-09-05T17:32:15.482 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:15.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.483 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.483 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:15.483 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.483 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.483 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.485 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/3885625462", 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/3885625462", 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/3885625462", 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/3885625462", 2024-09-05T17:32:15.486 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "7b87b0cc-2484-4a66-be1b-232a7e36dc11", 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:15.487 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 94, 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.488 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.490 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.491 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/3027840955", 2024-09-05T17:32:15.492 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/3027840955", 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/3027840955", 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/3027840955", 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f6d63b1e-2673-4542-a2e2-fbb0c4577864", 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:15.493 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 95, 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2024-09-05T17:32:15.494 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2024-09-05T17:32:15.495 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.496 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.497 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.498 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/2889879466", 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6819/2889879466", 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6823/2889879466", 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6821/2889879466", 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "273ec4c6-0c2a-41d5-90c1-68b317365484", 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 0.2735137939453125, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 95, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:15.500 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6808", 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6809", 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.501 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6810", 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6811", 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6814", 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6815", 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6812", 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6813", 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:15.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6809/1774319792", 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6811/1774319792", 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6815/1774319792", 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6813/1774319792", 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:32:15.505 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "5f6cf36b-2dd0-47de-97c4-42e98f849734", 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 94, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:15.506 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6816", 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6817", 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6818", 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6819", 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:15.508 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6822", 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6823", 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.509 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6820", 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6821", 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6817/1348894681", 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6819/1348894681", 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6823/1348894681", 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6821/1348894681", 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "2d6ed4a6-3d83-4c9d-9e96-2dbab049448a", 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:15.511 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 95, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.512 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6824", 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6825", 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.513 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6826", 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6827", 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.514 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6830", 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6831", 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6828", 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6829", 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6825/792585226", 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6827/792585226", 2024-09-05T17:32:15.516 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6831/792585226", 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6829/792585226", 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "dbe1901b-5f78-419f-864a-89946452f4a6", 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:15.517 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 91, 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6800", 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.518 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6801", 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6802", 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.519 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6803", 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6806", 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6807", 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6804", 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6805", 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6801/2161010500", 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6803/2161010500", 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2161010500", 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2161010500", 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:15.522 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:22.246726+0000", 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.638940+0000", 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:15.524 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.694544+0000", 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:15.525 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.653253+0000", 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.467561+0000", 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.797765+0000", 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:15.527 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.649372+0000", 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.242988+0000", 2024-09-05T17:32:15.528 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [ 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: "pgid": "3.7", 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: 6, 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: 7 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [], 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2024-09-05T17:32:15.529 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [ 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "pgid": "3.b", 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: 3 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2024-09-05T17:32:15.530 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [], 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [], 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2024-09-05T17:32:15.531 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2024-09-05T17:32:15.532 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2024-09-05T17:32:15.532 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.532 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:15.533 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:15.533 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:15.533 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:15.533 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:15.533 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:15.534 INFO:tasks.thrashosds.thrasher:j is {'epoch': 96, 'fsid': '229efc05-fdc4-4e1f-8246-413b49f3eeda', 'created': '2024-09-05T17:30:12.762369+0000', 'modified': '2024-09-05T17:32:14.997488+0000', 'last_up_change': '2024-09-05T17:30:23.981355+0000', 'last_in_change': '2024-09-05T17:32:09.963211+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T17:30:25.818485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9091892242431641, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.9100000262260437}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-05T17:30:30.943478+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9091892242431641, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.9100000262260437}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-05T17:30:42.082168+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.9091892242431641, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.9100000262260437}}], 'osds': [{'osd': 0, 'uuid': '38dd1565-a37f-4055-acb3-aa82457cf9e7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 95, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6824', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6825', 'nonce': 1446480840}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6826', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6827', 'nonce': 1446480840}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6830', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6831', 'nonce': 1446480840}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6828', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6829', 'nonce': 1446480840}]}, 'public_addr': '172.21.15.50:6825/1446480840', 'cluster_addr': '172.21.15.50:6827/1446480840', 'heartbeat_back_addr': '172.21.15.50:6831/1446480840', 'heartbeat_front_addr': '172.21.15.50:6829/1446480840', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f5ef5f03-d714-4329-b14b-1881ad1e7358', 'up': 1, 'in': 1, 'weight': 0.545806884765625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 94, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6808', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6809', 'nonce': 3885625462}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6810', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6811', 'nonce': 3885625462}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6814', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6815', 'nonce': 3885625462}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6812', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6813', 'nonce': 3885625462}]}, 'public_addr': '172.21.15.50:6809/3885625462', 'cluster_addr': '172.21.15.50:6811/3885625462', 'heartbeat_back_addr': '172.21.15.50:6815/3885625462', 'heartbeat_front_addr': '172.21.15.50:6813/3885625462', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '7b87b0cc-2484-4a66-be1b-232a7e36dc11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 94, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6800', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6801', 'nonce': 3027840955}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6802', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6803', 'nonce': 3027840955}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6806', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6807', 'nonce': 3027840955}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6804', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6805', 'nonce': 3027840955}]}, 'public_addr': '172.21.15.50:6801/3027840955', 'cluster_addr': '172.21.15.50:6803/3027840955', 'heartbeat_back_addr': '172.21.15.50:6807/3027840955', 'heartbeat_front_addr': '172.21.15.50:6805/3027840955', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'f6d63b1e-2673-4542-a2e2-fbb0c4577864', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 95, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6816', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6817', 'nonce': 2889879466}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6818', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 2889879466}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6822', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6823', 'nonce': 2889879466}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6820', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6821', 'nonce': 2889879466}]}, 'public_addr': '172.21.15.50:6817/2889879466', 'cluster_addr': '172.21.15.50:6819/2889879466', 'heartbeat_back_addr': '172.21.15.50:6823/2889879466', 'heartbeat_front_addr': '172.21.15.50:6821/2889879466', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '273ec4c6-0c2a-41d5-90c1-68b317365484', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2735137939453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 95, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 1774319792}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 1774319792}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 1774319792}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 1774319792}]}, 'public_addr': '172.21.15.110:6809/1774319792', 'cluster_addr': '172.21.15.110:6811/1774319792', 'heartbeat_back_addr': '172.21.15.110:6815/1774319792', 'heartbeat_front_addr': '172.21.15.110:6813/1774319792', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5f6cf36b-2dd0-47de-97c4-42e98f849734', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 94, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 1348894681}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 1348894681}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 1348894681}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 1348894681}]}, 'public_addr': '172.21.15.110:6817/1348894681', 'cluster_addr': '172.21.15.110:6819/1348894681', 'heartbeat_back_addr': '172.21.15.110:6823/1348894681', 'heartbeat_front_addr': '172.21.15.110:6821/1348894681', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2d6ed4a6-3d83-4c9d-9e96-2dbab049448a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 95, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 792585226}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 792585226}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 792585226}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 792585226}]}, 'public_addr': '172.21.15.110:6825/792585226', 'cluster_addr': '172.21.15.110:6827/792585226', 'heartbeat_back_addr': '172.21.15.110:6831/792585226', 'heartbeat_front_addr': '172.21.15.110:6829/792585226', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dbe1901b-5f78-419f-864a-89946452f4a6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 91, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2161010500}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2161010500}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2161010500}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2161010500}]}, 'public_addr': '172.21.15.110:6801/2161010500', 'cluster_addr': '172.21.15.110:6803/2161010500', 'heartbeat_back_addr': '172.21.15.110:6807/2161010500', 'heartbeat_front_addr': '172.21.15.110:6805/2161010500', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:22.246726+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.638940+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.694544+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.653253+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.467561+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.797765+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.649372+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.242988+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.7', 'osds': [6, 7]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '3.b', 'osds': [3]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-05T17:32:15.535 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:32:15.536 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:15.536 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:15.533+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:15.634 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:15.631+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:15.704 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13396 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5662720~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.704 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.494280988, 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140378372, 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13396 2024-09-05T17:32:15.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209184+0000", 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209760+0000", 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057600999999999996 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209784+0000", 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3736000000000001e-05 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209808+0000", 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3861000000000001e-05 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.209822+0000", 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3971000000000001e-05 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349185+0000", 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13936281 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349387+0000", 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020272199999999999 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.349563+0000", 2024-09-05T17:32:15.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175262 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.493259660999996, 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.710 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:15.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.715 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.492171162999995, 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.716 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:15.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:15.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.722 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.722 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:15.722 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.491150652000002, 2024-09-05T17:32:15.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:32:15.722 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.722 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.727 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.490123702999995, 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.728 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:32:15.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:32:15.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:32:15.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:32:15.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:32:15.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:32:15.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:32:15.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:32:15.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.735 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.735 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.735 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.487781104999996, 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.736 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:15.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:32:15.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:32:15.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:15.741 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.482828932000004, 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:32:15.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:32:15.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:32:15.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.481828949000004, 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:15.748 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:15.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.481223549999996, 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.753 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:15.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:15.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:15.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:15.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:15.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:15.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.480164422000001, 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.759 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:15.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.763 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.479523138999994, 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:32:15.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.768 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.478928245000006, 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:32:15.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:32:15.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.477863051, 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.773 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:15.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.777 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.477222361000003, 2024-09-05T17:32:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:32:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:32:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:32:15.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.476771661000001, 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:15.783 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:15.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:15.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:15.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.476125917999994, 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:15.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.792 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.475753900000001, 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:15.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:15.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.475112846000002, 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.797 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:32:15.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:32:15.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.474514317000001, 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:32:15.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.6999002860000001, 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:15.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:32:15.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:15.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:15.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:15.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:15.813 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:15.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:15.815 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:15.813+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:15.905 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:32:15.906 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:32:15.916 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:15.913+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:15.925 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-05T17:32:15.797033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1115190096,"num_objects":1415,"num_object_clones":332,"num_object_copies":2830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":50,"num_objects_unfound":0,"num_objects_dirty":1415,"num_whiteouts":271,"num_read":136426,"num_read_kb":385980,"num_write":18864,"num_write_kb":184647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1661,"num_bytes_recovered":55777082,"num_keys_recovered":168,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14516,"ondisk_log_size":14516,"up":82,"acting":79,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":406204,"kb_used_data":47052,"kb_used_omap":12,"kb_used_meta":358963,"kb_avail":754568516,"statfs":{"total":773094113280,"available":772678160384,"internally_reserved":0,"allocated":48181248,"data_stored":291548966,"data_compressed":10930276,"data_compressed_allocated":24965120,"data_compressed_original":278945070,"omap_allocated":12751,"internal_metadata":367578673},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":52803643,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":50,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":2815,"num_read_kb":18154,"num_write":415,"num_write_kb":15556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":822,"num_bytes_recovered":26402607,"num_keys_recovered":96,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000925"},"pg_stats":[{"pgid":"3.1f","version":"94'267","reported_seq":2578,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-05T17:32:13.927204+0000","last_change":"2024-09-05T17:32:14.863580+0000","last_active":"2024-09-05T17:32:14.863580+0000","last_peered":"2024-09-05T17:32:13.927204+0000","last_clean":"2024-09-05T17:32:09.072428+0000","last_became_active":"2024-09-05T17:32:12.879533+0000","last_became_peered":"2024-09-05T17:32:12.879533+0000","last_unstale":"2024-09-05T17:32:13.927204+0000","last_undegraded":"2024-09-05T17:32:13.927204+0000","last_fullsized":"2024-09-05T17:32:13.927204+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023314770000000002,"stat_sum":{"num_bytes":52100151,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":10,"num_read":2458,"num_read_kb":10926,"num_write":310,"num_write_kb":6801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":6784530,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"90'257","reported_seq":1375,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.001838+0000","last_change":"2024-09-05T17:30:45.601580+0000","last_active":"2024-09-05T17:32:14.001838+0000","last_peered":"2024-09-05T17:32:14.001838+0000","last_clean":"2024-09-05T17:32:14.001838+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:32:14.001838+0000","last_undegraded":"2024-09-05T17:32:14.001838+0000","last_fullsized":"2024-09-05T17:32:14.001838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:49:57.318465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012442379999999999,"stat_sum":{"num_bytes":8576842,"num_objects":24,"num_object_clones":4,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":1800,"num_read_kb":7434,"num_write":268,"num_write_kb":3913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"94'357","reported_seq":2799,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.006303+0000","last_change":"2024-09-05T17:30:45.585378+0000","last_active":"2024-09-05T17:32:14.006303+0000","last_peered":"2024-09-05T17:32:14.006303+0000","last_clean":"2024-09-05T17:32:14.006303+0000","last_became_active":"2024-09-05T17:30:43.597087+0000","last_became_peered":"2024-09-05T17:30:43.597087+0000","last_unstale":"2024-09-05T17:32:14.006303+0000","last_undegraded":"2024-09-05T17:32:14.006303+0000","last_fullsized":"2024-09-05T17:32:14.006303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:01:46.523755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064572499999999999,"stat_sum":{"num_bytes":54140328,"num_objects":47,"num_object_clones":13,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":9,"num_read":3268,"num_read_kb":14281,"num_write":410,"num_write_kb":4902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"94'284","reported_seq":2186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.005984+0000","last_change":"2024-09-05T17:30:45.586287+0000","last_active":"2024-09-05T17:32:14.005984+0000","last_peered":"2024-09-05T17:32:14.005984+0000","last_clean":"2024-09-05T17:32:14.005984+0000","last_became_active":"2024-09-05T17:30:43.604511+0000","last_became_peered":"2024-09-05T17:30:43.604511+0000","last_unstale":"2024-09-05T17:32:14.005984+0000","last_undegraded":"2024-09-05T17:32:14.005984+0000","last_fullsized":"2024-09-05T17:32:14.005984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:28:37.350677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015056150000000001,"stat_sum":{"num_bytes":12077781,"num_objects":42,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":5,"num_read":1835,"num_read_kb":6760,"num_write":295,"num_write_kb":4351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"90'251","reported_seq":1111,"reported_epoch":95,"state":"active+undersized+remapped","last_fresh":"2024-09-05T17:32:14.093366+0000","last_change":"2024-09-05T17:32:14.093366+0000","last_active":"2024-09-05T17:32:14.093366+0000","last_peered":"2024-09-05T17:32:14.093366+0000","last_clean":"2024-09-05T17:32:08.978282+0000","last_became_active":"2024-09-05T17:32:12.892523+0000","last_became_peered":"2024-09-05T17:32:12.892523+0000","last_unstale":"2024-09-05T17:32:14.093366+0000","last_undegraded":"2024-09-05T17:32:14.093366+0000","last_fullsized":"2024-09-05T17:32:11.991865+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":251,"log_dups_size":0,"ondisk_log_size":251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001548448,"stat_sum":{"num_bytes":54417239,"num_objects":38,"num_object_clones":10,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":7,"num_read":558,"num_read_kb":6787,"num_write":252,"num_write_kb":4547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[4],"avail_no_missing":["4","0","7"],"object_location_counts":[{"shards":"4","objects":38}],"blocked_by":[],"up_primary":0,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"94'554","reported_seq":4280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.002010+0000","last_change":"2024-09-05T17:31:31.709738+0000","last_active":"2024-09-05T17:32:14.002010+0000","last_peered":"2024-09-05T17:32:14.002010+0000","last_clean":"2024-09-05T17:32:14.002010+0000","last_became_active":"2024-09-05T17:31:31.708688+0000","last_became_peered":"2024-09-05T17:31:31.708688+0000","last_unstale":"2024-09-05T17:32:14.002010+0000","last_undegraded":"2024-09-05T17:32:14.002010+0000","last_fullsized":"2024-09-05T17:32:14.002010+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:16:55.478807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058024300000000003,"stat_sum":{"num_bytes":19051961,"num_objects":44,"num_object_clones":9,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":9,"num_read":5879,"num_read_kb":8991,"num_write":654,"num_write_kb":4572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"90'437","reported_seq":7070,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.002343+0000","last_change":"2024-09-05T17:30:45.579337+0000","last_active":"2024-09-05T17:32:14.002343+0000","last_peered":"2024-09-05T17:32:14.002343+0000","last_clean":"2024-09-05T17:32:14.002343+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:32:14.002343+0000","last_undegraded":"2024-09-05T17:32:14.002343+0000","last_fullsized":"2024-09-05T17:32:14.002343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:27:34.087388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096919599999999997,"stat_sum":{"num_bytes":57840063,"num_objects":39,"num_object_clones":5,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":6,"num_read":7129,"num_read_kb":29584,"num_write":509,"num_write_kb":7501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"90'208","reported_seq":1425,"reported_epoch":94,"state":"peering","last_fresh":"2024-09-05T17:32:13.589065+0000","last_change":"2024-09-05T17:32:14.003512+0000","last_active":"2024-09-05T17:32:14.003512+0000","last_peered":"2024-09-05T17:32:13.589065+0000","last_clean":"2024-09-05T17:32:09.779373+0000","last_became_active":"2024-09-05T17:32:12.882223+0000","last_became_peered":"2024-09-05T17:32:12.882223+0000","last_unstale":"2024-09-05T17:32:13.589065+0000","last_undegraded":"2024-09-05T17:32:13.589065+0000","last_fullsized":"2024-09-05T17:32:11.998352+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001371232,"stat_sum":{"num_bytes":10278232,"num_objects":36,"num_object_clones":12,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":8,"num_read":675,"num_read_kb":5423,"num_write":218,"num_write_kb":5651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"94'588","reported_seq":1459,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-05T17:32:13.989008+0000","last_change":"2024-09-05T17:32:14.863550+0000","last_active":"2024-09-05T17:32:14.863550+0000","last_peered":"2024-09-05T17:32:13.989008+0000","last_clean":"2024-09-05T17:32:09.964635+0000","last_became_active":"2024-09-05T17:32:12.876998+0000","last_became_peered":"2024-09-05T17:32:12.876998+0000","last_unstale":"2024-09-05T17:32:13.989008+0000","last_undegraded":"2024-09-05T17:32:13.989008+0000","last_fullsized":"2024-09-05T17:32:12.001734+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024520119999999999,"stat_sum":{"num_bytes":13672749,"num_objects":33,"num_object_clones":3,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":3,"num_read":2453,"num_read_kb":3641,"num_write":836,"num_write_kb":2866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":710624,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"94'593","reported_seq":1499,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.006255+0000","last_change":"2024-09-05T17:30:45.586718+0000","last_active":"2024-09-05T17:32:14.006255+0000","last_peered":"2024-09-05T17:32:14.006255+0000","last_clean":"2024-09-05T17:32:14.006255+0000","last_became_active":"2024-09-05T17:30:43.604988+0000","last_became_peered":"2024-09-05T17:30:43.604988+0000","last_unstale":"2024-09-05T17:32:14.006255+0000","last_undegraded":"2024-09-05T17:32:14.006255+0000","last_fullsized":"2024-09-05T17:32:14.006255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:21:25.039545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017597120000000001,"stat_sum":{"num_bytes":25481920,"num_objects":58,"num_object_clones":14,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":10,"num_read":2845,"num_read_kb":7027,"num_write":819,"num_write_kb":8765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"94'219","reported_seq":749,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119651+0000","last_change":"2024-09-05T17:30:46.331830+0000","last_active":"2024-09-05T17:32:14.119651+0000","last_peered":"2024-09-05T17:32:14.119651+0000","last_clean":"2024-09-05T17:32:14.119651+0000","last_became_active":"2024-09-05T17:30:43.598646+0000","last_became_peered":"2024-09-05T17:30:43.598646+0000","last_unstale":"2024-09-05T17:32:14.119651+0000","last_undegraded":"2024-09-05T17:32:14.119651+0000","last_fullsized":"2024-09-05T17:32:14.119651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:50:03.505927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010679610000000001,"stat_sum":{"num_bytes":12651503,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":429,"num_read_kb":2839,"num_write":195,"num_write_kb":2102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"93'349","reported_seq":13213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119682+0000","last_change":"2024-09-05T17:31:31.709878+0000","last_active":"2024-09-05T17:32:14.119682+0000","last_peered":"2024-09-05T17:32:14.119682+0000","last_clean":"2024-09-05T17:32:14.119682+0000","last_became_active":"2024-09-05T17:31:31.707629+0000","last_became_peered":"2024-09-05T17:31:31.707629+0000","last_unstale":"2024-09-05T17:32:14.119682+0000","last_undegraded":"2024-09-05T17:32:14.119682+0000","last_fullsized":"2024-09-05T17:32:14.119682+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:00.123059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010724350000000001,"stat_sum":{"num_bytes":44602033,"num_objects":48,"num_object_clones":12,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":13927,"num_read_kb":31786,"num_write":341,"num_write_kb":3375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.000540+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:32:14.000540+0000","last_peered":"2024-09-05T17:32:14.000540+0000","last_clean":"2024-09-05T17:32:14.000540+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:32:14.000540+0000","last_undegraded":"2024-09-05T17:32:14.000540+0000","last_fullsized":"2024-09-05T17:32:14.000540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"93'367","reported_seq":4991,"reported_epoch":95,"state":"creating+peering","last_fresh":"2024-09-05T17:32:13.314428+0000","last_change":"2024-09-05T17:32:14.863504+0000","last_active":"2024-09-05T17:32:14.863504+0000","last_peered":"2024-09-05T17:32:13.314428+0000","last_clean":"2024-09-05T17:32:09.128509+0000","last_became_active":"2024-09-05T17:32:12.871794+0000","last_became_peered":"2024-09-05T17:32:12.871794+0000","last_unstale":"2024-09-05T17:32:13.314428+0000","last_undegraded":"2024-09-05T17:32:13.314428+0000","last_fullsized":"2024-09-05T17:32:11.991902+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024656499999999998,"stat_sum":{"num_bytes":34616491,"num_objects":44,"num_object_clones":12,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":9,"num_read":5858,"num_read_kb":18757,"num_write":360,"num_write_kb":7322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.000421+0000","last_change":"2024-09-05T17:32:05.421784+0000","last_active":"2024-09-05T17:32:14.000421+0000","last_peered":"2024-09-05T17:32:14.000421+0000","last_clean":"2024-09-05T17:32:14.000421+0000","last_became_active":"2024-09-05T17:32:05.420725+0000","last_became_peered":"2024-09-05T17:32:05.420725+0000","last_unstale":"2024-09-05T17:32:14.000421+0000","last_undegraded":"2024-09-05T17:32:14.000421+0000","last_fullsized":"2024-09-05T17:32:14.000421+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:29:14.852745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"94'349","reported_seq":734,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.000268+0000","last_change":"2024-09-05T17:31:18.499515+0000","last_active":"2024-09-05T17:32:14.000268+0000","last_peered":"2024-09-05T17:32:14.000268+0000","last_clean":"2024-09-05T17:32:14.000268+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:32:14.000268+0000","last_undegraded":"2024-09-05T17:32:14.000268+0000","last_fullsized":"2024-09-05T17:32:14.000268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:13:46.630387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062572599999999995,"stat_sum":{"num_bytes":18500074,"num_objects":32,"num_object_clones":4,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":5,"num_read":720,"num_read_kb":2530,"num_write":426,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119916+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:32:14.119916+0000","last_peered":"2024-09-05T17:32:14.119916+0000","last_clean":"2024-09-05T17:32:14.119916+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:32:14.119916+0000","last_undegraded":"2024-09-05T17:32:14.119916+0000","last_fullsized":"2024-09-05T17:32:14.119916+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"94'555","reported_seq":2676,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.002520+0000","last_change":"2024-09-05T17:30:45.579183+0000","last_active":"2024-09-05T17:32:14.002520+0000","last_peered":"2024-09-05T17:32:14.002520+0000","last_clean":"2024-09-05T17:32:14.002520+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:32:14.002520+0000","last_undegraded":"2024-09-05T17:32:14.002520+0000","last_fullsized":"2024-09-05T17:32:14.002520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:39:07.345351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075116199999999999,"stat_sum":{"num_bytes":20625704,"num_objects":37,"num_object_clones":6,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":6,"num_read":4748,"num_read_kb":6823,"num_write":739,"num_write_kb":3090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.002640+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:32:14.002640+0000","last_peered":"2024-09-05T17:32:14.002640+0000","last_clean":"2024-09-05T17:32:14.002640+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:32:14.002640+0000","last_undegraded":"2024-09-05T17:32:14.002640+0000","last_fullsized":"2024-09-05T17:32:14.002640+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"90'417","reported_seq":1618,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.006326+0000","last_change":"2024-09-05T17:30:45.585838+0000","last_active":"2024-09-05T17:32:14.006326+0000","last_peered":"2024-09-05T17:32:14.006326+0000","last_clean":"2024-09-05T17:32:14.006326+0000","last_became_active":"2024-09-05T17:30:43.586429+0000","last_became_peered":"2024-09-05T17:30:43.586429+0000","last_unstale":"2024-09-05T17:32:14.006326+0000","last_undegraded":"2024-09-05T17:32:14.006326+0000","last_fullsized":"2024-09-05T17:32:14.006326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:10:19.127582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010231579999999999,"stat_sum":{"num_bytes":49379707,"num_objects":52,"num_object_clones":11,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":8,"num_read":2040,"num_read_kb":24683,"num_write":469,"num_write_kb":14787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"90'339","reported_seq":6046,"reported_epoch":95,"state":"active+undersized+remapped","last_fresh":"2024-09-05T17:32:14.567804+0000","last_change":"2024-09-05T17:32:14.568364+0000","last_active":"2024-09-05T17:32:14.567804+0000","last_peered":"2024-09-05T17:32:14.567804+0000","last_clean":"2024-09-05T17:32:09.889682+0000","last_became_active":"2024-09-05T17:32:12.892585+0000","last_became_peered":"2024-09-05T17:32:12.892585+0000","last_unstale":"2024-09-05T17:32:14.567804+0000","last_undegraded":"2024-09-05T17:32:14.567804+0000","last_fullsized":"2024-09-05T17:32:11.991805+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077238000000000003,"stat_sum":{"num_bytes":16611343,"num_objects":40,"num_object_clones":13,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":8,"num_read":6137,"num_read_kb":14587,"num_write":371,"num_write_kb":5349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[4],"avail_no_missing":["4","0","6"],"object_location_counts":[{"shards":"4","objects":40}],"blocked_by":[],"up_primary":0,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.005934+0000","last_change":"2024-09-05T17:30:34.068613+0000","last_active":"2024-09-05T17:32:14.005934+0000","last_peered":"2024-09-05T17:32:14.005934+0000","last_clean":"2024-09-05T17:32:14.005934+0000","last_became_active":"2024-09-05T17:30:32.048202+0000","last_became_peered":"2024-09-05T17:30:32.048202+0000","last_unstale":"2024-09-05T17:32:14.005934+0000","last_undegraded":"2024-09-05T17:32:14.005934+0000","last_fullsized":"2024-09-05T17:32:14.005934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:49:57.024162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"90'1209","reported_seq":2850,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.002339+0000","last_change":"2024-09-05T17:30:45.580126+0000","last_active":"2024-09-05T17:32:14.002339+0000","last_peered":"2024-09-05T17:32:14.002339+0000","last_clean":"2024-09-05T17:32:14.002339+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:32:14.002339+0000","last_undegraded":"2024-09-05T17:32:14.002339+0000","last_fullsized":"2024-09-05T17:32:14.002339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:19:49.774933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093389999999999999,"stat_sum":{"num_bytes":25247426,"num_objects":55,"num_object_clones":15,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":14,"num_read":7252,"num_read_kb":8886,"num_write":2041,"num_write_kb":4812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:13.999666+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:32:13.999666+0000","last_peered":"2024-09-05T17:32:13.999666+0000","last_clean":"2024-09-05T17:32:13.999666+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:32:13.999666+0000","last_undegraded":"2024-09-05T17:32:13.999666+0000","last_fullsized":"2024-09-05T17:32:13.999666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"94'448","reported_seq":7727,"reported_epoch":95,"state":"active+remapped","last_fresh":"2024-09-05T17:32:14.298264+0000","last_change":"2024-09-05T17:32:14.298537+0000","last_active":"2024-09-05T17:32:14.298264+0000","last_peered":"2024-09-05T17:32:14.298264+0000","last_clean":"2024-09-05T17:32:09.937227+0000","last_became_active":"2024-09-05T17:32:12.884501+0000","last_became_peered":"2024-09-05T17:32:12.884501+0000","last_unstale":"2024-09-05T17:32:14.298264+0000","last_undegraded":"2024-09-05T17:32:14.298264+0000","last_fullsized":"2024-09-05T17:32:14.298264+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001490367,"stat_sum":{"num_bytes":38653440,"num_objects":51,"num_object_clones":12,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":8855,"num_read_kb":17049,"num_write":520,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[3,4],"avail_no_missing":["3","0","4"],"object_location_counts":[{"shards":"3,4","objects":51}],"blocked_by":[],"up_primary":0,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119308+0000","last_change":"2024-09-05T17:32:10.998471+0000","last_active":"2024-09-05T17:32:14.119308+0000","last_peered":"2024-09-05T17:32:14.119308+0000","last_clean":"2024-09-05T17:32:14.119308+0000","last_became_active":"2024-09-05T17:32:10.997586+0000","last_became_peered":"2024-09-05T17:32:10.997586+0000","last_unstale":"2024-09-05T17:32:14.119308+0000","last_undegraded":"2024-09-05T17:32:14.119308+0000","last_fullsized":"2024-09-05T17:32:14.119308+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:35:48.493112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"94'1539","reported_seq":4769,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.002148+0000","last_change":"2024-09-05T17:30:45.600843+0000","last_active":"2024-09-05T17:32:14.002148+0000","last_peered":"2024-09-05T17:32:14.002148+0000","last_clean":"2024-09-05T17:32:14.002148+0000","last_became_active":"2024-09-05T17:30:43.587691+0000","last_became_peered":"2024-09-05T17:30:43.587691+0000","last_unstale":"2024-09-05T17:32:14.002148+0000","last_undegraded":"2024-09-05T17:32:14.002148+0000","last_fullsized":"2024-09-05T17:32:14.002148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1539,"log_dups_size":0,"ondisk_log_size":1539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:40:19.654445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069190400000000002,"stat_sum":{"num_bytes":61193979,"num_objects":50,"num_object_clones":14,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":13,"num_read":10705,"num_read_kb":14686,"num_write":2708,"num_write_kb":6013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.005980+0000","last_change":"2024-09-05T17:30:34.067541+0000","last_active":"2024-09-05T17:32:14.005980+0000","last_peered":"2024-09-05T17:32:14.005980+0000","last_clean":"2024-09-05T17:32:14.005980+0000","last_became_active":"2024-09-05T17:30:32.044544+0000","last_became_peered":"2024-09-05T17:30:32.044544+0000","last_unstale":"2024-09-05T17:32:14.005980+0000","last_undegraded":"2024-09-05T17:32:14.005980+0000","last_fullsized":"2024-09-05T17:32:14.005980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:19:55.294419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090042900000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":281,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119478+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:32:14.119478+0000","last_peered":"2024-09-05T17:32:14.119478+0000","last_clean":"2024-09-05T17:32:14.119478+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:32:14.119478+0000","last_undegraded":"2024-09-05T17:32:14.119478+0000","last_fullsized":"2024-09-05T17:32:14.119478+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"94'286","reported_seq":2035,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.003890+0000","last_change":"2024-09-05T17:32:07.960003+0000","last_active":"2024-09-05T17:32:14.003890+0000","last_peered":"2024-09-05T17:32:14.003890+0000","last_clean":"2024-09-05T17:32:14.003890+0000","last_became_active":"2024-09-05T17:32:07.958644+0000","last_became_peered":"2024-09-05T17:32:07.958644+0000","last_unstale":"2024-09-05T17:32:14.003890+0000","last_undegraded":"2024-09-05T17:32:14.003890+0000","last_fullsized":"2024-09-05T17:32:14.003890+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:17:46.304971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097333599999999999,"stat_sum":{"num_bytes":75019042,"num_objects":50,"num_object_clones":13,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":12,"num_read":1545,"num_read_kb":11494,"num_write":315,"num_write_kb":15948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":93,"num_bytes_recovered":4647101,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"93'501","reported_seq":3788,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.001405+0000","last_change":"2024-09-05T17:30:45.577452+0000","last_active":"2024-09-05T17:32:14.001405+0000","last_peered":"2024-09-05T17:32:14.001405+0000","last_clean":"2024-09-05T17:32:14.001405+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:32:14.001405+0000","last_undegraded":"2024-09-05T17:32:14.001405+0000","last_fullsized":"2024-09-05T17:32:14.001405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:20:21.767348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00119338,"stat_sum":{"num_bytes":29112212,"num_objects":48,"num_object_clones":10,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":6,"num_read":5604,"num_read_kb":13067,"num_write":686,"num_write_kb":3603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"94'351","reported_seq":3303,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.000143+0000","last_change":"2024-09-05T17:30:45.806921+0000","last_active":"2024-09-05T17:32:14.000143+0000","last_peered":"2024-09-05T17:32:14.000143+0000","last_clean":"2024-09-05T17:32:14.000143+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:32:14.000143+0000","last_undegraded":"2024-09-05T17:32:14.000143+0000","last_fullsized":"2024-09-05T17:32:14.000143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:12:39.999450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092165900000000002,"stat_sum":{"num_bytes":26605449,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":7,"num_read":3162,"num_read_kb":12349,"num_write":391,"num_write_kb":3197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"94'897","reported_seq":9969,"reported_epoch":95,"state":"active+recovering+undersized+remapped","last_fresh":"2024-09-05T17:32:14.850731+0000","last_change":"2024-09-05T17:32:14.834302+0000","last_active":"2024-09-05T17:32:14.850731+0000","last_peered":"2024-09-05T17:32:14.850731+0000","last_clean":"2024-09-05T17:32:09.781830+0000","last_became_active":"2024-09-05T17:32:12.893946+0000","last_became_peered":"2024-09-05T17:32:12.893946+0000","last_unstale":"2024-09-05T17:32:14.850731+0000","last_undegraded":"2024-09-05T17:32:14.850731+0000","last_fullsized":"2024-09-05T17:32:11.998424+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":897,"log_dups_size":0,"ondisk_log_size":897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001053415,"stat_sum":{"num_bytes":66367555,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":50,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":8,"num_read":12878,"num_read_kb":27497,"num_write":1334,"num_write_kb":8949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":77,"num_bytes_recovered":3062528,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3],"avail_no_missing":["3","4"],"object_location_counts":[{"shards":"3","objects":3},{"shards":"3,4","objects":50}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"90'257","reported_seq":960,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.006303+0000","last_change":"2024-09-05T17:30:45.586557+0000","last_active":"2024-09-05T17:32:14.006303+0000","last_peered":"2024-09-05T17:32:14.006303+0000","last_clean":"2024-09-05T17:32:14.006303+0000","last_became_active":"2024-09-05T17:30:43.586452+0000","last_became_peered":"2024-09-05T17:30:43.586452+0000","last_unstale":"2024-09-05T17:32:14.006303+0000","last_undegraded":"2024-09-05T17:32:14.006303+0000","last_fullsized":"2024-09-05T17:32:14.006303+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:17:12.741212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012305,"stat_sum":{"num_bytes":24720746,"num_objects":36,"num_object_clones":10,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":11,"num_read":575,"num_read_kb":8041,"num_write":246,"num_write_kb":2467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"94'271","reported_seq":661,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119756+0000","last_change":"2024-09-05T17:30:46.333102+0000","last_active":"2024-09-05T17:32:14.119756+0000","last_peered":"2024-09-05T17:32:14.119756+0000","last_clean":"2024-09-05T17:32:14.119756+0000","last_became_active":"2024-09-05T17:30:43.600919+0000","last_became_peered":"2024-09-05T17:30:43.600919+0000","last_unstale":"2024-09-05T17:32:14.119756+0000","last_undegraded":"2024-09-05T17:32:14.119756+0000","last_fullsized":"2024-09-05T17:32:14.119756+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:16:58.355206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002229342,"stat_sum":{"num_bytes":49935391,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":7,"num_read":279,"num_read_kb":4957,"num_write":296,"num_write_kb":3185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"94'172","reported_seq":915,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119830+0000","last_change":"2024-09-05T17:30:46.333307+0000","last_active":"2024-09-05T17:32:14.119830+0000","last_peered":"2024-09-05T17:32:14.119830+0000","last_clean":"2024-09-05T17:32:14.119830+0000","last_became_active":"2024-09-05T17:30:43.600952+0000","last_became_peered":"2024-09-05T17:30:43.600952+0000","last_unstale":"2024-09-05T17:32:14.119830+0000","last_undegraded":"2024-09-05T17:32:14.119830+0000","last_fullsized":"2024-09-05T17:32:14.119830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:08:49.150649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019952949999999998,"stat_sum":{"num_bytes":38726870,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":7,"num_read":633,"num_read_kb":11414,"num_write":204,"num_write_kb":13961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"90'364","reported_seq":3953,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119980+0000","last_change":"2024-09-05T17:30:46.332586+0000","last_active":"2024-09-05T17:32:14.119980+0000","last_peered":"2024-09-05T17:32:14.119980+0000","last_clean":"2024-09-05T17:32:14.119980+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:32:14.119980+0000","last_undegraded":"2024-09-05T17:32:14.119980+0000","last_fullsized":"2024-09-05T17:32:14.119980+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:51:57.618420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001698326,"stat_sum":{"num_bytes":22679763,"num_objects":49,"num_object_clones":12,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":9,"num_read":4392,"num_read_kb":10956,"num_write":437,"num_write_kb":4751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"94'461","reported_seq":3652,"reported_epoch":94,"state":"peering","last_fresh":"2024-09-05T17:32:13.996801+0000","last_change":"2024-09-05T17:32:14.002041+0000","last_active":"2024-09-05T17:32:14.002041+0000","last_peered":"2024-09-05T17:32:13.996801+0000","last_clean":"2024-09-05T17:32:09.514281+0000","last_became_active":"2024-09-05T17:32:12.884014+0000","last_became_peered":"2024-09-05T17:32:12.884014+0000","last_unstale":"2024-09-05T17:32:13.996801+0000","last_undegraded":"2024-09-05T17:32:13.996801+0000","last_fullsized":"2024-09-05T17:32:11.997072+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000919516,"stat_sum":{"num_bytes":29448879,"num_objects":41,"num_object_clones":10,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":8,"num_read":3922,"num_read_kb":9489,"num_write":606,"num_write_kb":3412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":2696193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"93'250","reported_seq":838,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119394+0000","last_change":"2024-09-05T17:30:46.332397+0000","last_active":"2024-09-05T17:32:14.119394+0000","last_peered":"2024-09-05T17:32:14.119394+0000","last_clean":"2024-09-05T17:32:14.119394+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:32:14.119394+0000","last_undegraded":"2024-09-05T17:32:14.119394+0000","last_fullsized":"2024-09-05T17:32:14.119394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:37:07.343596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015389449999999999,"stat_sum":{"num_bytes":26542029,"num_objects":47,"num_object_clones":8,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":7,"num_read":482,"num_read_kb":4833,"num_write":254,"num_write_kb":2365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"94'481","reported_seq":8253,"reported_epoch":95,"state":"active+remapped","last_fresh":"2024-09-05T17:32:14.832179+0000","last_change":"2024-09-05T17:32:14.832179+0000","last_active":"2024-09-05T17:32:14.832179+0000","last_peered":"2024-09-05T17:32:14.832179+0000","last_clean":"2024-09-05T17:32:09.898663+0000","last_became_active":"2024-09-05T17:32:12.888399+0000","last_became_peered":"2024-09-05T17:32:12.888399+0000","last_unstale":"2024-09-05T17:32:14.832179+0000","last_undegraded":"2024-09-05T17:32:14.832179+0000","last_fullsized":"2024-09-05T17:32:14.832179+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001164483,"stat_sum":{"num_bytes":73716432,"num_objects":57,"num_object_clones":18,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":15,"num_read":8962,"num_read_kb":19904,"num_write":538,"num_write_kb":8740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[3,7],"avail_no_missing":["3","0","7"],"object_location_counts":[{"shards":"3,7","objects":57}],"blocked_by":[],"up_primary":0,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"90'563","reported_seq":1925,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-05T17:32:14.119494+0000","last_change":"2024-09-05T17:30:46.331733+0000","last_active":"2024-09-05T17:32:14.119494+0000","last_peered":"2024-09-05T17:32:14.119494+0000","last_clean":"2024-09-05T17:32:14.119494+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:32:14.119494+0000","last_undegraded":"2024-09-05T17:32:14.119494+0000","last_fullsized":"2024-09-05T17:32:14.119494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:54:04.344202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099853899999999989,"stat_sum":{"num_bytes":22006375,"num_objects":50,"num_object_clones":10,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":9,"num_read":4355,"num_read_kb":8444,"num_write":713,"num_write_kb":5190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1114599709,"num_objects":1411,"num_object_clones":332,"num_object_copies":2822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":50,"num_objects_unfound":0,"num_objects_dirty":1411,"num_whiteouts":271,"num_read":136360,"num_read_kb":385925,"num_write":18761,"num_write_kb":183017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1657,"num_bytes_recovered":54596346,"num_keys_recovered":168,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":39333888,"data_stored":286444063,"data_compressed":11043612,"data_compressed_allocated":25030656,"data_compressed_original":277947293,"omap_allocated":0,"internal_metadata":0},"log_size":14441,"ondisk_log_size":14441,"up":64,"acting":61,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39004,"kb_used_data":7820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332836,"statfs":{"total":96636764160,"available":96596824064,"internally_reserved":0,"allocated":8007680,"data_stored":52100988,"data_compressed":1787868,"data_compressed_allocated":4448256,"data_compressed_original":50165407,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42412,"kb_used_data":2900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329428,"statfs":{"total":96636764160,"available":96593334272,"internally_reserved":0,"allocated":2969600,"data_stored":10921890,"data_compressed":476997,"data_compressed_allocated":1015808,"data_compressed_original":9916416,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":6836,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":7000064,"data_stored":44241445,"data_compressed":1767249,"data_compressed_allocated":3899392,"data_compressed_original":42524231,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44148,"kb_used_data":8796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327692,"statfs":{"total":96636764160,"available":96591556608,"internally_reserved":0,"allocated":9007104,"data_stored":59641788,"data_compressed":2077133,"data_compressed_allocated":4804608,"data_compressed_original":57272730,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79988,"kb_used_data":8540,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94291852,"statfs":{"total":96636764160,"available":96554856448,"internally_reserved":0,"allocated":8744960,"data_stored":56168311,"data_compressed":2394426,"data_compressed_allocated":5234688,"data_compressed_original":54242321,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46808,"kb_used_data":3136,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94325032,"statfs":{"total":96636764160,"available":96588832768,"internally_reserved":0,"allocated":3211264,"data_stored":12787952,"data_compressed":625578,"data_compressed_allocated":1187840,"data_compressed_original":11720997,"omap_allocated":1594,"internal_metadata":44693958},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52664,"kb_used_data":3420,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319176,"statfs":{"total":96636764160,"available":96582836224,"internally_reserved":0,"allocated":3502080,"data_stored":19774113,"data_compressed":509853,"data_compressed_allocated":1400832,"data_compressed_original":18721144,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40952,"kb_used_data":5604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330888,"statfs":{"total":96636764160,"available":96594829312,"internally_reserved":0,"allocated":5738496,"data_stored":35912479,"data_compressed":1291172,"data_compressed_allocated":2973696,"data_compressed_original":34381824,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":34978740,"data_compressed":1346128,"data_compressed_allocated":3006464,"data_compressed_original":33935360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":19255759,"data_compressed":509853,"data_compressed_allocated":1400832,"data_compressed_original":18721144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2088960,"data_stored":12269617,"data_compressed":625578,"data_compressed_allocated":1187840,"data_compressed_original":11720997,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7622656,"data_stored":55649976,"data_compressed":2394426,"data_compressed_allocated":5234688,"data_compressed_original":54242321,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7884800,"data_stored":59123453,"data_compressed":2077133,"data_compressed_allocated":4804608,"data_compressed_original":57272730,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5873664,"data_stored":43676880,"data_compressed":1767128,"data_compressed_allocated":3895296,"data_compressed_original":42475079,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1847296,"data_stored":10403555,"data_compressed":476997,"data_compressed_allocated":1015808,"data_compressed_original":9916416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6946816,"data_stored":51086083,"data_compressed":1846369,"data_compressed_allocated":4485120,"data_compressed_original":49663246,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:32:15.927 INFO:tasks.thrashosds.thrasher:Setting 3.8 to [7, 4, 1, 6] 2024-09-05T17:32:15.927 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.8', '7', '4', '1', '6'] 2024-09-05T17:32:15.928 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.8 7 4 1 6 2024-09-05T17:32:15.947 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:15.947 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:15.947 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:15.947 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:15.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:16.008 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:32:16.039 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.040 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.049 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:16.049+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:16.057 INFO:teuthology.orchestra.run.smithi050.stdout:5141 write 0xc6d284a thru 0xc6df29b (0xca52 bytes) 2024-09-05T17:32:16.062 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.062 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.075 INFO:teuthology.orchestra.run.smithi050.stdout:5146 trunc from 0xc6df29c to 0x3dfe57f 2024-09-05T17:32:16.104 INFO:teuthology.orchestra.run.smithi050.stdout:5147 write 0x590d504 thru 0x591a18a (0xcc87 bytes) 2024-09-05T17:32:16.110 INFO:teuthology.orchestra.run.smithi050.stdout:5148 punch from 0x2fd5a2d to 0x2fdd606, (0x7bd9 bytes) 2024-09-05T17:32:16.110 INFO:teuthology.orchestra.run.smithi050.stdout:5149 read 0x19caa4c thru 0x19cf75b (0x4d10 bytes) 2024-09-05T17:32:16.110 INFO:teuthology.orchestra.run.smithi050.stdout:5151 read 0x52bddcf thru 0x52c95a5 (0xb7d7 bytes) 2024-09-05T17:32:16.111 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.111 INFO:teuthology.orchestra.run.smithi050.stdout:5155 read 0x454041c thru 0x454898e (0x8573 bytes) 2024-09-05T17:32:16.111 INFO:teuthology.orchestra.run.smithi050.stdout:5157 write 0x4a46ebc thru 0x4a497b3 (0x28f8 bytes) 2024-09-05T17:32:16.118 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:16.117+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:16.136 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:16.136 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:16.136 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:16.136 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:16.136 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:16.142 INFO:teuthology.orchestra.run.smithi050.stdout:5158 writesame 0xd3ab624 thru 0xd3ae392 data_size 0x1(0x2d6f bytes) 2024-09-05T17:32:16.151 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:16.155 INFO:teuthology.orchestra.run.smithi050.stdout:5160 write 0xdde2727 thru 0xddeb0a6 (0x8980 bytes) 2024-09-05T17:32:16.160 INFO:teuthology.orchestra.run.smithi050.stdout:5162 write 0x514b36d thru 0x515ae87 (0xfb1b bytes) 2024-09-05T17:32:16.165 INFO:teuthology.orchestra.run.smithi050.stdout:5163 read 0xa9feca4 thru 0xaa095ff (0xa95c bytes) 2024-09-05T17:32:16.165 INFO:teuthology.orchestra.run.smithi050.stdout:5165 write 0x41256c7 thru 0x412d6c2 (0x7ffc bytes) 2024-09-05T17:32:16.172 INFO:teuthology.orchestra.run.smithi050.stdout:5166 read 0x60fd5ce thru 0x6105660 (0x8093 bytes) 2024-09-05T17:32:16.172 INFO:teuthology.orchestra.run.smithi050.stdout:5167 read 0x4aa3042 thru 0x4aae9f6 (0xb9b5 bytes) 2024-09-05T17:32:16.172 INFO:teuthology.orchestra.run.smithi050.stdout:5171 read 0x77192f1 thru 0x77278da (0xe5ea bytes) 2024-09-05T17:32:16.172 INFO:teuthology.orchestra.run.smithi050.stdout:5174 read 0x7affa6f thru 0x7b0d3ad (0xd93f bytes) 2024-09-05T17:32:16.174 INFO:teuthology.orchestra.run.smithi050.stdout:5175 write 0xc7bbdea thru 0xc7c67ca (0xa9e1 bytes) 2024-09-05T17:32:16.199 INFO:teuthology.orchestra.run.smithi050.stdout:5177 trunc from 0xddeb0a7 to 0x479c145 2024-09-05T17:32:16.225 INFO:teuthology.orchestra.run.smithi050.stdout:5179 trunc from 0x479c145 to 0x13ca247 2024-09-05T17:32:16.237 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:16.237+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:16.242 INFO:teuthology.orchestra.run.smithi050.stdout:5180 write 0x9a3a9 thru 0xa3fd1 (0x9c29 bytes) 2024-09-05T17:32:16.245 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.265 INFO:teuthology.orchestra.run.smithi050.stdout:5183 write 0x682f505 thru 0x68381a6 (0x8ca2 bytes) 2024-09-05T17:32:16.271 INFO:teuthology.orchestra.run.smithi050.stdout:5184 read 0x3f0b925 thru 0x3f1b2cc (0xf9a8 bytes) 2024-09-05T17:32:16.278 INFO:teuthology.orchestra.run.smithi050.stdout:5185 trunc from 0x68381a7 to 0x30197f3 2024-09-05T17:32:16.301 INFO:teuthology.orchestra.run.smithi050.stdout:5188 punch from 0x2d3e9bb to 0x2d40157, (0x179c bytes) 2024-09-05T17:32:16.315 INFO:teuthology.orchestra.run.smithi050.stdout:5192 trunc from 0x30197f3 to 0xba190b4 2024-09-05T17:32:16.320 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:16.315+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:16.326 INFO:teuthology.orchestra.run.smithi050.stdout:5193 write 0x5b05bcb thru 0x5b08cf0 (0x3126 bytes) 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.626988114, 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:32:16.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:32:16.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.626940730000001, 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:32:16.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:32:16.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.626896058, 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:32:16.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.626850716000007, 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:32:16.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:16.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.626781706000003, 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:16.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:32:16.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.626733268999999, 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:16.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.626686910999993, 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:32:16.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:32:16.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:32:16.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:32:16.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.364 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.626024321000003, 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.365 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:32:16.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.625932974999998, 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:32:16.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:32:16.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.625871494999998, 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:32:16.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.625814594999994, 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.625721354000007, 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.385 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:32:16.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.625661825999998, 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:32:16.389 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:32:16.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.618505863999999, 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:32:16.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:32:16.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.618444397000005, 2024-09-05T17:32:16.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:32:16.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:32:16.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.616576428000002, 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:32:16.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:32:16.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.616535917999997, 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.408 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:32:16.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.616497452000004, 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:32:16.412 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:32:16.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.416 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.616439345000003, 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:32:16.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:16.421 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.616382044000005, 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:16.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:32:16.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.426 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.426 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.426 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:16.428 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:32:16.428 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:16.425+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:5194 write 0x4debf61 thru 0x4df23ae (0x644e bytes) 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:5195 punch from 0x7098af3 to 0x709a4c1, (0x19ce bytes) 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:5197 read 0x157a8a thru 0x15f792 (0x7d09 bytes) 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:5199 trunc from 0xba190b4 to 0x95ae6c8 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:5200 punch from 0x41c84e4 to 0x41d622f, (0xdd4b bytes) 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:5201 trunc from 0x95ae6c8 to 0x1b5892f 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.429 INFO:teuthology.orchestra.run.smithi050.stdout:5205 write 0x7e0d68a thru 0x7e17f39 (0xa8b0 bytes) 2024-09-05T17:32:16.436 INFO:teuthology.orchestra.run.smithi050.stdout:5206 write 0x59fbe9a thru 0x59fc2b5 (0x41c bytes) 2024-09-05T17:32:16.443 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.443 INFO:teuthology.orchestra.run.smithi050.stdout:5209 read 0x10b17c8 thru 0x10bc3c2 (0xabfb bytes) 2024-09-05T17:32:16.444 INFO:teuthology.orchestra.run.smithi050.stdout:5210 punch from 0x43e862f to 0x43f26d0, (0xa0a1 bytes) 2024-09-05T17:32:16.460 INFO:teuthology.orchestra.run.smithi050.stdout:5211 trunc from 0x7e17f3a to 0x1dea777 2024-09-05T17:32:16.508 INFO:teuthology.orchestra.run.smithi050.stdout:5212 write 0x55dcef1 thru 0x55e698b (0x9a9b bytes) 2024-09-05T17:32:16.527 INFO:teuthology.orchestra.run.smithi050.stdout:5213 trunc from 0x55e698c to 0x92e6d72 2024-09-05T17:32:16.528 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:16.525+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:16.541 INFO:teuthology.orchestra.run.smithi050.stdout:5215 read 0x7c529bd thru 0x7c5d819 (0xae5d bytes) 2024-09-05T17:32:16.541 INFO:teuthology.orchestra.run.smithi050.stdout:5216 punch from 0x883270f to 0x8840054, (0xd945 bytes) 2024-09-05T17:32:16.541 INFO:teuthology.orchestra.run.smithi050.stdout:5217 write 0xc5b701 thru 0xc5ccb8 (0x15b8 bytes) 2024-09-05T17:32:16.544 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.544 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.544 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:16.544 INFO:teuthology.orchestra.run.smithi050.stdout:5221 writesame 0x46a027a thru 0x46a2363 data_size 0xb(0x20ea bytes) 2024-09-05T17:32:16.552 INFO:teuthology.orchestra.run.smithi050.stdout:5222 read 0x40274c1 thru 0x4036927 (0xf467 bytes) 2024-09-05T17:32:16.567 INFO:teuthology.orchestra.run.smithi050.stdout:5223 write 0x999a67b thru 0x999da46 (0x33cc bytes) 2024-09-05T17:32:16.574 INFO:teuthology.orchestra.run.smithi050.stdout:5224 punch from 0x55832b6 to 0x5591003, (0xdd4d bytes) 2024-09-05T17:32:16.589 INFO:teuthology.orchestra.run.smithi050.stdout:5225 write 0xaaff339 thru 0xab08217 (0x8edf bytes) 2024-09-05T17:32:16.601 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:16.601 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:16.601 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:16.601 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:16.615 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:32:16.629 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:16.627+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:16.730 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:16.729+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:16.783 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:16.783 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:16.783 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:16.797 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:32:16.841 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:16.841+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:16.931 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:16.927+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.219174932999998, 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:32:16.964 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:32:16.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.219116739999997, 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.969 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.973 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.219055421999997, 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:32:16.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218988955, 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.978 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218912797999998, 2024-09-05T17:32:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:32:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218849831, 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:32:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:32:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218788099999998, 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:32:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:32:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218705073000002, 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:32:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218646399000001, 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218589452000003, 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:32:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:32:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218524977000001, 2024-09-05T17:32:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:32:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218454324, 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218377334000003, 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:32:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218318572999998, 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218255902000003, 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218193771000003, 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:32:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218074696000002, 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:32:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.218020244999998, 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:32:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.217857805000001, 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.216673417999999, 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:32:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:32:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:32:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.051 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:17.052 INFO:teuthology.orchestra.run.smithi050.stderr:set 3.8 pg_upmap_items mapping to [7->4,1->6] 2024-09-05T17:32:17.053 INFO:teuthology.orchestra.run.smithi050.stdout:5226 read 0x77740f5 thru 0x777526d (0x1179 bytes) 2024-09-05T17:32:17.053 INFO:teuthology.orchestra.run.smithi050.stdout:5227 read 0x819d00c thru 0x81a5956 (0x894b bytes) 2024-09-05T17:32:17.053 INFO:teuthology.orchestra.run.smithi050.stdout:5228 trunc from 0xab08218 to 0x258489 2024-09-05T17:32:17.054 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:17.055 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:17.047+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:17.153 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:17.153+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:17.174 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:17.174 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:17.188 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:17.254 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:17.251+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:17.355 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:17.351+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:17.356 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:17.357 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:17.357 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:17.357 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:17.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:17.455 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:17.451+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:17.497 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:17.497 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:17.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:17.497 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:17.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038980819999999, 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.498 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:32:17.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038932538000001, 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:32:17.502 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:32:17.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:32:17.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038886177999998, 2024-09-05T17:32:17.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:32:17.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:17.510 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038837576999999, 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038781977999999, 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:32:17.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038736734, 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:32:17.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:32:17.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038692234999999, 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:32:17.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:17.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038648278, 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:17.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.531 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038602941000001, 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:32:17.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:32:17.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:32:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038556492000001, 2024-09-05T17:32:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:32:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:17.542 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.03851293, 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:17.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038467555, 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:32:17.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:32:17.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038418444000001, 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:32:17.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038379509999999, 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:32:17.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:32:17.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.559 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038309848000001, 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038257297000001, 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:32:17.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038111741000002, 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:32:17.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.571 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.038060160000001, 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.572 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:32:17.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80382 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.037961112000001, 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049737581000000003, 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80382 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458150+0000", 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.23e-07 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458154+0000", 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3120000000000004e-06 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458168+0000", 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3947e-05 2024-09-05T17:32:17.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458179+0000", 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0906e-05 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507875+0000", 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049695744 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507887+0000", 2024-09-05T17:32:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1849e-05 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.806037788999999, 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:32:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:32:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:32:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:17.586 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:17.587 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:17.587 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:17.588 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:17.588 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:17.589 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:17.589 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:17.585+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:17.589 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:17.590 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:17.590 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:17.590 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:17.591 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:17.609 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:17.609 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:17.631 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:17.632 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:17.653 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:17.653 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:17.689 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:17.689+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:17.758 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:17.758 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:17.772 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:17.790 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:17.787+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:17.891 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:17.887+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:17.931 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:17.931 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:17.947 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:17.993 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:17.993+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:18.041 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:32:18.069 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:18.069 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:18.084 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:18.137 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:18.135+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:18.193 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:18.193+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:18.218 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:18.219 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:18.233 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:18.329 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:18.327+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:18.395 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:18.393+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:18.397 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:18.397 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:18.411 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:18.499 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:32:18.500 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:18.495+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:18.581 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:18.581 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:18.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:18.597 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:18.595+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:18.698 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:18.697+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:18.718 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:18.718 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:18.732 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:18.798 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:18.797+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:18.853 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:18.853 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:18.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:18.889 INFO:teuthology.orchestra.run.smithi050.stdout:5229 read 0x1629e6 thru 0x166478 (0x3a93 bytes) 2024-09-05T17:32:18.899 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:18.897+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:18.910 INFO:teuthology.orchestra.run.smithi050.stdout:5230 write 0x59a4bbe thru 0x59b2cfb (0xe13e bytes) 2024-09-05T17:32:18.934 INFO:teuthology.orchestra.run.smithi050.stdout:5231 writesame 0x8da326e thru 0x8da8aa7 data_size 0x17(0x583a bytes) 2024-09-05T17:32:18.934 INFO:teuthology.orchestra.run.smithi050.stdout:5232 writesame 0x5a1cd5 thru 0x5a2de7 data_size 0x1f(0x1113 bytes) 2024-09-05T17:32:18.938 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:18.938 INFO:teuthology.orchestra.run.smithi050.stdout:5234 punch from 0x6e36fb7 to 0x6e3e214, (0x725d bytes) 2024-09-05T17:32:18.938 INFO:teuthology.orchestra.run.smithi050.stdout:5235 write 0x51ecebb thru 0x51f5dc2 (0x8f08 bytes) 2024-09-05T17:32:18.941 INFO:teuthology.orchestra.run.smithi050.stdout:5237 trunc from 0x8da8aa8 to 0x90a87e7 2024-09-05T17:32:18.954 INFO:teuthology.orchestra.run.smithi050.stdout:5238 read 0x14271fb thru 0x142f2b2 (0x80b8 bytes) 2024-09-05T17:32:18.954 INFO:teuthology.orchestra.run.smithi050.stdout:5239 clone 32 order 22 su 262144 sc 14 2024-09-05T17:32:19.001 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:18.999+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:19.005 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:19.005 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:19.019 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:19.113 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:19.111+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:19.199 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:19.199 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:19.202 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:19.199+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:19.214 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:19.304 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:19.305+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:19.383 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:19.383 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:19.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:19.405 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:19.405+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:19.506 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:19.505+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:19.520 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:19.520 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:19.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:19.606 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:19.605+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:19.662 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:19.662 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:19.673 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:19.678 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:19.725 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:19.723+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:19.807 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:19.803+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:19.807 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-05T17:32:19.821 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:19.822 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:19.839 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:19.839 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:19.857 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:19.857 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:19.875 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:19.875 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:19.892 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:19.892 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:19.892 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:19.892 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:19.896 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:19.897 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:19.908 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:19.903+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:19.918 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:32:19.919 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:32:19.920 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:19.950 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:19.985 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:19.985 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:20.053 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:20.051+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:20.080 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:20.080 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:20.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:20.080 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:20.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.080 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.869357719000007, 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:20.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.868269221000006, 2024-09-05T17:32:20.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.086 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:20.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13402 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5761024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.867248709999998, 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14045227199999999, 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13402 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212315+0000", 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212892+0000", 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000576915 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212903+0000", 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1109e-05 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212922+0000", 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9083999999999999e-05 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.212933+0000", 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1445e-05 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352289+0000", 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139355966 2024-09-05T17:32:20.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352516+0000", 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000227288 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.352767+0000", 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025046500000000001 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13404 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5826560~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.866221761000006, 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140436747, 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13404 2024-09-05T17:32:20.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.096 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213342+0000", 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213908+0000", 2024-09-05T17:32:20.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056678399999999997 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213920+0000", 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1182000000000001e-05 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213953+0000", 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3680999999999998e-05 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.213965+0000", 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2065999999999999e-05 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353288+0000", 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13932244899999999 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353519+0000", 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000231487 2024-09-05T17:32:20.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.353778+0000", 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025909799999999998 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13408 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5859328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.863879163000007, 2024-09-05T17:32:20.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039104199999999, 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13408 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.215684+0000", 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216233+0000", 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054856700000000002 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216253+0000", 2024-09-05T17:32:20.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0100000000000001e-05 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216275+0000", 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2033999999999999e-05 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.216287+0000", 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2105e-05 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355590+0000", 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13930309799999999 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.355825+0000", 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023447 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.356075+0000", 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025066800000000001 2024-09-05T17:32:20.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13417 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6039552~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.858926990000001, 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14040323599999999, 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13417 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.220636+0000", 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221166+0000", 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052985200000000004 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221178+0000", 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2184999999999999e-05 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221199+0000", 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0197999999999999e-05 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221210+0000", 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1664e-05 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360548+0000", 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139337349 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.360777+0000", 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022910199999999999 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361040+0000", 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026288599999999999 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.109 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.857927007000001, 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:20.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:20.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.857321608000007, 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.114 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:20.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:20.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.118 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.856262479999998, 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.119 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:20.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:20.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13423 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6121472~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.855621197000005, 2024-09-05T17:32:20.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041024499999999, 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13423 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223942+0000", 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224467+0000", 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052468000000000002 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224478+0000", 2024-09-05T17:32:20.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1158999999999999e-05 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224503+0000", 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5049999999999999e-05 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224515+0000", 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2118e-05 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363883+0000", 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139368244 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364105+0000", 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000221888 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364352+0000", 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024710599999999997 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13424 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6137856~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.855026303000002, 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140385485, 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.128 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13424 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.224537+0000", 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225084+0000", 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00054695000000000004 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225096+0000", 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1637999999999999e-05 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225116+0000", 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0241000000000002e-05 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225128+0000", 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1768e-05 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364442+0000", 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13931406399999999 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364675+0000", 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023328199999999999 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.364922+0000", 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024754200000000001 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.132 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.853961108999997, 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.136 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13427 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6187008~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.853320418999999, 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14039622600000001, 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13427 2024-09-05T17:32:20.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226243+0000", 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226627+0000", 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038434899999999998 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226639+0000", 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1749000000000001e-05 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226659+0000", 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0494000000000001e-05 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226671+0000", 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1898e-05 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366166+0000", 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13949491999999999 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366383+0000", 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000217023 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366639+0000", 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025579299999999998 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.852869718999997, 2024-09-05T17:32:20.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:20.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:20.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13429 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6219776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.852223976000005, 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14041244999999999, 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13429 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227339+0000", 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227645+0000", 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030548800000000003 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227657+0000", 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1924e-05 2024-09-05T17:32:20.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227677+0000", 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0171000000000001e-05 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227689+0000", 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2021999999999999e-05 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367420+0000", 2024-09-05T17:32:20.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13973153399999999 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367602+0000", 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018142399999999999 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367752+0000", 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000149887 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.851851957999997, 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:20.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:20.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13431 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6252544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.851210903999998, 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14043087200000001, 2024-09-05T17:32:20.155 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13431 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228352+0000", 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228874+0000", 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00052197699999999997 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228886+0000", 2024-09-05T17:32:20.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1585e-05 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228906+0000", 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0397000000000001e-05 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228918+0000", 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1795e-05 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368460+0000", 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139541795 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368632+0000", 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017221000000000001 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368783+0000", 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000151113 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13432 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6268928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.850612374999997, 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140409387, 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13432 2024-09-05T17:32:20.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228951+0000", 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229505+0000", 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00055411600000000001 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229516+0000", 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0954999999999999e-05 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229537+0000", 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0537e-05 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.229548+0000", 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1792e-05 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368881+0000", 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139332448 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369106+0000", 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000225231 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.369360+0000", 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025430800000000002 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.075998344, 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:32:20.164 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:32:20.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.170 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.4835673740000002, 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.171 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:32:20.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:32:20.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:20.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:20.177 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:20.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:20.179 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:20.177+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:20.280 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:20.277+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:20.312 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:20.312 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:20.312 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:20.312 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:20.325 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:20.413 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:20.413+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:20.481 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:20.481+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:20.489 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:20.490 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:20.490 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:20.490 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:20.490 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:20.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:20.527 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:32:20.582 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:20.579+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.966207894999997, 2024-09-05T17:32:20.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:20.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.675 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.966160510999998, 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:32:20.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.680 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.966115838999997, 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.681 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:32:20.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.966070497000004, 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.686 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:32:20.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:32:20.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:32:20.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:32:20.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.690 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.966001487, 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:32:20.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.695 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.965953049999996, 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:32:20.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:32:20.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.700 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.700 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.700 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:20.700 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.965906692000004, 2024-09-05T17:32:20.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:32:20.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.965244102, 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.705 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:32:20.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.965152755999995, 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:32:20.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.965091275999995, 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:32:20.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:32:20.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:20.719 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.965034376000006, 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:20.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:32:20.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.964941135000004, 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:32:20.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:20.728 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.964881606999995, 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:32:20.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.957725644999996, 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:20.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:32:20.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.957664178000002, 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:20.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:32:20.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:20.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.955796208999999, 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:20.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:32:20.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.747 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.747 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:20.747 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.955755698999994, 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:32:20.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:32:20.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.955717233000001, 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:32:20.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:32:20.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.955659126, 2024-09-05T17:32:20.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:32:20.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.955601825000002, 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:20.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:20.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:20.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:32:20.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.769 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:20.769 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:20.769 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:20.771 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:32:20.771 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:20.769+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:20.871 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:20.867+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:20.878 INFO:teuthology.orchestra.run.smithi050.stdout:5240 read 0xea7de5 thru 0xeb3eff (0xc11b bytes) 2024-09-05T17:32:20.881 INFO:teuthology.orchestra.run.smithi050.stdout:5241 punch from 0x3b98079 to 0x3ba2aa4, (0xaa2b bytes) 2024-09-05T17:32:20.894 INFO:teuthology.orchestra.run.smithi050.stdout:5243 trunc from 0x90a87e7 to 0x625208c 2024-09-05T17:32:20.937 INFO:teuthology.orchestra.run.smithi050.stdout:5244 write 0xe2ecbe thru 0xe383b3 (0x96f6 bytes) 2024-09-05T17:32:20.948 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:20.948 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:20.948 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:20.962 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:32:20.970 INFO:teuthology.orchestra.run.smithi050.stdout:5245 writesame 0xe6ad8ce thru 0xe6b2bbd data_size 0x8(0x52f0 bytes) 2024-09-05T17:32:20.970 INFO:teuthology.orchestra.run.smithi050.stdout:5246 punch from 0x2de3c66 to 0x2de97e3, (0x5b7d bytes) 2024-09-05T17:32:20.971 INFO:teuthology.orchestra.run.smithi050.stdout:5247 read 0xe299665 thru 0xe29c7c2 (0x315e bytes) 2024-09-05T17:32:20.971 INFO:teuthology.orchestra.run.smithi050.stdout:5249 writesame 0x2486362 thru 0x2486e69 data_size 0x8(0xb08 bytes) 2024-09-05T17:32:20.978 INFO:teuthology.orchestra.run.smithi050.stdout:5250 writesame 0xc29e002 thru 0xc2a1fe2 data_size 0x17(0x3fe1 bytes) 2024-09-05T17:32:20.985 INFO:teuthology.orchestra.run.smithi050.stdout:5251 read 0x31b55d0 thru 0x31bdd94 (0x87c5 bytes) 2024-09-05T17:32:20.985 INFO:teuthology.orchestra.run.smithi050.stdout:5252 writesame 0xaef874c thru 0xaf01830 data_size 0x7(0x90e5 bytes) 2024-09-05T17:32:20.995 INFO:teuthology.orchestra.run.smithi050.stdout:5253 writesame 0xdc72aec thru 0xdc7e248 data_size 0x1(0xb75d bytes) 2024-09-05T17:32:21.009 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:21.009+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:21.024 INFO:teuthology.orchestra.run.smithi050.stdout:5254 writesame 0x5fd218c thru 0x5fd9df2 data_size 0x1(0x7c67 bytes) 2024-09-05T17:32:21.039 INFO:teuthology.orchestra.run.smithi050.stdout:5257 punch from 0x349f347 to 0x34a1211, (0x1eca bytes) 2024-09-05T17:32:21.040 INFO:teuthology.orchestra.run.smithi050.stdout:5258 punch from 0xa2d3429 to 0xa2d5fb6, (0x2b8d bytes) 2024-09-05T17:32:21.040 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:21.040 INFO:teuthology.orchestra.run.smithi050.stdout:5261 clone 33 order 19 su 16384 sc 8 2024-09-05T17:32:21.073 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:21.069+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:21.086 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:21.086 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:21.086 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:21.086 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:21.086 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:21.101 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:32:21.174 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:21.175+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:21.271 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:21.271 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:21.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:21.271 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:21.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.271 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38643 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 36864~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.271 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:21.271 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.526040731999998, 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383291999999997, 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38643 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.272 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743576+0000", 2024-09-05T17:32:21.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743577+0000", 2024-09-05T17:32:21.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2860000000000001e-06 2024-09-05T17:32:21.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743583+0000", 2024-09-05T17:32:21.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0260000000000004e-06 2024-09-05T17:32:21.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743602+0000", 2024-09-05T17:32:21.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8253e-05 2024-09-05T17:32:21.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743616+0000", 2024-09-05T17:32:21.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4436e-05 2024-09-05T17:32:21.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809767+0000", 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066151142999999996 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809859+0000", 2024-09-05T17:32:21.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1978000000000006e-05 2024-09-05T17:32:21.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809959+0000", 2024-09-05T17:32:21.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010017 2024-09-05T17:32:21.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.278 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38644 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:21.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525982538999997, 2024-09-05T17:32:21.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066555548000000006, 2024-09-05T17:32:21.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38644 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:21.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743634+0000", 2024-09-05T17:32:21.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743635+0000", 2024-09-05T17:32:21.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.254e-06 2024-09-05T17:32:21.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743645+0000", 2024-09-05T17:32:21.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000002e-06 2024-09-05T17:32:21.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743663+0000", 2024-09-05T17:32:21.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8002000000000001e-05 2024-09-05T17:32:21.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743676+0000", 2024-09-05T17:32:21.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3723000000000001e-05 2024-09-05T17:32:21.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.809998+0000", 2024-09-05T17:32:21.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066321269000000002 2024-09-05T17:32:21.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:21.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810085+0000", 2024-09-05T17:32:21.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7003999999999996e-05 2024-09-05T17:32:21.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810190+0000", 2024-09-05T17:32:21.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105116 2024-09-05T17:32:21.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.287 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.288 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38645 3.1c 3:39132cc7:::rbd_data.11404462ede9.0000000000000000:b [read 65536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.288 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:21.288 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525921221000004, 2024-09-05T17:32:21.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066726186000000007, 2024-09-05T17:32:21.289 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.289 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.289 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:21.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.289 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.290 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38645 2024-09-05T17:32:21.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.290 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:21.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743695+0000", 2024-09-05T17:32:21.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743697+0000", 2024-09-05T17:32:21.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0839999999999999e-06 2024-09-05T17:32:21.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743703+0000", 2024-09-05T17:32:21.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9789999999999998e-06 2024-09-05T17:32:21.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743727+0000", 2024-09-05T17:32:21.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4868999999999999e-05 2024-09-05T17:32:21.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743741+0000", 2024-09-05T17:32:21.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4086e-05 2024-09-05T17:32:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810226+0000", 2024-09-05T17:32:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.06648424 2024-09-05T17:32:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810310+0000", 2024-09-05T17:32:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4382999999999995e-05 2024-09-05T17:32:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810422+0000", 2024-09-05T17:32:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111545 2024-09-05T17:32:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38646 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525854753999994, 2024-09-05T17:32:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066699391999999996, 2024-09-05T17:32:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38646 2024-09-05T17:32:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743762+0000", 2024-09-05T17:32:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743763+0000", 2024-09-05T17:32:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1799999999999999e-06 2024-09-05T17:32:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743771+0000", 2024-09-05T17:32:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5299999999999999e-06 2024-09-05T17:32:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743793+0000", 2024-09-05T17:32:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2429000000000002e-05 2024-09-05T17:32:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743813+0000", 2024-09-05T17:32:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9432999999999998e-05 2024-09-05T17:32:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810453+0000", 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066640851000000001 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810461+0000", 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9689999999999994e-06 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38647 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525778596999999, 2024-09-05T17:32:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066658068000000001, 2024-09-05T17:32:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38647 2024-09-05T17:32:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743838+0000", 2024-09-05T17:32:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743839+0000", 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743845+0000", 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1460000000000001e-06 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743864+0000", 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536e-05 2024-09-05T17:32:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743879+0000", 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5432999999999999e-05 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810488+0000", 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066608765 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810496+0000", 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1310000000000006e-06 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38648 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525715629999993, 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066628316000000007, 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38648 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743901+0000", 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743902+0000", 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-06 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743908+0000", 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743927+0000", 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8872000000000002e-05 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743942+0000", 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4533e-05 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810521+0000", 2024-09-05T17:32:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066579653000000003 2024-09-05T17:32:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810529+0000", 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1410000000000005e-06 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38649 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525653899000005, 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066599146999999997, 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38649 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743963+0000", 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743964+0000", 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1969999999999999e-06 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.743970+0000", 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7289999999999997e-06 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744002+0000", 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2228999999999999e-05 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744024+0000", 2024-09-05T17:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2535999999999999e-05 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810554+0000", 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066529584000000003 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810562+0000", 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8720000000000002e-06 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38650 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525570872000003, 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066558451000000005, 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38650 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744046+0000", 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744047+0000", 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744054+0000", 2024-09-05T17:32:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5429999999999999e-06 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744072+0000", 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8422000000000001e-05 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744086+0000", 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4236000000000001e-05 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810587+0000", 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066500248999999997 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810604+0000", 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7680999999999999e-05 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38651 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525512198000001, 2024-09-05T17:32:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066539669999999995, 2024-09-05T17:32:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38651 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744104+0000", 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744106+0000", 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5430000000000001e-06 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744112+0000", 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4700000000000001e-06 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744129+0000", 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7212999999999999e-05 2024-09-05T17:32:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744143+0000", 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3899e-05 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810636+0000", 2024-09-05T17:32:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066493390999999999 2024-09-05T17:32:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810644+0000", 2024-09-05T17:32:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1540000000000002e-06 2024-09-05T17:32:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38652 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525455250999997, 2024-09-05T17:32:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066516697, 2024-09-05T17:32:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38652 2024-09-05T17:32:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744161+0000", 2024-09-05T17:32:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744163+0000", 2024-09-05T17:32:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1000000000000001e-06 2024-09-05T17:32:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744169+0000", 2024-09-05T17:32:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3770000000000001e-06 2024-09-05T17:32:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744192+0000", 2024-09-05T17:32:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869000000000001e-05 2024-09-05T17:32:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744206+0000", 2024-09-05T17:32:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4382000000000001e-05 2024-09-05T17:32:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810670+0000", 2024-09-05T17:32:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066464071 2024-09-05T17:32:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810678+0000", 2024-09-05T17:32:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8979999999999996e-06 2024-09-05T17:32:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38653 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525390775999995, 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066485819000000002, 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38653 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744226+0000", 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744227+0000", 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744233+0000", 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3459999999999999e-06 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744252+0000", 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8612999999999999e-05 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744266+0000", 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4416000000000001e-05 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810704+0000", 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066437560000000007 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810712+0000", 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8310000000000001e-06 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38654 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525320123, 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066448517999999998, 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38654 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744297+0000", 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744298+0000", 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744319+0000", 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0979e-05 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744338+0000", 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9468999999999999e-05 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744353+0000", 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4612e-05 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810737+0000", 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066383849999999994 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810745+0000", 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240000000000003e-06 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38655 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525243133000004, 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066405256999999995, 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38655 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744374+0000", 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744375+0000", 2024-09-05T17:32:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744381+0000", 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2339999999999999e-06 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744399+0000", 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822e-05 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744413+0000", 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.434e-05 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810771+0000", 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066357792999999998 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810779+0000", 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0150000000000003e-06 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38656 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525184371999998, 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066379056000000006, 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38656 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744432+0000", 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744433+0000", 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744439+0000", 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744461+0000", 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1535999999999998e-05 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744476+0000", 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5712000000000001e-05 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810804+0000", 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066327250000000004 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810811+0000", 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.661e-06 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38657 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525121701000003, 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066350514999999999, 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38657 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744495+0000", 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744496+0000", 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.026e-06 2024-09-05T17:32:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744503+0000", 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8040000000000004e-06 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744521+0000", 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8589000000000001e-05 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744535+0000", 2024-09-05T17:32:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3743e-05 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810838+0000", 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066302362000000004 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810846+0000", 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9910000000000002e-06 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38658 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.525059569999996, 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066320688000000003, 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38658 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744557+0000", 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744558+0000", 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744564+0000", 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4620000000000004e-06 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744587+0000", 2024-09-05T17:32:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3028999999999999e-05 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744600+0000", 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.343e-05 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810870+0000", 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066269932000000004 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.810878+0000", 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7079999999999997e-06 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38660 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.524940494999996, 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066349088000000001, 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38660 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744676+0000", 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744677+0000", 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744683+0000", 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6289999999999998e-06 2024-09-05T17:32:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744700+0000", 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7090000000000001e-05 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744713+0000", 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2928999999999999e-05 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811014+0000", 2024-09-05T17:32:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066301106999999998 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811025+0000", 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1195999999999999e-05 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38661 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.524886043999999, 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066331721999999996, 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38661 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744731+0000", 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744732+0000", 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.063e-06 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744737+0000", 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0860000000000001e-06 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744754+0000", 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744767+0000", 2024-09-05T17:32:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3125999999999999e-05 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811054+0000", 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066286707 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811062+0000", 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6170000000000007e-06 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38663 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.524723604000002, 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066324392999999995, 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38663 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744893+0000", 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744894+0000", 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.333e-06 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744901+0000", 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4590000000000003e-06 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744921+0000", 2024-09-05T17:32:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0556000000000001e-05 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.744936+0000", 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4713e-05 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811203+0000", 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.066266449000000005 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811217+0000", 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4883e-05 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:38771 3.1c 3.e334c89c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e43)", 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.523539217000007, 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067575886000000002, 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 38771 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746077+0000", 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746079+0000", 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1930000000000001e-06 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746105+0000", 2024-09-05T17:32:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6556000000000001e-05 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746126+0000", 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0395e-05 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.746140+0000", 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.811744+0000", 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.065603825000000004 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:13.813653+0000", 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019091170000000001 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.385 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:21.387 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:21.387 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:21.387+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:21.488 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:21.485+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:21.513 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:21.514 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:21.528 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:32:21.529 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:21.597 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:21.595+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:21.625 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone32 from 0xe6b2bbe (overlap 0x625208c) to 0x1d7f02a 2024-09-05T17:32:21.689 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:21.689+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:21.711 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:21.711 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:21.711 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:21.711 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:21.711 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:21.725 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:21.790 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:21.787+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:21.802 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-05T17:32:21.891 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:21.887+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:21.900 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.442118481000001, 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:32:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.442070199, 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:32:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:32:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.442023839000001, 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441975238000001, 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:32:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441919638999998, 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:32:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441874394999999, 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:32:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441829896000002, 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:32:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:32:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441785938999999, 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:32:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441740601999999, 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:32:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441694153, 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:32:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:32:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441650590999998, 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:32:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441605215999999, 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441556105, 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:32:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:32:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441517171000001, 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441447509, 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:32:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:32:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441394958, 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:32:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:32:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441249402, 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:32:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441197820999999, 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:32:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80382 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.441098773, 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049737581000000003, 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80382 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458150+0000", 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.23e-07 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458154+0000", 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3120000000000004e-06 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458168+0000", 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3947e-05 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458179+0000", 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0906e-05 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507875+0000", 2024-09-05T17:32:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049695744 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507887+0000", 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1849e-05 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.20917545, 2024-09-05T17:32:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:32:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:21.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:21.990 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:21.992 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:21.992 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:21.989+0000 7fd30b967640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26467) UID: 0 2024-09-05T17:32:22.007 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:22.056 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:32:22.056 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:32:22.056 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-05T17:32:22.056 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-05T17:32:22.056 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:32:22.093 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:22.091+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:22.165 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:22.166 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:22.168 INFO:teuthology.orchestra.run.smithi050.stdout:5262 write 0x4be0316 thru 0x4beadae (0xaa99 bytes) 2024-09-05T17:32:22.171 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:22.171 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:22.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:22.188 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:22.188 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:22.205 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:22.205 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:22.223 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:22.223 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:22.225 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:22.225+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:22.242 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:22.242 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:22.295 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:22.291+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:22.348 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:22.349 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:22.349 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:22.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:22.409 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:22.409+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:22.489 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:32:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 115.470676625, 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:32:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:32:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:32:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103685261999999, 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:32:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103634346, 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:32:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.1035845, 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:32:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:32:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103539192, 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103491175999999, 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:32:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103418044000001, 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:32:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:32:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103369017999999, 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103284000999999, 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:32:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:32:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103228279, 2024-09-05T17:32:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:32:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103165421, 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:32:22.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.542 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.103018848000001, 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:32:22.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:32:22.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92453 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12443648~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391359+0000", 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.096168485, 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109392684, 2024-09-05T17:32:22.547 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92453 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391359+0000", 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391359+0000", 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391360+0000", 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:32:22.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391362+0000", 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5189999999999999e-06 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391369+0000", 2024-09-05T17:32:22.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8580000000000002e-06 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391375+0000", 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6470000000000003e-06 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.500642+0000", 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10926704199999999 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.500688+0000", 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6326000000000003e-05 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.500752+0000", 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3721999999999997e-05 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92455 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12470272~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391382+0000", 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.096145382, 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109659538, 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92455 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.553 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391382+0000", 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391382+0000", 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391383+0000", 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0999999999999999e-07 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391385+0000", 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1380000000000001e-06 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391396+0000", 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0702e-05 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391404+0000", 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6449999999999994e-06 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.500796+0000", 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109391581 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.500921+0000", 2024-09-05T17:32:22.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124762 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501042+0000", 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012120000000000001 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:22.557 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.096115616999999, 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:32:22.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:32:22.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.096093823, 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.562 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:32:22.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:32:22.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.09605036, 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:32:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:32:22.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.096013688999999, 2024-09-05T17:32:22.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:32:22.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:32:22.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.095973382, 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:22.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.095934675999999, 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:22.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:22.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:22.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:22.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:22.585 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:22.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:22.587 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:22.583+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:22.688 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:22.683+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:22.722 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:22.722 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:22.737 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:22.788 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:22.785+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:22.889 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:22.889+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:22.910 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:22.910 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:22.924 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:22.989 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:22.987+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:23.051 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:23.052 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:23.066 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:23.109 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:23.107+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:23.191 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:23.189+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:23.230 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:23.230 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:23.245 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:23.292 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:23.287+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:23.366 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:23.367 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:23.381 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:23.393 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:23.393+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:23.494 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:23.491+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:23.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:32:23.562 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:23.562 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:23.582 INFO:teuthology.orchestra.run.smithi050.stdout:5263 punch from 0x8e06ed6 to 0x8e099eb, (0x2b15 bytes) 2024-09-05T17:32:23.583 INFO:teuthology.orchestra.run.smithi050.stdout:5264 flatten 2024-09-05T17:32:23.587 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:23.594 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:23.593+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:23.697 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:23.695+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:23.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-05T17:32:23.798 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:23.795+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:23.822 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:23.822 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:23.851 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:23.901 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:23.895+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:24.000 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:23.997+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:24.053 INFO:teuthology.orchestra.run.smithi050.stdout:5266 write 0xea60aef thru 0xea64edc (0x43ee bytes) 2024-09-05T17:32:24.058 INFO:teuthology.orchestra.run.smithi050.stdout:5267 read 0xbe5365f thru 0xbe539de (0x380 bytes) 2024-09-05T17:32:24.063 INFO:teuthology.orchestra.run.smithi050.stdout:5268 trunc from 0xea64edd to 0xa425232 2024-09-05T17:32:24.079 INFO:teuthology.orchestra.run.smithi050.stdout:5269 write 0x462c972 thru 0x463b1bd (0xe84c bytes) 2024-09-05T17:32:24.080 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:24.080 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:24.093 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:24.126 INFO:teuthology.orchestra.run.smithi050.stdout:5271 trunc from 0xa425232 to 0x81cd7b5 2024-09-05T17:32:24.126 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:24.123+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:24.138 INFO:teuthology.orchestra.run.smithi050.stdout:5272 writesame 0x190fbf6 thru 0x190fea3 data_size 0x7(0x2ae bytes) 2024-09-05T17:32:24.143 INFO:teuthology.orchestra.run.smithi050.stdout:5273 read 0x1ac7455 thru 0x1ad37ce (0xc37a bytes) 2024-09-05T17:32:24.144 INFO:teuthology.orchestra.run.smithi050.stdout:5274 write 0x804a16a thru 0x804b718 (0x15af bytes) 2024-09-05T17:32:24.149 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:24.149 INFO:teuthology.orchestra.run.smithi050.stdout:5276 read 0x66c7411 thru 0x66c9d6c (0x295c bytes) 2024-09-05T17:32:24.171 INFO:teuthology.orchestra.run.smithi050.stdout:5280 write 0xebe6416 thru 0xebed209 (0x6df4 bytes) 2024-09-05T17:32:24.201 INFO:teuthology.orchestra.run.smithi050.stdout:5282 trunc from 0xebed20a to 0x3c6271b 2024-09-05T17:32:24.201 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:24.199+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:24.218 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:24.219 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:24.232 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:24.253 INFO:teuthology.orchestra.run.smithi050.stdout:5285 write 0x92e89d3 thru 0x92ef82d (0x6e5b bytes) 2024-09-05T17:32:24.261 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:24.261 INFO:teuthology.orchestra.run.smithi050.stdout:5288 read 0x1781fad thru 0x178527d (0x32d1 bytes) 2024-09-05T17:32:24.261 INFO:teuthology.orchestra.run.smithi050.stdout:5289 punch from 0x73b853e to 0x73c47de, (0xc2a0 bytes) 2024-09-05T17:32:24.267 INFO:teuthology.orchestra.run.smithi050.stdout:5290 trunc from 0x92ef82e to 0x3f3a069 2024-09-05T17:32:24.284 INFO:teuthology.orchestra.run.smithi050.stdout:5293 trunc from 0x3f3a069 to 0x418f3ab 2024-09-05T17:32:24.300 INFO:teuthology.orchestra.run.smithi050.stdout:5294 trunc from 0x418f3ab to 0x265649 2024-09-05T17:32:24.302 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:24.299+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:24.324 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:24.324 INFO:teuthology.orchestra.run.smithi050.stdout:5296 punch from 0xe4583 to 0xecf12, (0x898f bytes) 2024-09-05T17:32:24.325 INFO:teuthology.orchestra.run.smithi050.stdout:5298 read 0x9f085 thru 0xab3f2 (0xc36e bytes) 2024-09-05T17:32:24.353 INFO:teuthology.orchestra.run.smithi050.stdout:5299 write 0xce8eb79 thru 0xce91a6c (0x2ef4 bytes) 2024-09-05T17:32:24.358 INFO:teuthology.orchestra.run.smithi050.stdout:5301 punch from 0x7979afc to 0x7984dcc, (0xb2d0 bytes) 2024-09-05T17:32:24.358 INFO:teuthology.orchestra.run.smithi050.stdout:5302 read 0x8fc080c thru 0x8fc4d82 (0x4577 bytes) 2024-09-05T17:32:24.359 INFO:teuthology.orchestra.run.smithi050.stdout:5303 punch from 0x342a2c2 to 0x3434df9, (0xab37 bytes) 2024-09-05T17:32:24.359 INFO:teuthology.orchestra.run.smithi050.stdout:5304 read 0xb3fd0f2 thru 0xb40c413 (0xf322 bytes) 2024-09-05T17:32:24.359 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:24.372 INFO:teuthology.orchestra.run.smithi050.stdout:5306 trunc from 0xce91a6d to 0x260f1d8 2024-09-05T17:32:24.388 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:24.389 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:24.391 INFO:teuthology.orchestra.run.smithi050.stdout:5307 punch from 0x2c8b1a to 0x2cdaae, (0x4f94 bytes) 2024-09-05T17:32:24.395 INFO:teuthology.orchestra.run.smithi050.stdout:5308 trunc from 0x260f1d8 to 0x54a9bec 2024-09-05T17:32:24.404 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:24.399+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:24.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:24.437 INFO:teuthology.orchestra.run.smithi050.stdout:5311 write 0xd015327 thru 0xd018564 (0x323e bytes) 2024-09-05T17:32:24.444 INFO:teuthology.orchestra.run.smithi050.stdout:5312 write 0xc9c5c12 thru 0xc9cd900 (0x7cef bytes) 2024-09-05T17:32:24.452 INFO:teuthology.orchestra.run.smithi050.stdout:5313 punch from 0x34c2b83 to 0x34c367d, (0xafa bytes) 2024-09-05T17:32:24.452 INFO:teuthology.orchestra.run.smithi050.stdout:5315 writesame 0x324d996 thru 0x325a2a4 data_size 0x85(0xc90f bytes) 2024-09-05T17:32:24.460 INFO:teuthology.orchestra.run.smithi050.stdout:5316 read 0xb2ef971 thru 0xb2f3013 (0x36a3 bytes) 2024-09-05T17:32:24.460 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:24.460 INFO:teuthology.orchestra.run.smithi050.stdout:5320 read 0x38d9488 thru 0x38e2b09 (0x9682 bytes) 2024-09-05T17:32:24.460 INFO:teuthology.orchestra.run.smithi050.stdout:5322 read 0x1f8950a thru 0x1f8ec32 (0x5729 bytes) 2024-09-05T17:32:24.460 INFO:teuthology.orchestra.run.smithi050.stdout:5325 write 0xc03145c thru 0xc033a52 (0x25f7 bytes) 2024-09-05T17:32:24.463 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:24.463 INFO:teuthology.orchestra.run.smithi050.stdout:5327 read 0x271c96e thru 0x271cad1 (0x164 bytes) 2024-09-05T17:32:24.463 INFO:teuthology.orchestra.run.smithi050.stdout:5328 read 0x42b4509 thru 0x42baf9e (0x6a96 bytes) 2024-09-05T17:32:24.471 INFO:teuthology.orchestra.run.smithi050.stdout:5330 trunc from 0xd018565 to 0x6ef3f5d 2024-09-05T17:32:24.489 INFO:teuthology.orchestra.run.smithi050.stdout:5331 write 0x2496128 thru 0x24a32a5 (0xd17e bytes) 2024-09-05T17:32:24.498 INFO:teuthology.orchestra.run.smithi050.stdout:5332 clone 34 order 24 su 4194304 sc 15 2024-09-05T17:32:24.505 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:24.503+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:24.545 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:32:24.571 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:24.571 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:24.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:24.606 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:24.605+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:24.706 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:24.703+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:24.742 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:24.742 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:24.755 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:24.796 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-05T17:32:24.807 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:24.803+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:24.870 INFO:teuthology.orchestra.run.smithi050.stdout:5333 read 0x61947fb thru 0x6195208 (0xa0e bytes) 2024-09-05T17:32:24.871 INFO:teuthology.orchestra.run.smithi050.stdout:5334 trunc from 0x6ef3f5d to 0x71bab65 2024-09-05T17:32:24.890 INFO:teuthology.orchestra.run.smithi050.stdout:5337 punch from 0x368a9c to 0x377f0b, (0xf46f bytes) 2024-09-05T17:32:24.895 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:24.895 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:24.897 INFO:teuthology.orchestra.run.smithi050.stdout:5338 trunc from 0x71bab65 to 0x2ff2099 2024-09-05T17:32:24.907 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:24.903+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:24.911 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:24.949 INFO:teuthology.orchestra.run.smithi050.stdout:5340 punch from 0x18bea4b to 0x18c6af5, (0x80aa bytes) 2024-09-05T17:32:24.949 INFO:teuthology.orchestra.run.smithi050.stdout:5341 write 0x14be30 thru 0x14ffcd (0x419e bytes) 2024-09-05T17:32:24.977 INFO:teuthology.orchestra.run.smithi050.stdout:5342 write 0x90dcf52 thru 0x90e1160 (0x420f bytes) 2024-09-05T17:32:24.980 INFO:teuthology.orchestra.run.smithi050.stdout:5347 punch from 0x800d719 to 0x801a309, (0xcbf0 bytes) 2024-09-05T17:32:25.000 INFO:teuthology.orchestra.run.smithi050.stdout:5349 write 0xd2385e8 thru 0xd23e1ca (0x5be3 bytes) 2024-09-05T17:32:25.003 INFO:teuthology.orchestra.run.smithi050.stdout:5351 write 0xb903d2b thru 0xb913d06 (0xffdc bytes) 2024-09-05T17:32:25.007 INFO:teuthology.orchestra.run.smithi050.stdout:5352 write 0x395280 thru 0x3a0eb4 (0xbc35 bytes) 2024-09-05T17:32:25.007 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:25.005+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:25.011 INFO:teuthology.orchestra.run.smithi050.stdout:5353 punch from 0xc6b944 to 0xc7029c, (0x4958 bytes) 2024-09-05T17:32:25.011 INFO:teuthology.orchestra.run.smithi050.stdout:5355 read 0x19de786 thru 0x19e9ec1 (0xb73c bytes) 2024-09-05T17:32:25.012 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.012 INFO:teuthology.orchestra.run.smithi050.stdout:5357 punch from 0x8082cdc to 0x8083f4c, (0x1270 bytes) 2024-09-05T17:32:25.012 INFO:teuthology.orchestra.run.smithi050.stdout:5360 write 0x819fc62 thru 0x81aeeca (0xf269 bytes) 2024-09-05T17:32:25.014 INFO:teuthology.orchestra.run.smithi050.stdout:5361 read 0x4626594 thru 0x4635a8d (0xf4fa bytes) 2024-09-05T17:32:25.020 INFO:teuthology.orchestra.run.smithi050.stdout:5362 trunc from 0xd23e1cb to 0xea51466 2024-09-05T17:32:25.030 INFO:teuthology.orchestra.run.smithi050.stdout:5363 writesame 0xd1ee950 thru 0xd1f254c data_size 0x1(0x3bfd bytes) 2024-09-05T17:32:25.040 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:25.041 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:25.042 INFO:teuthology.orchestra.run.smithi050.stdout:5364 writesame 0xb90e22c thru 0xb9179f9 data_size 0x33(0x97ce bytes) 2024-09-05T17:32:25.048 INFO:teuthology.orchestra.run.smithi050.stdout:5366 write 0xf4b7a9 thru 0xf53429 (0x7c81 bytes) 2024-09-05T17:32:25.051 INFO:teuthology.orchestra.run.smithi050.stdout:5367 punch from 0x907bae8 to 0x9083661, (0x7b79 bytes) 2024-09-05T17:32:25.051 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.051 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.051 INFO:teuthology.orchestra.run.smithi050.stdout:5371 write 0x77e4523 thru 0x77eb668 (0x7146 bytes) 2024-09-05T17:32:25.057 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:25.058 INFO:teuthology.orchestra.run.smithi050.stdout:5372 read 0xe66508c thru 0xe66c1bc (0x7131 bytes) 2024-09-05T17:32:25.058 INFO:teuthology.orchestra.run.smithi050.stdout:5374 read 0x6169ba7 thru 0x6172e83 (0x92dd bytes) 2024-09-05T17:32:25.091 INFO:teuthology.orchestra.run.smithi050.stdout:5375 trunc from 0xea51466 to 0x2b1be8b 2024-09-05T17:32:25.108 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:25.103+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:25.115 INFO:teuthology.orchestra.run.smithi050.stdout:5376 read 0xb95efa thru 0xba5656 (0xf75d bytes) 2024-09-05T17:32:25.117 INFO:teuthology.orchestra.run.smithi050.stdout:5377 write 0x1030d12 thru 0x1037344 (0x6633 bytes) 2024-09-05T17:32:25.121 INFO:teuthology.orchestra.run.smithi050.stdout:5378 writesame 0x57011f thru 0x575a41 data_size 0x1(0x5923 bytes) 2024-09-05T17:32:25.138 INFO:teuthology.orchestra.run.smithi050.stdout:5379 read 0x170d07b thru 0x1713f5d (0x6ee3 bytes) 2024-09-05T17:32:25.139 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.140 INFO:teuthology.orchestra.run.smithi050.stdout:5383 read 0x648ce8 thru 0x6519cb (0x8ce4 bytes) 2024-09-05T17:32:25.147 INFO:teuthology.orchestra.run.smithi050.stdout:5384 trunc from 0x2b1be8b to 0x4e507c9 2024-09-05T17:32:25.164 INFO:teuthology.orchestra.run.smithi050.stdout:5385 trunc from 0x4e507c9 to 0x27f943b 2024-09-05T17:32:25.184 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.184 INFO:teuthology.orchestra.run.smithi050.stdout:5387 read 0x2506cbd thru 0x250e224 (0x7568 bytes) 2024-09-05T17:32:25.185 INFO:teuthology.orchestra.run.smithi050.stdout:5389 read 0x3b081 thru 0x4a3ab (0xf32b bytes) 2024-09-05T17:32:25.208 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:25.205+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:25.210 INFO:teuthology.orchestra.run.smithi050.stdout:5390 writesame 0x7f26a63 thru 0x7f2f025 data_size 0xb(0x85c3 bytes) 2024-09-05T17:32:25.213 INFO:teuthology.orchestra.run.smithi050.stdout:5391 read 0x4fd0eab thru 0x4fdefb4 (0xe10a bytes) 2024-09-05T17:32:25.214 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.214 INFO:teuthology.orchestra.run.smithi050.stdout:5394 punch from 0x51f6b4 to 0x5253da, (0x5d26 bytes) 2024-09-05T17:32:25.214 INFO:teuthology.orchestra.run.smithi050.stdout:5395 write 0x1081ade thru 0x10892d3 (0x77f6 bytes) 2024-09-05T17:32:25.218 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.218 INFO:teuthology.orchestra.run.smithi050.stdout:5399 punch from 0x5ce721e to 0x5ce7856, (0x638 bytes) 2024-09-05T17:32:25.226 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:25.226 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:25.234 INFO:teuthology.orchestra.run.smithi050.stdout:5400 write 0xa203465 thru 0xa21122d (0xddc9 bytes) 2024-09-05T17:32:25.241 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:25.242 INFO:teuthology.orchestra.run.smithi050.stdout:5401 write 0x683ca3f thru 0x68462f0 (0x98b2 bytes) 2024-09-05T17:32:25.250 INFO:teuthology.orchestra.run.smithi050.stdout:5402 read 0x6517676 thru 0x651c3af (0x4d3a bytes) 2024-09-05T17:32:25.266 INFO:teuthology.orchestra.run.smithi050.stdout:5403 writesame 0xb752933 thru 0xb75adc4 data_size 0x47(0x8492 bytes) 2024-09-05T17:32:25.269 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.269 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.274 INFO:teuthology.orchestra.run.smithi050.stdout:5407 trunc from 0xb75adc5 to 0x9a8d4f4 2024-09-05T17:32:25.289 INFO:teuthology.orchestra.run.smithi050.stdout:5408 punch from 0x24191e to 0x244763, (0x2e45 bytes) 2024-09-05T17:32:25.289 INFO:teuthology.orchestra.run.smithi050.stdout:5409 read 0x163f1fd thru 0x1644702 (0x5506 bytes) 2024-09-05T17:32:25.289 INFO:teuthology.orchestra.run.smithi050.stdout:5411 write 0x342129c thru 0x3422b84 (0x18e9 bytes) 2024-09-05T17:32:25.295 INFO:teuthology.orchestra.run.smithi050.stdout:5413 read 0x12d090f thru 0x12db3f2 (0xaae4 bytes) 2024-09-05T17:32:25.297 INFO:teuthology.orchestra.run.smithi050.stdout:5415 punch from 0x371bd1b to 0x3724e6e, (0x9153 bytes) 2024-09-05T17:32:25.297 INFO:teuthology.orchestra.run.smithi050.stdout:5416 read 0x119964f thru 0x119e5f3 (0x4fa5 bytes) 2024-09-05T17:32:25.298 INFO:teuthology.orchestra.run.smithi050.stdout:5418 writesame 0x1fe1a1e thru 0x1fe6559 data_size 0x5a(0x4b3c bytes) 2024-09-05T17:32:25.300 INFO:teuthology.orchestra.run.smithi050.stdout:5419 write 0x92a3a41 thru 0x92b230a (0xe8ca bytes) 2024-09-05T17:32:25.303 INFO:teuthology.orchestra.run.smithi050.stdout:5420 write 0x8f6e3a1 thru 0x8f72748 (0x43a8 bytes) 2024-09-05T17:32:25.305 INFO:teuthology.orchestra.run.smithi050.stdout:5421 read 0x432fa98 thru 0x433d786 (0xdcef bytes) 2024-09-05T17:32:25.306 INFO:teuthology.orchestra.run.smithi050.stdout:5422 write 0xf493e1 thru 0xf503e1 (0x7001 bytes) 2024-09-05T17:32:25.309 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.309 INFO:teuthology.orchestra.run.smithi050.stdout:5428 write 0x149c45c thru 0x149f9e6 (0x358b bytes) 2024-09-05T17:32:25.309 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:25.307+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:25.311 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.311 INFO:teuthology.orchestra.run.smithi050.stdout:5430 punch from 0x7d34d2c to 0x7d39222, (0x44f6 bytes) 2024-09-05T17:32:25.311 INFO:teuthology.orchestra.run.smithi050.stdout:5431 write 0x8975b0c thru 0x8982647 (0xcb3c bytes) 2024-09-05T17:32:25.316 INFO:teuthology.orchestra.run.smithi050.stdout:5433 writesame 0xd39ea thru 0xdaebd data_size 0x2(0x74d4 bytes) 2024-09-05T17:32:25.332 INFO:teuthology.orchestra.run.smithi050.stdout:5434 trunc from 0x9a8d4f4 to 0x7fe7069 2024-09-05T17:32:25.346 INFO:teuthology.orchestra.run.smithi050.stdout:5435 write 0x1aa8b24 thru 0x1ab05f4 (0x7ad1 bytes) 2024-09-05T17:32:25.351 INFO:teuthology.orchestra.run.smithi050.stdout:5437 trunc from 0x7fe7069 to 0x6e932ac 2024-09-05T17:32:25.368 INFO:teuthology.orchestra.run.smithi050.stdout:5438 trunc from 0x6e932ac to 0x79bee53 2024-09-05T17:32:25.404 INFO:teuthology.orchestra.run.smithi050.stdout:5439 write 0xb92bb0e thru 0xb930df9 (0x52ec bytes) 2024-09-05T17:32:25.408 INFO:teuthology.orchestra.run.smithi050.stdout:5440 punch from 0x142a4e9 to 0x1430aac, (0x65c3 bytes) 2024-09-05T17:32:25.408 INFO:teuthology.orchestra.run.smithi050.stdout:5444 read 0x97756f3 thru 0x977d1dc (0x7aea bytes) 2024-09-05T17:32:25.408 INFO:teuthology.orchestra.run.smithi050.stdout:5445 write 0x4ff60b3 thru 0x4fff5e9 (0x9537 bytes) 2024-09-05T17:32:25.410 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:25.407+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:25.413 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:25.413 INFO:teuthology.orchestra.run.smithi050.stdout:5447 write 0x9ca3913 thru 0x9ca4cac (0x139a bytes) 2024-09-05T17:32:25.415 INFO:teuthology.orchestra.run.smithi050.stdout:5448 writesame 0x6fd5893 thru 0x6fe3c5c data_size 0x3(0xe3ca bytes) 2024-09-05T17:32:25.416 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:25.416 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:25.416 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:25.416 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:25.435 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:25.437 INFO:teuthology.orchestra.run.smithi050.stdout:5450 punch from 0x66160af to 0x66172a4, (0x11f5 bytes) 2024-09-05T17:32:25.437 INFO:teuthology.orchestra.run.smithi050.stdout:5451 write 0x3d3cb38 thru 0x3d47fea (0xb4b3 bytes) 2024-09-05T17:32:25.441 INFO:teuthology.orchestra.run.smithi050.stdout:5452 read 0x65d25cb thru 0x65da371 (0x7da7 bytes) 2024-09-05T17:32:25.442 INFO:teuthology.orchestra.run.smithi050.stdout:5455 read 0x1747867 thru 0x174ed4d (0x74e7 bytes) 2024-09-05T17:32:25.442 INFO:teuthology.orchestra.run.smithi050.stdout:5457 punch from 0x45701cd to 0x45799a5, (0x97d8 bytes) 2024-09-05T17:32:25.443 INFO:teuthology.orchestra.run.smithi050.stdout:5458 clone 35 order 19 su 131072 sc 8 2024-09-05T17:32:25.511 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:25.508+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:25.558 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:25.558 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:25.558 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:25.575 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:25.617 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:25.616+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:25.691 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone34 from 0xb930dfa (overlap 0x27f943b) to 0x3ff539 2024-09-05T17:32:25.714 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:25.712+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:25.748 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.292062456, 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.749 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:32:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:32:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:32:25.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:32:25.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.292014173999998, 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:32:25.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.759 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291967813999999, 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:32:25.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:32:25.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291919213, 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291863614, 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:32:25.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.771 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291818370000001, 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.772 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:32:25.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291773871, 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.776 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291729914000001, 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:32:25.780 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291684577000002, 2024-09-05T17:32:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:32:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:25.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:32:25.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291638127999999, 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:25.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:32:25.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291594566000001, 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:32:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:32:25.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291549191000001, 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291500079999999, 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:32:25.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291461146, 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.808 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:32:25.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:32:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:32:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:32:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:32:25.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291391483999998, 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:25.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.817 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291338932999999, 2024-09-05T17:32:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:32:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:25.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291193376999999, 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.822 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:32:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:25.826 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291141796000002, 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:32:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80382 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.291042747999999, 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049737581000000003, 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80382 2024-09-05T17:32:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458149+0000", 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458150+0000", 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.23e-07 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458154+0000", 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3120000000000004e-06 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458168+0000", 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3947e-05 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458179+0000", 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0906e-05 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507875+0000", 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049695744 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507887+0000", 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1849e-05 2024-09-05T17:32:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.059119424999999, 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:32:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:32:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:25.841 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:25.842 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-05T17:32:25.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:25.843 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:25.840+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:25.947 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:25.944+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:26.015 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:26.016 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:26.029 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:26.073 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:26.072+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:26.142 INFO:teuthology.orchestra.run.smithi050.stdout:5459 read 0x8d383fd thru 0x8d43757 (0xb35b bytes) 2024-09-05T17:32:26.149 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:26.147+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:26.157 INFO:teuthology.orchestra.run.smithi050.stdout:5461 trunc from 0xb930dfa to 0x22d9cbb 2024-09-05T17:32:26.203 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:26.203 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:26.203 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:26.203 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:26.203 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:26.204 INFO:teuthology.orchestra.run.smithi050.stdout:5464 trunc from 0x22d9cbb to 0x4e05683 2024-09-05T17:32:26.213 INFO:teuthology.orchestra.run.smithi050.stdout:5466 read 0x2a14a18 thru 0x2a18e84 (0x446d bytes) 2024-09-05T17:32:26.219 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:26.233 INFO:teuthology.orchestra.run.smithi050.stdout:5467 write 0x93392c9 thru 0x9346db9 (0xdaf1 bytes) 2024-09-05T17:32:26.253 INFO:teuthology.orchestra.run.smithi050.stdout:5469 writesame 0x952cb9d thru 0x952eed1 data_size 0x1(0x2335 bytes) 2024-09-05T17:32:26.253 INFO:teuthology.orchestra.run.smithi050.stdout:5470 punch from 0x657ed87 to 0x6584dba, (0x6033 bytes) 2024-09-05T17:32:26.255 INFO:teuthology.orchestra.run.smithi050.stdout:5471 trunc from 0x952eed2 to 0xa2e0fd7 2024-09-05T17:32:26.266 INFO:teuthology.orchestra.run.smithi050.stdout:5473 writesame 0x25ff36b thru 0x2603310 data_size 0x1(0x3fa6 bytes) 2024-09-05T17:32:26.269 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:26.268+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:26.319 INFO:teuthology.orchestra.run.smithi050.stdout:5474 write 0xedfe0be thru 0xee09dba (0xbcfd bytes) 2024-09-05T17:32:26.329 INFO:teuthology.orchestra.run.smithi050.stdout:5475 read 0x9d2f3ae thru 0x9d3076a (0x13bd bytes) 2024-09-05T17:32:26.329 INFO:teuthology.orchestra.run.smithi050.stdout:5476 read 0xc259b9 thru 0xc2fdd8 (0xa420 bytes) 2024-09-05T17:32:26.330 INFO:teuthology.orchestra.run.smithi050.stdout:5479 read 0xc4eb3fa thru 0xc4ed27f (0x1e86 bytes) 2024-09-05T17:32:26.330 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.330 INFO:teuthology.orchestra.run.smithi050.stdout:5481 write 0xe78e659 thru 0xe7936de (0x5086 bytes) 2024-09-05T17:32:26.338 INFO:teuthology.orchestra.run.smithi050.stdout:5482 writesame 0xab835c2 thru 0xab85082 data_size 0x3(0x1ac1 bytes) 2024-09-05T17:32:26.349 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 119.33034326800001, 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:32:26.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:32:26.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:32:26.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:32:26.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:32:26.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:26.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:32:26.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.358 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.963351905, 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.363 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.963300989, 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.364 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:32:26.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:32:26.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:32:26.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:32:26.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.963251143000001, 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:32:26.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.963205835, 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:32:26.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.963157818999999, 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:32:26.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:32:26.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.963084686999998, 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:32:26.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:32:26.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.963035660999999, 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:32:26.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:32:26.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.962950643999999, 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:32:26.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.397 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.962894922, 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.398 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:32:26.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.962832064000001, 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:26.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:32:26.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.962685490999998, 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:32:26.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:32:26.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:32:26.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:26.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.955782259999999, 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:26.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.955760466000001, 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:32:26.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.955717003, 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:26.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.955680332, 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:32:26.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:32:26.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.955640025000001, 2024-09-05T17:32:26.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.955601318999999, 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.1755950720000001, 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:32:26.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.8042644960000001, 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:26.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:26.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:32:26.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:32:26.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:32:26.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.451 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:26.451 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:26.451 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:26.452 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:26.347+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:26.453 INFO:teuthology.orchestra.run.smithi050.stdout:5483 trunc from 0xee09dbb to 0x24645f 2024-09-05T17:32:26.453 INFO:teuthology.orchestra.run.smithi050.stdout:5484 read 0x101e37 thru 0x1049f9 (0x2bc3 bytes) 2024-09-05T17:32:26.453 INFO:teuthology.orchestra.run.smithi050.stdout:5485 read 0xe2932 thru 0xee59f (0xbc6e bytes) 2024-09-05T17:32:26.453 INFO:teuthology.orchestra.run.smithi050.stdout:5487 punch from 0x232267 to 0x238357, (0x60f0 bytes) 2024-09-05T17:32:26.454 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:26.448+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:26.454 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:26.477 INFO:teuthology.orchestra.run.smithi050.stdout:5488 write 0x79cfe3e thru 0x79d29cb (0x2b8e bytes) 2024-09-05T17:32:26.482 INFO:teuthology.orchestra.run.smithi050.stdout:5489 punch from 0x9494f6 to 0x94b5eb, (0x20f5 bytes) 2024-09-05T17:32:26.483 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.483 INFO:teuthology.orchestra.run.smithi050.stdout:5491 write 0x5c81698 thru 0x5c83b67 (0x24d0 bytes) 2024-09-05T17:32:26.501 INFO:teuthology.orchestra.run.smithi050.stdout:5492 trunc from 0x79d29cc to 0x2f0720 2024-09-05T17:32:26.531 INFO:teuthology.orchestra.run.smithi050.stdout:5493 trunc from 0x2f0720 to 0x53785f5 2024-09-05T17:32:26.542 INFO:teuthology.orchestra.run.smithi050.stdout:5494 read 0x1e34660 thru 0x1e3c571 (0x7f12 bytes) 2024-09-05T17:32:26.542 INFO:teuthology.orchestra.run.smithi050.stdout:5495 read 0x3008d46 thru 0x301392a (0xabe5 bytes) 2024-09-05T17:32:26.543 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.553 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:26.551+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:26.559 INFO:teuthology.orchestra.run.smithi050.stdout:5499 writesame 0x7e9f974 thru 0x7eae233 data_size 0x4c(0xe8c0 bytes) 2024-09-05T17:32:26.559 INFO:teuthology.orchestra.run.smithi050.stdout:5500 read 0x626a79 thru 0x63365c (0xcbe4 bytes) 2024-09-05T17:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout:5505 punch from 0x3603e78 to 0x360c190, (0x8318 bytes) 2024-09-05T17:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout:5506 punch from 0x2a659b3 to 0x2a65f90, (0x5dd bytes) 2024-09-05T17:32:26.560 INFO:teuthology.orchestra.run.smithi050.stdout:5508 read 0x782dbb7 thru 0x782faf7 (0x1f41 bytes) 2024-09-05T17:32:26.562 INFO:teuthology.orchestra.run.smithi050.stdout:5510 trunc from 0x7eae234 to 0x9a48796 2024-09-05T17:32:26.570 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:32:26.580 INFO:teuthology.orchestra.run.smithi050.stdout:5511 trunc from 0x9a48796 to 0xb87edb9 2024-09-05T17:32:26.596 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:26.596 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:26.607 INFO:teuthology.orchestra.run.smithi050.stdout:5512 trunc from 0xb87edb9 to 0x141fb22 2024-09-05T17:32:26.619 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:26.620 INFO:teuthology.orchestra.run.smithi050.stdout:5513 trunc from 0x141fb22 to 0x25247e5 2024-09-05T17:32:26.631 INFO:teuthology.orchestra.run.smithi050.stdout:5514 read 0x1d31a72 thru 0x1d31acc (0x5b bytes) 2024-09-05T17:32:26.654 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:26.651+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:26.660 INFO:teuthology.orchestra.run.smithi050.stdout:5516 write 0xd28f7c7 thru 0xd29f4ed (0xfd27 bytes) 2024-09-05T17:32:26.675 INFO:teuthology.orchestra.run.smithi050.stdout:5517 write 0xd70b4a1 thru 0xd70bcdf (0x83f bytes) 2024-09-05T17:32:26.679 INFO:teuthology.orchestra.run.smithi050.stdout:5518 read 0xcf36023 thru 0xcf3ac2a (0x4c08 bytes) 2024-09-05T17:32:26.680 INFO:teuthology.orchestra.run.smithi050.stdout:5520 read 0xc1da4ce thru 0xc1e3805 (0x9338 bytes) 2024-09-05T17:32:26.680 INFO:teuthology.orchestra.run.smithi050.stdout:5522 read 0xd3d32f5 thru 0xd3e1bb8 (0xe8c4 bytes) 2024-09-05T17:32:26.680 INFO:teuthology.orchestra.run.smithi050.stdout:5525 punch from 0x9d5dcea to 0x9d5ef5e, (0x1274 bytes) 2024-09-05T17:32:26.680 INFO:teuthology.orchestra.run.smithi050.stdout:5526 punch from 0x82cbba8 to 0x82d9b65, (0xdfbd bytes) 2024-09-05T17:32:26.680 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.680 INFO:teuthology.orchestra.run.smithi050.stdout:5529 write 0x3b85eab thru 0x3b89e65 (0x3fbb bytes) 2024-09-05T17:32:26.684 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.684 INFO:teuthology.orchestra.run.smithi050.stdout:5534 writesame 0x52ecea5 thru 0x52f0515 data_size 0xb(0x3671 bytes) 2024-09-05T17:32:26.691 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.703 INFO:teuthology.orchestra.run.smithi050.stdout:5537 trunc from 0xd70bce0 to 0x4e9318c 2024-09-05T17:32:26.732 INFO:teuthology.orchestra.run.smithi050.stdout:5538 write 0x6912061 thru 0x691db65 (0xbb05 bytes) 2024-09-05T17:32:26.736 INFO:teuthology.orchestra.run.smithi050.stdout:5540 punch from 0x1d97b51 to 0x1da62cf, (0xe77e bytes) 2024-09-05T17:32:26.736 INFO:teuthology.orchestra.run.smithi050.stdout:5541 read 0x5958bfd thru 0x595f2d3 (0x66d7 bytes) 2024-09-05T17:32:26.736 INFO:teuthology.orchestra.run.smithi050.stdout:5543 read 0x1ee0e13 thru 0x1ee37e1 (0x29cf bytes) 2024-09-05T17:32:26.736 INFO:teuthology.orchestra.run.smithi050.stdout:5544 read 0x2d5195 thru 0x2d8c17 (0x3a83 bytes) 2024-09-05T17:32:26.737 INFO:teuthology.orchestra.run.smithi050.stdout:5545 punch from 0x46ba8a to 0x4770b0, (0xb626 bytes) 2024-09-05T17:32:26.737 INFO:teuthology.orchestra.run.smithi050.stdout:5546 read 0x622c162 thru 0x622c36c (0x20b bytes) 2024-09-05T17:32:26.747 INFO:teuthology.orchestra.run.smithi050.stdout:5548 write 0x74589fe thru 0x7461186 (0x8789 bytes) 2024-09-05T17:32:26.754 INFO:teuthology.orchestra.run.smithi050.stdout:5549 trunc from 0x7461187 to 0x71ae7d9 2024-09-05T17:32:26.755 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:26.751+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:26.764 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:26.765 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:26.769 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.769 INFO:teuthology.orchestra.run.smithi050.stdout:5551 read 0x459756e thru 0x4597e7c (0x90f bytes) 2024-09-05T17:32:26.785 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:26.790 INFO:teuthology.orchestra.run.smithi050.stdout:5552 write 0xe4b8f55 thru 0xe4c694f (0xd9fb bytes) 2024-09-05T17:32:26.796 INFO:teuthology.orchestra.run.smithi050.stdout:5553 write 0x81f0ad6 thru 0x8200873 (0xfd9e bytes) 2024-09-05T17:32:26.818 INFO:teuthology.orchestra.run.smithi050.stdout:5554 trunc from 0xe4c6950 to 0x28a060f 2024-09-05T17:32:26.835 INFO:teuthology.orchestra.run.smithi050.stdout:5555 write 0x1396161 thru 0x13a5503 (0xf3a3 bytes) 2024-09-05T17:32:26.841 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.845 INFO:teuthology.orchestra.run.smithi050.stdout:5557 trunc from 0x28a060f to 0x50b45d6 2024-09-05T17:32:26.855 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:26.851+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:26.864 INFO:teuthology.orchestra.run.smithi050.stdout:5558 write 0x5188085 thru 0x5194c90 (0xcc0c bytes) 2024-09-05T17:32:26.870 INFO:teuthology.orchestra.run.smithi050.stdout:5560 read 0x31e30d6 thru 0x31ef227 (0xc152 bytes) 2024-09-05T17:32:26.870 INFO:teuthology.orchestra.run.smithi050.stdout:5561 read 0x4db3754 thru 0x4db6b75 (0x3422 bytes) 2024-09-05T17:32:26.870 INFO:teuthology.orchestra.run.smithi050.stdout:5563 read 0x1ad8bf9 thru 0x1adc6dc (0x3ae4 bytes) 2024-09-05T17:32:26.871 INFO:teuthology.orchestra.run.smithi050.stdout:5564 write 0xed8561 thru 0xee7420 (0xeec0 bytes) 2024-09-05T17:32:26.875 INFO:teuthology.orchestra.run.smithi050.stdout:5565 punch from 0x40c1130 to 0x40cea69, (0xd939 bytes) 2024-09-05T17:32:26.876 INFO:teuthology.orchestra.run.smithi050.stdout:5566 punch from 0x371bf8e to 0x371cf2b, (0xf9d bytes) 2024-09-05T17:32:26.894 INFO:teuthology.orchestra.run.smithi050.stdout:5568 writesame 0xb22718e thru 0xb22a162 data_size 0x1f(0x2fd5 bytes) 2024-09-05T17:32:26.906 INFO:teuthology.orchestra.run.smithi050.stdout:5569 trunc from 0xb22a163 to 0x26d2330 2024-09-05T17:32:26.923 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:26.923 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:26.942 INFO:teuthology.orchestra.run.smithi050.stdout:5570 writesame 0x97b5808 thru 0x97bca9d data_size 0x3(0x7296 bytes) 2024-09-05T17:32:26.942 INFO:teuthology.orchestra.run.smithi050.stdout:5571 punch from 0x6919082 to 0x6920eb7, (0x7e35 bytes) 2024-09-05T17:32:26.942 INFO:teuthology.orchestra.run.smithi050.stdout:5572 write 0x8c935b0 thru 0x8c95aa1 (0x24f2 bytes) 2024-09-05T17:32:26.945 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:26.948 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:26.948 INFO:teuthology.orchestra.run.smithi050.stdout:5575 writesame 0x84e7d7d thru 0x84f6cf9 data_size 0x1(0xef7d bytes) 2024-09-05T17:32:26.984 INFO:teuthology.orchestra.run.smithi050.stdout:5576 clone 36 order 21 su 262144 sc 12 2024-09-05T17:32:26.984 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:26.979+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:27.057 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:27.055+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:27.067 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:27.067 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:27.082 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:27.154 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:27.157 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:27.155+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:27.190 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:27.190 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:27.211 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:27.212 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:27.215 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:27.216 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:27.258 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:27.256+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:27.261 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:27.262 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:27.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:27.359 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:27.355+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:27.401 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:27.401 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:27.416 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:27.465 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:27.456+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:27.561 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:27.560+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:27.581 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:32:27.589 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:27.589 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:27.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:27.661 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:27.660+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:27.730 INFO:teuthology.orchestra.run.smithi050.stdout:leaving image image_client.0-clone35 intact 2024-09-05T17:32:27.763 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:27.759+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:27.772 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:27.772 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:27.789 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:27.885 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:27.883+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:27.965 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:27.959+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:27.972 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:27.972 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:27.979 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-05T17:32:27.987 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:28.000 INFO:teuthology.orchestra.run.smithi050.stdout:5578 flatten 2024-09-05T17:32:28.058 INFO:teuthology.orchestra.run.smithi050.stdout:5579 write 0x430e153 thru 0x4310514 (0x23c2 bytes) 2024-09-05T17:32:28.066 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:28.063+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:28.066 INFO:teuthology.orchestra.run.smithi050.stdout:5580 writesame 0x13d2ddf thru 0x13d4d93 data_size 0x1(0x1fb5 bytes) 2024-09-05T17:32:28.077 INFO:teuthology.orchestra.run.smithi050.stdout:5581 punch from 0x5d60d47 to 0x5d6160c, (0x8c5 bytes) 2024-09-05T17:32:28.084 INFO:teuthology.orchestra.run.smithi050.stdout:5582 trunc from 0x97bca9e to 0x6580458 2024-09-05T17:32:28.107 INFO:teuthology.orchestra.run.smithi050.stdout:5584 read 0x5df46da thru 0x5e005d1 (0xbef8 bytes) 2024-09-05T17:32:28.113 INFO:teuthology.orchestra.run.smithi050.stdout:5585 trunc from 0x6580458 to 0x8960a2a 2024-09-05T17:32:28.124 INFO:teuthology.orchestra.run.smithi050.stdout:5586 read 0x4e73ee6 thru 0x4e7e36a (0xa485 bytes) 2024-09-05T17:32:28.129 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:28.129 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:28.141 INFO:teuthology.orchestra.run.smithi050.stdout:5587 write 0xab24c05 thru 0xab334a5 (0xe8a1 bytes) 2024-09-05T17:32:28.145 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:28.148 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:28.149 INFO:teuthology.orchestra.run.smithi050.stdout:5590 write 0x80e3e7a thru 0x80f22cb (0xe452 bytes) 2024-09-05T17:32:28.156 INFO:teuthology.orchestra.run.smithi050.stdout:5593 write 0x98dd051 thru 0x98e2d7c (0x5d2c bytes) 2024-09-05T17:32:28.157 INFO:tasks.ceph.osd.5:Stopped 2024-09-05T17:32:28.158 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.5 2024-09-05T17:32:28.158 INFO:tasks.thrashosds.thrasher:remote for osd 5 is ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:32:28.158 DEBUG:teuthology.orchestra.run.smithi110:> type ceph-objectstore-tool 2024-09-05T17:32:28.162 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-05T17:32:28.163 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op list-pgs 2024-09-05T17:32:28.164 INFO:teuthology.orchestra.run.smithi050.stdout:5594 write 0x329462a thru 0x32a1c2b (0xd602 bytes) 2024-09-05T17:32:28.167 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:28.163+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:28.168 INFO:teuthology.orchestra.run.smithi050.stdout:5595 read 0x30a21e0 thru 0x30b107a (0xee9b bytes) 2024-09-05T17:32:28.168 INFO:teuthology.orchestra.run.smithi050.stdout:5596 writesame 0xf18d50 thru 0xf1b16a data_size 0x27(0x241b bytes) 2024-09-05T17:32:28.174 INFO:teuthology.orchestra.run.smithi050.stdout:5597 write 0x231547b thru 0x231bfdb (0x6b61 bytes) 2024-09-05T17:32:28.180 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:28.188 INFO:teuthology.orchestra.run.smithi050.stdout:5599 write 0xadb9449 thru 0xadc322d (0x9de5 bytes) 2024-09-05T17:32:28.195 INFO:teuthology.orchestra.run.smithi050.stdout:5601 writesame 0x9e15d8 thru 0x9e5465 data_size 0x33(0x3e8e bytes) 2024-09-05T17:32:28.198 INFO:teuthology.orchestra.run.smithi050.stdout:5602 read 0x84f7168 thru 0x84f8107 (0xfa0 bytes) 2024-09-05T17:32:28.198 INFO:teuthology.orchestra.run.smithi050.stdout:5603 write 0x347e723 thru 0x34811cf (0x2aad bytes) 2024-09-05T17:32:28.206 INFO:teuthology.orchestra.run.smithi050.stdout:5604 punch from 0xa4ce6e7 to 0xa4d7f20, (0x9839 bytes) 2024-09-05T17:32:28.206 INFO:teuthology.orchestra.run.smithi050.stdout:5606 read 0x68b8ad1 thru 0x68bb2b1 (0x27e1 bytes) 2024-09-05T17:32:28.212 INFO:teuthology.orchestra.run.smithi050.stdout:5607 trunc from 0xadc322e to 0xe494b23 2024-09-05T17:32:28.221 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:28.221 INFO:teuthology.orchestra.run.smithi050.stdout:5609 trunc from 0xe494b23 to 0xe73b4da 2024-09-05T17:32:28.230 INFO:teuthology.orchestra.run.smithi050.stdout:5610 read 0x73991d9 thru 0x739a333 (0x115b bytes) 2024-09-05T17:32:28.230 INFO:teuthology.orchestra.run.smithi050.stdout:5611 read 0x110bcd0 thru 0x1112800 (0x6b31 bytes) 2024-09-05T17:32:28.231 INFO:teuthology.orchestra.run.smithi050.stdout:5612 write 0x8e11b27 thru 0x8e1c543 (0xaa1d bytes) 2024-09-05T17:32:28.235 INFO:teuthology.orchestra.run.smithi050.stdout:5613 punch from 0x4188c39 to 0x419484b, (0xbc12 bytes) 2024-09-05T17:32:28.235 INFO:teuthology.orchestra.run.smithi050.stdout:5614 write 0x4749925 thru 0x47513a6 (0x7a82 bytes) 2024-09-05T17:32:28.254 INFO:teuthology.orchestra.run.smithi050.stdout:5615 trunc from 0xe73b4da to 0x61d2456 2024-09-05T17:32:28.268 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:28.264+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:28.269 INFO:teuthology.orchestra.run.smithi050.stdout:5616 read 0x20dfa93 thru 0x20e9a29 (0x9f97 bytes) 2024-09-05T17:32:28.269 INFO:teuthology.orchestra.run.smithi050.stdout:5617 writesame 0x95b021 thru 0x96477e data_size 0x7d(0x975e bytes) 2024-09-05T17:32:28.272 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:28.272 INFO:teuthology.orchestra.run.smithi050.stdout:5620 write 0x2081beb thru 0x208a026 (0x843c bytes) 2024-09-05T17:32:28.278 INFO:teuthology.orchestra.run.smithi050.stdout:5622 writesame 0x43f3651 thru 0x43f6600 data_size 0x38(0x2fb0 bytes) 2024-09-05T17:32:28.283 INFO:teuthology.orchestra.run.smithi050.stdout:5623 read 0xd79e1d thru 0xd86370 (0xc554 bytes) 2024-09-05T17:32:28.284 INFO:teuthology.orchestra.run.smithi050.stdout:5624 read 0x18be4f1 thru 0x18c23fb (0x3f0b bytes) 2024-09-05T17:32:28.287 INFO:teuthology.orchestra.run.smithi050.stdout:5625 trunc from 0x61d2456 to 0x420c5ab 2024-09-05T17:32:28.302 INFO:teuthology.orchestra.run.smithi050.stdout:5627 write 0x369c9ba thru 0x36ab94c (0xef93 bytes) 2024-09-05T17:32:28.306 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:28.306 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:28.326 INFO:teuthology.orchestra.run.smithi050.stdout:5628 write 0x7f8a590 thru 0x7f9395a (0x93cb bytes) 2024-09-05T17:32:28.328 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:28.353 INFO:teuthology.orchestra.run.smithi050.stdout:5629 write 0xd0b7b52 thru 0xd0c2ff7 (0xb4a6 bytes) 2024-09-05T17:32:28.362 INFO:teuthology.orchestra.run.smithi050.stdout:5630 write 0x28f3566 thru 0x2902aa5 (0xf540 bytes) 2024-09-05T17:32:28.368 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:28.364+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:28.370 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:28.370 INFO:teuthology.orchestra.run.smithi050.stdout:5634 read 0x6baee3a thru 0x6bb9e7a (0xb041 bytes) 2024-09-05T17:32:28.370 INFO:teuthology.orchestra.run.smithi050.stdout:5635 read 0xa94651d thru 0xa94f331 (0x8e15 bytes) 2024-09-05T17:32:28.370 INFO:teuthology.orchestra.run.smithi050.stdout:5636 writesame 0xac2c8e8 thru 0xac35b7f data_size 0x4(0x9298 bytes) 2024-09-05T17:32:28.385 INFO:teuthology.orchestra.run.smithi050.stdout:5637 write 0x2ab76ee thru 0x2abe5ed (0x6f00 bytes) 2024-09-05T17:32:28.392 INFO:teuthology.orchestra.run.smithi050.stdout:5638 writesame 0x1873c6a thru 0x1877eb5 data_size 0x2(0x424c bytes) 2024-09-05T17:32:28.421 INFO:teuthology.orchestra.run.smithi050.stdout:5639 trunc from 0xd0c2ff8 to 0x4507c29 2024-09-05T17:32:28.466 INFO:teuthology.orchestra.run.smithi050.stdout:5640 trunc from 0x4507c29 to 0xc66a360 2024-09-05T17:32:28.469 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:28.468+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:5641 read 0xb142703 thru 0xb14d3bd (0xacbb bytes) 2024-09-05T17:32:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:5643 read 0x5b8dc82 thru 0x5b94516 (0x6895 bytes) 2024-09-05T17:32:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:5646 punch from 0x64fe612 to 0x64ffbc2, (0x15b0 bytes) 2024-09-05T17:32:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:5647 punch from 0x2f1e91b to 0x2f28087, (0x976c bytes) 2024-09-05T17:32:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:5648 read 0x555be8c thru 0x555d537 (0x16ac bytes) 2024-09-05T17:32:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:5649 read 0xaa7a3e2 thru 0xaa7a50a (0x129 bytes) 2024-09-05T17:32:28.478 INFO:teuthology.orchestra.run.smithi050.stdout:5651 write 0xb3ec0e1 thru 0xb3f421e (0x813e bytes) 2024-09-05T17:32:28.485 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:28.485 INFO:teuthology.orchestra.run.smithi050.stdout:5653 write 0xc1ff2c thru 0xc21949 (0x1a1e bytes) 2024-09-05T17:32:28.488 INFO:teuthology.orchestra.run.smithi050.stdout:5654 write 0x3b44a5a thru 0x3b547cd (0xfd74 bytes) 2024-09-05T17:32:28.491 INFO:teuthology.orchestra.run.smithi050.stdout:5655 write 0x6afcad2 thru 0x6afd5ce (0xafd bytes) 2024-09-05T17:32:28.495 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:28.495 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:28.504 INFO:teuthology.orchestra.run.smithi050.stdout:5656 trunc from 0xc66a360 to 0x9ab2de9 2024-09-05T17:32:28.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:28.524 INFO:teuthology.orchestra.run.smithi050.stdout:5658 read 0x100aaa thru 0x10514b (0x46a2 bytes) 2024-09-05T17:32:28.525 INFO:teuthology.orchestra.run.smithi050.stdout:5661 write 0x916f693 thru 0x9177b9f (0x850d bytes) 2024-09-05T17:32:28.532 INFO:teuthology.orchestra.run.smithi050.stdout:5662 write 0x879e4d0 thru 0x87a7765 (0x9296 bytes) 2024-09-05T17:32:28.557 INFO:teuthology.orchestra.run.smithi050.stdout:5664 writesame 0xe480cfc thru 0xe483b62 data_size 0x1(0x2e67 bytes) 2024-09-05T17:32:28.557 INFO:teuthology.orchestra.run.smithi050.stdout:5666 write 0x522094 thru 0x525836 (0x37a3 bytes) 2024-09-05T17:32:28.570 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:28.567+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:28.574 INFO:teuthology.orchestra.run.smithi050.stdout:5667 trunc from 0xe483b63 to 0x6b1bf72 2024-09-05T17:32:28.594 INFO:teuthology.orchestra.run.smithi050.stdout:5668 punch from 0x5d07b8a to 0x5d0bdf2, (0x4268 bytes) 2024-09-05T17:32:28.607 INFO:teuthology.orchestra.run.smithi050.stdout:5671 trunc from 0x6b1bf72 to 0xbd3e63f 2024-09-05T17:32:28.617 INFO:teuthology.orchestra.run.smithi050.stdout:5673 read 0x394c28c thru 0x3950a2a (0x479f bytes) 2024-09-05T17:32:28.621 INFO:teuthology.orchestra.run.smithi050.stdout:5674 trunc from 0xbd3e63f to 0xa0da7f3 2024-09-05T17:32:28.631 INFO:teuthology.orchestra.run.smithi050.stdout:5676 write 0xea09cd thru 0xea1281 (0x8b5 bytes) 2024-09-05T17:32:28.635 INFO:teuthology.orchestra.run.smithi050.stdout:5677 punch from 0x2150136 to 0x215b8bb, (0xb785 bytes) 2024-09-05T17:32:28.653 INFO:teuthology.orchestra.run.smithi050.stdout:5678 writesame 0xc486ccf thru 0xc490bc9 data_size 0x1(0x9efb bytes) 2024-09-05T17:32:28.653 INFO:teuthology.orchestra.run.smithi050.stdout:5680 punch from 0xc0f02cc to 0xc0f4c6f, (0x49a3 bytes) 2024-09-05T17:32:28.655 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:28.656 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:28.670 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:28.672 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:28.667+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:28.679 INFO:teuthology.orchestra.run.smithi050.stdout:5683 trunc from 0xc490bca to 0x293ba26 2024-09-05T17:32:28.704 INFO:teuthology.orchestra.run.smithi050.stdout:5684 clone 37 order 25 su 1048576 sc 6 2024-09-05T17:32:28.760 INFO:teuthology.orchestra.run.smithi110.stdout:3.d 2024-09-05T17:32:28.760 INFO:teuthology.orchestra.run.smithi110.stdout:3.c 2024-09-05T17:32:28.760 INFO:teuthology.orchestra.run.smithi110.stdout:3.1f 2024-09-05T17:32:28.760 INFO:teuthology.orchestra.run.smithi110.stdout:3.1c 2024-09-05T17:32:28.761 INFO:teuthology.orchestra.run.smithi110.stdout:3.17 2024-09-05T17:32:28.761 INFO:teuthology.orchestra.run.smithi110.stdout:3.16 2024-09-05T17:32:28.761 INFO:teuthology.orchestra.run.smithi110.stdout:3.5 2024-09-05T17:32:28.761 INFO:teuthology.orchestra.run.smithi110.stdout:3.1d 2024-09-05T17:32:28.761 INFO:teuthology.orchestra.run.smithi110.stdout:2.3 2024-09-05T17:32:28.761 INFO:teuthology.orchestra.run.smithi110.stdout:3.2 2024-09-05T17:32:28.761 INFO:teuthology.orchestra.run.smithi110.stdout:2.2 2024-09-05T17:32:28.772 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:28.767+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:28.791 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:28.791 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:28.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:28.873 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:28.867+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:28.926 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:28.927 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:28.940 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:28.973 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:28.971+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:29.062 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:29.062 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:29.074 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:29.075+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:29.077 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:29.095 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op export --pgid 3.c --file /var/log/ceph/exp.3.c.5 2024-09-05T17:32:29.189 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:29.188+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:29.197 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:29.197 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:29.211 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:29.217 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:29.297 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:29.296+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:29.371 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:29.371 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:29.377 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:29.378 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:29.374+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:29.378 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:29.386 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:29.396 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:29.396 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:29.412 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:29.412 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:29.429 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:29.429 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:29.448 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:29.448 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:29.468 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:29.468 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:29.479 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:29.474+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:29.486 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:29.486 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:29.490 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:29.491 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:29.551 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:29.552 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:29.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:29.608 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:32:29.613 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:29.612+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:29.681 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:29.678+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:29.682 INFO:teuthology.orchestra.run.smithi110.stderr:Exporting 3.c info 3.c( v 103'266 (0'0,103'266] local-lis/les=24/25 n=42 ec=24/24 lis/c=24/24 les/c/f=25/25/0 sis=24) 2024-09-05T17:32:29.684 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:302a726f:::rbd_data.114070605229.0000000000000036:4# 2024-09-05T17:32:29.684 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:302a726f:::rbd_data.114070605229.0000000000000036:head# 2024-09-05T17:32:29.685 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:30396c86:::rbd_data.114070605229.0000000000000122:4# 2024-09-05T17:32:29.685 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:30396c86:::rbd_data.114070605229.0000000000000122:head# 2024-09-05T17:32:29.685 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:31bc3250:::rbd_data.1140c66ba109.0000000000000004:23# 2024-09-05T17:32:29.685 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:31bc3250:::rbd_data.1140c66ba109.0000000000000004:head# 2024-09-05T17:32:29.688 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:32928108:::rbd_data.114070605229.0000000000000127:4# 2024-09-05T17:32:29.688 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:32928108:::rbd_data.114070605229.0000000000000127:head# 2024-09-05T17:32:29.688 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:32ac2821:::rbd_data.11402b8b869e.0000000000000009:head# 2024-09-05T17:32:29.689 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:32cc3091:::rbd_data.1140e4bbd9e2.00000000000000af:head# 2024-09-05T17:32:29.690 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:3308375d:::rbd_data.1140f0d7121a.0000000000000015:10# 2024-09-05T17:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:3308375d:::rbd_data.1140f0d7121a.0000000000000015:head# 2024-09-05T17:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:33251906:::rbd_data.1140f3505917.0000000000000002:head# 2024-09-05T17:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:335df081:::rbd_data.114070605229.000000000000009a:4# 2024-09-05T17:32:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:335df081:::rbd_data.114070605229.000000000000009a:head# 2024-09-05T17:32:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:337cf9fe:::rbd_data.1140e4bbd9e2.00000000000000a7:head# 2024-09-05T17:32:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:33840839:::rbd_data.114076cffc4f.0000000000000007:head# 2024-09-05T17:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:33baf03c:::rbd_data.1140e4bbd9e2.000000000000000b:head# 2024-09-05T17:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:33d98fe8:::rbd_data.1140e4bbd9e2.00000000000001f9:head# 2024-09-05T17:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:3454b815:::rbd_data.11402e02f3c2.0000000000000039:head# 2024-09-05T17:32:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:34579730:::rbd_object_map.11402e02f3c2.000000000000001b:head# 2024-09-05T17:32:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:34dc32f7:::rbd_data.1140c66ba109.0000000000000003:23# 2024-09-05T17:32:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:34dc32f7:::rbd_data.1140c66ba109.0000000000000003:head# 2024-09-05T17:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:3548b700:::rbd_data.114070605229.000000000000007b:4# 2024-09-05T17:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:3548b700:::rbd_data.114070605229.000000000000007b:head# 2024-09-05T17:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:35999e1c:::rbd_data.1140e4bbd9e2.000000000000013d:head# 2024-09-05T17:32:29.699 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:35e8a807:::rbd_data.1140c66ba109.0000000000000007:23# 2024-09-05T17:32:29.699 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:35e8a807:::rbd_data.1140c66ba109.0000000000000007:head# 2024-09-05T17:32:29.701 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:35f84864:::rbd_data.1140f3505917.0000000000000025:9# 2024-09-05T17:32:29.702 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:35f84864:::rbd_data.1140f3505917.0000000000000025:head# 2024-09-05T17:32:29.702 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:36427e6a:::rbd_data.1140e4bbd9e2.0000000000000030:head# 2024-09-05T17:32:29.702 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:36b37c76:::rbd_data.1140f0d7121a.000000000000000f:10# 2024-09-05T17:32:29.704 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:36b37c76:::rbd_data.1140f0d7121a.000000000000000f:head# 2024-09-05T17:32:29.704 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:375190e0:::rbd_data.114070605229.0000000000000030:4# 2024-09-05T17:32:29.704 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:375190e0:::rbd_data.114070605229.0000000000000030:head# 2024-09-05T17:32:29.705 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:3779f3e6:::rbd_data.1140102563a7.0000000000000004:head# 2024-09-05T17:32:29.705 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:29.706 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:29.706 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:29.706 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:29.706 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:29.707 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:3793002e:::rbd_data.11402e02f3c2.0000000000000300:head# 2024-09-05T17:32:29.707 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:3799faa0:::rbd_data.1140e4bbd9e2.0000000000000065:head# 2024-09-05T17:32:29.708 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:37b66259:::rbd_data.1140cca6b281.0000000000000001:16# 2024-09-05T17:32:29.713 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:37b66259:::rbd_data.1140cca6b281.0000000000000001:head# 2024-09-05T17:32:29.713 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:37ca48c5:::rbd_data.1140e4bbd9e2.0000000000000300:head# 2024-09-05T17:32:29.713 INFO:teuthology.orchestra.run.smithi110.stderr:Read #3:37e56a0e:::rbd_data.1140e4bbd9e2.00000000000000d3:head# 2024-09-05T17:32:29.714 INFO:teuthology.orchestra.run.smithi110.stderr:Export successful 2024-09-05T17:32:29.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:29.785 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-05T17:32:29.809 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:29.808+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:29.883 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:29.878+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.871833608, 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:32:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:32:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504842244999999, 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:32:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504791329, 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:32:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504741483, 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:32:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504696174999999, 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:32:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504648158999998, 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:32:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504575027000001, 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:32:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:32:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504526000999999, 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:32:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:32:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:32:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504440983999999, 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:32:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:32:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504385262, 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:32:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504322404, 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:32:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:32:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.504175831000001, 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.497272599999999, 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:32:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.497250806, 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:32:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:32:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.497207342999999, 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:32:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.497170671999999, 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:32:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.497130365, 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:32:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:32:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.497091658999999, 2024-09-05T17:32:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:32:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.7170854120000003, 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:32:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 7.3457548360000002, 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:32:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:32:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:29.986 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:29.988 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:29.984+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:29.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:29.999 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --force --op remove --pgid 3.c 2024-09-05T17:32:30.085 INFO:teuthology.orchestra.run.smithi050.stdout:5685 write 0x891b3e4 thru 0x891fd87 (0x49a4 bytes) 2024-09-05T17:32:30.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-05T17:32:30.089 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:30.086+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:30.092 INFO:teuthology.orchestra.run.smithi050.stdout:5686 punch from 0x5b1b6a8 to 0x5b1ca7b, (0x13d3 bytes) 2024-09-05T17:32:30.092 INFO:teuthology.orchestra.run.smithi050.stdout:5691 read 0x79b6ff6 thru 0x79c23f3 (0xb3fe bytes) 2024-09-05T17:32:30.093 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.101 INFO:teuthology.orchestra.run.smithi050.stdout:5693 writesame 0x97f7c41 thru 0x9802532 data_size 0x32(0xa8f2 bytes) 2024-09-05T17:32:30.117 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.118 INFO:teuthology.orchestra.run.smithi050.stdout:5696 writesame 0x5cd9bca thru 0x5ce1584 data_size 0x1(0x79bb bytes) 2024-09-05T17:32:30.118 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:116393 3.1b 3:dd907f30:::rbd_data.11402f0626d4.0000000000000002:head [stat,write-same in=1b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:32:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:30.119436+0000", 2024-09-05T17:32:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.5897999999999996e-05, 2024-09-05T17:32:30.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011485300000000001, 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 116393 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:30.119436+0000", 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:30.119436+0000", 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:30.119438+0000", 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3379999999999999e-06 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:30.119444+0000", 2024-09-05T17:32:30.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.691e-06 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:30.119460+0000", 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5313999999999999e-05 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:30.119470+0000", 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0149999999999999e-05 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:30.119523+0000", 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2957000000000001e-05 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.123 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:30.123 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 1 2024-09-05T17:32:30.123 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:30.134 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:30.136 INFO:teuthology.orchestra.run.smithi050.stdout:5697 writesame 0x8233ad9 thru 0x8236608 data_size 0x10(0x2b30 bytes) 2024-09-05T17:32:30.159 INFO:teuthology.orchestra.run.smithi050.stdout:5699 write 0xd37886e thru 0xd37e0ee (0x5881 bytes) 2024-09-05T17:32:30.165 INFO:teuthology.orchestra.run.smithi050.stdout:5700 punch from 0x83139ba to 0x831db41, (0xa187 bytes) 2024-09-05T17:32:30.165 INFO:teuthology.orchestra.run.smithi050.stdout:5701 write 0x97c4b1c thru 0x97cf09d (0xa582 bytes) 2024-09-05T17:32:30.167 INFO:teuthology.orchestra.run.smithi050.stdout:5702 read 0xc5cacf3 thru 0xc5d1e96 (0x71a4 bytes) 2024-09-05T17:32:30.167 INFO:teuthology.orchestra.run.smithi050.stdout:5703 read 0x59fee14 thru 0x5a0c2d2 (0xd4bf bytes) 2024-09-05T17:32:30.168 INFO:teuthology.orchestra.run.smithi050.stdout:5704 read 0xcef7fe1 thru 0xcefe4e1 (0x6501 bytes) 2024-09-05T17:32:30.168 INFO:teuthology.orchestra.run.smithi050.stdout:5705 read 0xa8c6eeb thru 0xa8ce0e1 (0x71f7 bytes) 2024-09-05T17:32:30.168 INFO:teuthology.orchestra.run.smithi050.stdout:5706 write 0x539451b thru 0x539f987 (0xb46d bytes) 2024-09-05T17:32:30.174 INFO:teuthology.orchestra.run.smithi050.stdout:5707 trunc from 0xd37e0ef to 0xa21d839 2024-09-05T17:32:30.189 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:30.186+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:30.211 INFO:teuthology.orchestra.run.smithi050.stdout:5708 write 0x46a0be5 thru 0x46a5e25 (0x5241 bytes) 2024-09-05T17:32:30.215 INFO:teuthology.orchestra.run.smithi050.stdout:5709 write 0x682b75b thru 0x6837960 (0xc206 bytes) 2024-09-05T17:32:30.228 INFO:teuthology.orchestra.run.smithi050.stdout:5710 writesame 0xaa10cc1 thru 0xaa1497f data_size 0x1(0x3cbf bytes) 2024-09-05T17:32:30.230 INFO:teuthology.orchestra.run.smithi050.stdout:5711 write 0x4c7e07 thru 0x4d7096 (0xf290 bytes) 2024-09-05T17:32:30.235 INFO:teuthology.orchestra.run.smithi050.stdout:5713 trunc from 0xaa14980 to 0x9acb0cb 2024-09-05T17:32:30.260 INFO:teuthology.orchestra.run.smithi050.stdout:5715 write 0xa61bd32 thru 0xa624297 (0x8566 bytes) 2024-09-05T17:32:30.264 INFO:teuthology.orchestra.run.smithi050.stdout:5716 write 0x9c878eb thru 0x9c8fd9c (0x84b2 bytes) 2024-09-05T17:32:30.269 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.269 INFO:teuthology.orchestra.run.smithi050.stdout:5722 read 0x3f13461 thru 0x3f22467 (0xf007 bytes) 2024-09-05T17:32:30.269 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.270 INFO:teuthology.orchestra.run.smithi050.stdout:5724 writesame 0x620fd0 thru 0x6308a0 data_size 0x1(0xf8d1 bytes) 2024-09-05T17:32:30.282 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:30.282 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:30.282 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:30.282 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:30.282 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:30.290 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:30.288+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:30.297 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:30.340 INFO:teuthology.orchestra.run.smithi050.stdout:5725 write 0x3b7199b thru 0x3b7ad1f (0x9385 bytes) 2024-09-05T17:32:30.343 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.343 INFO:teuthology.orchestra.run.smithi050.stdout:5729 read 0x66fd2e4 thru 0x670215b (0x4e78 bytes) 2024-09-05T17:32:30.344 INFO:teuthology.orchestra.run.smithi050.stdout:5731 writesame 0x77f9458 thru 0x77fee43 data_size 0x5(0x59ec bytes) 2024-09-05T17:32:30.350 INFO:teuthology.orchestra.run.smithi050.stdout:5732 punch from 0x8b6c91e to 0x8b6e4bf, (0x1ba1 bytes) 2024-09-05T17:32:30.350 INFO:teuthology.orchestra.run.smithi050.stdout:5734 write 0x3d54ce0 thru 0x3d5f322 (0xa643 bytes) 2024-09-05T17:32:30.353 INFO:teuthology.orchestra.run.smithi050.stdout:5735 writesame 0x8003776 thru 0x8008da1 data_size 0xa(0x562c bytes) 2024-09-05T17:32:30.358 INFO:teuthology.orchestra.run.smithi050.stdout:5736 writesame 0x2869001 thru 0x28788e2 data_size 0x2a(0xf8e2 bytes) 2024-09-05T17:32:30.361 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.361 INFO:teuthology.orchestra.run.smithi050.stdout:5739 read 0x3a12465 thru 0x3a1a96a (0x8506 bytes) 2024-09-05T17:32:30.362 INFO:teuthology.orchestra.run.smithi050.stdout:5740 writesame 0xa5b28d7 thru 0xa5bfdbf data_size 0xb(0xd4e9 bytes) 2024-09-05T17:32:30.365 INFO:teuthology.orchestra.run.smithi050.stdout:5741 writesame 0x97009ae thru 0x97080d7 data_size 0x7(0x772a bytes) 2024-09-05T17:32:30.370 INFO:teuthology.orchestra.run.smithi050.stdout:5744 write 0x9987f4e thru 0x998e922 (0x69d5 bytes) 2024-09-05T17:32:30.372 INFO:teuthology.orchestra.run.smithi050.stdout:5745 read 0x9912982 thru 0x991cd5b (0xa3da bytes) 2024-09-05T17:32:30.373 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.374 INFO:teuthology.orchestra.run.smithi050.stdout:5747 trunc from 0xa624298 to 0x985bb2f 2024-09-05T17:32:30.386 INFO:teuthology.orchestra.run.smithi050.stdout:5749 read 0x43d5d42 thru 0x43e0e46 (0xb105 bytes) 2024-09-05T17:32:30.390 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:30.386+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:30.405 INFO:teuthology.orchestra.run.smithi050.stdout:5750 write 0xe7afd8c thru 0xe7bd5ea (0xd85f bytes) 2024-09-05T17:32:30.412 INFO:teuthology.orchestra.run.smithi050.stdout:5751 punch from 0xa356671 to 0xa3585e7, (0x1f76 bytes) 2024-09-05T17:32:30.413 INFO:teuthology.orchestra.run.smithi050.stdout:5752 write 0x2a67c56 thru 0x2a69965 (0x1d10 bytes) 2024-09-05T17:32:30.416 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.416 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.416 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.416 INFO:teuthology.orchestra.run.smithi050.stdout:5757 punch from 0xaaaac68 to 0xaab77de, (0xcb76 bytes) 2024-09-05T17:32:30.416 INFO:teuthology.orchestra.run.smithi050.stdout:5758 read 0x7bce213 thru 0x7bd50c1 (0x6eaf bytes) 2024-09-05T17:32:30.421 INFO:teuthology.orchestra.run.smithi050.stdout:5759 trunc from 0xe7bd5eb to 0xbcc6c70 2024-09-05T17:32:30.440 INFO:teuthology.orchestra.run.smithi050.stdout:5760 read 0x4409878 thru 0x440dab6 (0x423f bytes) 2024-09-05T17:32:30.441 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.441 INFO:teuthology.orchestra.run.smithi050.stdout:5765 read 0x49b7242 thru 0x49c12f7 (0xa0b6 bytes) 2024-09-05T17:32:30.442 INFO:teuthology.orchestra.run.smithi050.stdout:5766 write 0x233b208 thru 0x2345b23 (0xa91c bytes) 2024-09-05T17:32:30.444 INFO:teuthology.orchestra.run.smithi050.stdout:5767 read 0x496744a thru 0x496f9cb (0x8582 bytes) 2024-09-05T17:32:30.446 INFO:teuthology.orchestra.run.smithi050.stdout:5769 trunc from 0xbcc6c70 to 0xae0af17 2024-09-05T17:32:30.462 INFO:teuthology.orchestra.run.smithi050.stdout:5770 punch from 0x742cf9f to 0x74398aa, (0xc90b bytes) 2024-09-05T17:32:30.480 INFO:teuthology.orchestra.run.smithi050.stdout:5771 write 0xd30d12b thru 0xd31490c (0x77e2 bytes) 2024-09-05T17:32:30.487 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:30.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402933683000001, 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.488 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:32:30.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.492 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402905266999994, 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:32:30.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402883341000006, 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:32:30.497 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:32:30.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:32:30.501 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402861893999997, 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.502 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:30.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402823604000005, 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.507 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:30.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402808788000002, 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.511 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:32:30.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402797589000002, 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:30.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402786750000004, 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.520 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:32:30.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:32:30.524 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402776273000001, 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.525 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:32:30.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:30.529 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402765450999993, 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:30.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:32:30.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.534 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402755051, 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.535 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:30.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402736699000002, 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:32:30.539 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:32:30.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:32:30.543 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.402553075, 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.544 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:32:30.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.393893781000003, 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:32:30.548 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:32:30.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.552 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.393853239999999, 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.553 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:32:30.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.557 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.393813410999996, 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:32:30.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.393785936, 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.562 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:32:30.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.393747426999994, 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:32:30.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:32:30.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.393704686999996, 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.571 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:32:30.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.575 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.992426473000002, 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:32:30.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:30.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:30.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:32:30.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:30.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:30.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:30.583 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:30.584 INFO:teuthology.orchestra.run.smithi050.stdout:5774 trunc from 0xd31490d to 0xc212113 2024-09-05T17:32:30.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:30.586 INFO:teuthology.orchestra.run.smithi050.stdout:5775 read 0x721f4e thru 0x7313ea (0xf49d bytes) 2024-09-05T17:32:30.586 INFO:teuthology.orchestra.run.smithi050.stdout:5776 write 0x1d6d235 thru 0x1d78958 (0xb724 bytes) 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:5779 write 0x5ffd477 thru 0x5fff15f (0x1ce9 bytes) 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:5781 trunc from 0xc212113 to 0x55cfae5 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:5782 punch from 0x129e227 to 0x12a6616, (0x83ef bytes) 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:5783 write 0x33590f6 thru 0x335e038 (0x4f43 bytes) 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:5785 punch from 0x20881f1 to 0x208dc7b, (0x5a8a bytes) 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:5787 punch from 0x2ce4833 to 0x2ce9c93, (0x5460 bytes) 2024-09-05T17:32:30.587 INFO:teuthology.orchestra.run.smithi050.stdout:5789 clone 38 order 21 su 32768 sc 12 2024-09-05T17:32:30.587 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:30.582+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:30.615 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:32:30.685 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:30.682+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:30.712 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone37 from 0x55cfae5 (overlap 0x293ba26) to 0x18bd616 2024-09-05T17:32:30.752 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:30.752 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:30.753 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:30.768 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:30.809 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:30.806+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:30.838 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-05T17:32:30.888 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:30.882+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:30.939 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:30.939 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:30.939 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:30.939 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:30.939 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:30.952 INFO:teuthology.orchestra.run.smithi050.stdout:5790 read 0x49d6e5c thru 0x49dac92 (0x3e37 bytes) 2024-09-05T17:32:30.954 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:30.955 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:30.955 INFO:teuthology.orchestra.run.smithi050.stdout:5793 punch from 0x41e78b6 to 0x41f183c, (0x9f86 bytes) 2024-09-05T17:32:30.961 INFO:teuthology.orchestra.run.smithi050.stdout:5794 trunc from 0x55cfae5 to 0x47ae6eb 2024-09-05T17:32:31.008 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:31.002+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:31.051 INFO:teuthology.orchestra.run.smithi050.stdout:5795 read 0x7e091f thru 0x7e72ec (0x69ce bytes) 2024-09-05T17:32:31.060 INFO:teuthology.orchestra.run.smithi050.stdout:5796 trunc from 0x47ae6eb to 0xa4ae16f 2024-09-05T17:32:31.069 INFO:teuthology.orchestra.run.smithi050.stdout:5797 read 0x78d4c23 thru 0x78dab8a (0x5f68 bytes) 2024-09-05T17:32:31.069 INFO:teuthology.orchestra.run.smithi050.stdout:5798 write 0x4a92b2e thru 0x4a96edf (0x43b2 bytes) 2024-09-05T17:32:31.086 INFO:teuthology.orchestra.run.smithi050.stdout:5799 write 0xd118e10 thru 0xd1260e3 (0xd2d4 bytes) 2024-09-05T17:32:31.089 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:31.086+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:31.093 INFO:teuthology.orchestra.run.smithi050.stdout:5800 trunc from 0xd1260e4 to 0xbf0035b 2024-09-05T17:32:31.114 INFO:teuthology.orchestra.run.smithi050.stdout:5801 clone 39 order 22 su 131072 sc 2 2024-09-05T17:32:31.120 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78320 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2920448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.282215815000001, 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064661845999999995, 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.121 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78320 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:31.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837282+0000", 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837285+0000", 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837296+0000", 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.11e-05 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837302+0000", 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6939999999999998e-06 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901848+0000", 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064545672999999998 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901890+0000", 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1853000000000001e-05 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901943+0000", 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3362999999999997e-05 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.125 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.282161719000001, 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:32:31.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.282116260000002, 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.282088072999997, 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.135 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:32:31.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.282060461999997, 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:32:31.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.282033746000003, 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:32:31.145 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:32:31.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.149 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.282004835000002, 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.150 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:32:31.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.154 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281973604000001, 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:32:31.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281943581999997, 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:31.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:32:31.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281916686000002, 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:32:31.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:32:31.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.168 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281819945999999, 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:32:31.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:32:31.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281789341, 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:32:31.173 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:31.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:32:31.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.177 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281762012999998, 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.178 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:32:31.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.182 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281735126000001, 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:32:31.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281707814999997, 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.187 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:32:31.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:32:31.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.281370631000001, 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:32:31.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:32:31.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:32:31.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.280353552000001, 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.197 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:32:31.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:32:31.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.280244043000003, 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.202 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:32:31.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.280177561999999, 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.207 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:32:31.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 34.280117775999997, 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:32:31.211 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:32:31.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.215 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.216 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.216 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:31.216 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:31.216 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:31.218 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:31.218 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:31.216+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:31.318 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:31.314+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:31.391 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:31.391 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:31.391 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:31.405 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:31.449 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:31.446+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:31.492 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:31.537 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:31.534+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:31.569 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:31.570 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:31.570 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:31.570 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:31.570 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:31.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:31.629 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:31.626+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:31.650 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:31.650 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:31.670 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:31.671 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:31.690 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:31.690 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:31.702 INFO:teuthology.orchestra.run.smithi050.stdout:flattening image image_client.0-clone38 2024-09-05T17:32:31.721 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:31.721 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:31.722 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:31.720+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:31.766 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:31.767 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:31.768 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:31.792 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:31.792 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:31.807 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:31.808 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:31.822 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:31.839 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:31.839 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:31.840 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:31.834+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:31.844 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:31.844 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:31.924 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:31.920+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:31.977 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:31.977 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:31.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:32.010 INFO:teuthology.orchestra.run.smithi110.stdout: marking collection for removal 2024-09-05T17:32:32.011 INFO:teuthology.orchestra.run.smithi110.stdout:setting '_remove' omap key 2024-09-05T17:32:32.011 INFO:teuthology.orchestra.run.smithi110.stdout:finish_remove_pgs 3.c_head removing 3.c 2024-09-05T17:32:32.016 INFO:teuthology.orchestra.run.smithi110.stdout:Remove successful 2024-09-05T17:32:32.024 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:32.020+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:32.047 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-05T17:32:32.095 INFO:teuthology.orchestra.run.smithi050.stdout:5802 punch from 0x5521e87 to 0x5531e5b, (0xffd4 bytes) 2024-09-05T17:32:32.099 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:32.099 INFO:teuthology.orchestra.run.smithi050.stdout:5805 read 0x5de9320 thru 0x5dec1f0 (0x2ed1 bytes) 2024-09-05T17:32:32.099 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:32.100 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:32.110 INFO:teuthology.orchestra.run.smithi050.stdout:5808 trunc from 0xbf0035b to 0x488decb 2024-09-05T17:32:32.125 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:32.122+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:32.135 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:32.136 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:32.147 INFO:teuthology.orchestra.run.smithi050.stdout:5809 writesame 0xd14ae0f thru 0xd155d50 data_size 0x1(0xaf42 bytes) 2024-09-05T17:32:32.147 INFO:teuthology.orchestra.run.smithi050.stdout:5810 write 0x8c7ed5 thru 0x8d689b (0xe9c7 bytes) 2024-09-05T17:32:32.156 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:5811 read 0xb235197 thru 0xb243e8b (0xecf5 bytes) 2024-09-05T17:32:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:32.196 INFO:teuthology.orchestra.run.smithi050.stdout:5815 write 0x656c53d thru 0x6570adb (0x459f bytes) 2024-09-05T17:32:32.216 INFO:teuthology.orchestra.run.smithi050.stdout:5816 trunc from 0xd155d51 to 0x50e5c9b 2024-09-05T17:32:32.225 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:32.224+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:32.230 INFO:teuthology.orchestra.run.smithi050.stdout:5817 punch from 0x2c4e6bc to 0x2c58429, (0x9d6d bytes) 2024-09-05T17:32:32.230 INFO:teuthology.orchestra.run.smithi050.stdout:5819 read 0x12dbb52 thru 0x12de7ad (0x2c5c bytes) 2024-09-05T17:32:32.245 INFO:teuthology.orchestra.run.smithi050.stdout:5821 trunc from 0x50e5c9b to 0xddefbd7 2024-09-05T17:32:32.253 INFO:teuthology.orchestra.run.smithi050.stdout:5822 write 0xa48626b thru 0xa4949f3 (0xe789 bytes) 2024-09-05T17:32:32.270 INFO:teuthology.orchestra.run.smithi050.stdout:5824 write 0xeb57eca thru 0xeb6593f (0xda76 bytes) 2024-09-05T17:32:32.285 INFO:teuthology.orchestra.run.smithi050.stdout:5825 writesame 0xec1360d thru 0xec1c069 data_size 0x1(0x8a5d bytes) 2024-09-05T17:32:32.287 INFO:teuthology.orchestra.run.smithi050.stdout:5826 writesame 0xe4dd037 thru 0xe4ea3ce data_size 0x94(0xd398 bytes) 2024-09-05T17:32:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:5830 read 0x30b3978 thru 0x30b49a6 (0x102f bytes) 2024-09-05T17:32:32.294 INFO:teuthology.orchestra.run.smithi050.stdout:5831 writesame 0x23dbc1a thru 0x23e1df4 data_size 0x29(0x61db bytes) 2024-09-05T17:32:32.327 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:32.322+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:32.337 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:32.353 INFO:teuthology.orchestra.run.smithi050.stdout:5832 trunc from 0xec1c06a to 0x959ff5f 2024-09-05T17:32:32.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:32.365 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:32.365 INFO:teuthology.orchestra.run.smithi050.stdout:5835 punch from 0x56f7880 to 0x57033d6, (0xbb56 bytes) 2024-09-05T17:32:32.376 INFO:teuthology.orchestra.run.smithi050.stdout:5836 writesame 0xbcc5b37 thru 0xbccc79c data_size 0x7d(0x6c66 bytes) 2024-09-05T17:32:32.376 INFO:teuthology.orchestra.run.smithi050.stdout:5837 writesame 0x2b1d279 thru 0x2b28aeb data_size 0x1(0xb873 bytes) 2024-09-05T17:32:32.428 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:32.424+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:32.448 INFO:teuthology.orchestra.run.smithi050.stdout:5838 trunc from 0xbccc79d to 0x51ceb0a 2024-09-05T17:32:32.487 INFO:teuthology.orchestra.run.smithi050.stdout:5839 write 0xe77b5bb thru 0xe782aa6 (0x74ec bytes) 2024-09-05T17:32:32.489 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:32.489 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:32.493 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:32.493 INFO:teuthology.orchestra.run.smithi050.stdout:5841 punch from 0xe5c03a7 to 0xe5c3405, (0x305e bytes) 2024-09-05T17:32:32.493 INFO:teuthology.orchestra.run.smithi050.stdout:5842 writesame 0x6a7e074 thru 0x6a807cb data_size 0x4(0x2758 bytes) 2024-09-05T17:32:32.501 INFO:teuthology.orchestra.run.smithi050.stdout:5843 punch from 0x48f71a9 to 0x4904d16, (0xdb6d bytes) 2024-09-05T17:32:32.501 INFO:teuthology.orchestra.run.smithi050.stdout:5844 read 0xc762707 thru 0xc76a43f (0x7d39 bytes) 2024-09-05T17:32:32.501 INFO:teuthology.orchestra.run.smithi050.stdout:5845 read 0x303a531 thru 0x3047afa (0xd5ca bytes) 2024-09-05T17:32:32.502 INFO:teuthology.orchestra.run.smithi050.stdout:5847 read 0x6763282 thru 0x676eb57 (0xb8d6 bytes) 2024-09-05T17:32:32.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:32.521 INFO:teuthology.orchestra.run.smithi050.stdout:5848 trunc from 0xe782aa7 to 0x77f7d67 2024-09-05T17:32:32.545 INFO:teuthology.orchestra.run.smithi050.stdout:5849 punch from 0x3250095 to 0x3259c44, (0x9baf bytes) 2024-09-05T17:32:32.549 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:32.548+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:32.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.c.5 2024-09-05T17:32:32.573 INFO:teuthology.orchestra.run.smithi050.stdout:5850 write 0xd039b16 thru 0xd047895 (0xdd80 bytes) 2024-09-05T17:32:32.582 INFO:teuthology.orchestra.run.smithi050.stdout:5852 read 0xb8d5bfd thru 0xb8e2be5 (0xcfe9 bytes) 2024-09-05T17:32:32.583 INFO:teuthology.orchestra.run.smithi050.stdout:5853 write 0x6e06332 thru 0x6e0eeb8 (0x8b87 bytes) 2024-09-05T17:32:32.586 INFO:teuthology.orchestra.run.smithi050.stdout:5854 punch from 0x986b42d to 0x986e7cd, (0x33a0 bytes) 2024-09-05T17:32:32.587 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:32.587 INFO:teuthology.orchestra.run.smithi050.stdout:5856 punch from 0xc36c2e9 to 0xc376625, (0xa33c bytes) 2024-09-05T17:32:32.587 INFO:teuthology.orchestra.run.smithi050.stdout:5858 read 0x1008ce thru 0x109956 (0x9089 bytes) 2024-09-05T17:32:32.587 INFO:teuthology.orchestra.run.smithi050.stdout:5859 write 0x2b93fb5 thru 0x2b99ee7 (0x5f33 bytes) 2024-09-05T17:32:32.591 INFO:teuthology.orchestra.run.smithi050.stdout:5861 write 0x99a6b23 thru 0x99aab06 (0x3fe4 bytes) 2024-09-05T17:32:32.597 INFO:teuthology.orchestra.run.smithi050.stdout:5862 write 0xadcd16d thru 0xadd79b9 (0xa84d bytes) 2024-09-05T17:32:32.619 INFO:teuthology.orchestra.run.smithi050.stdout:5863 trunc from 0xd047896 to 0x801a316 2024-09-05T17:32:32.629 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:32.626+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:32.640 INFO:teuthology.orchestra.run.smithi050.stdout:5865 read 0x346d51c thru 0x347b4aa (0xdf8f bytes) 2024-09-05T17:32:32.641 INFO:teuthology.orchestra.run.smithi050.stdout:5866 write 0xb19581 thru 0xb237b4 (0xa234 bytes) 2024-09-05T17:32:32.642 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:32:32.670 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:32.670 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:32.684 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:32.686 INFO:teuthology.orchestra.run.smithi050.stdout:5867 punch from 0x41653d6 to 0x41658ee, (0x518 bytes) 2024-09-05T17:32:32.687 INFO:teuthology.orchestra.run.smithi050.stdout:5868 writesame 0x2dbde76 thru 0x2dc7d0b data_size 0x35(0x9e96 bytes) 2024-09-05T17:32:32.689 INFO:teuthology.orchestra.run.smithi050.stdout:5870 clone 40 order 23 su 65536 sc 14 2024-09-05T17:32:32.730 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:32.728+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:32.800 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:32.800 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:32.815 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:32.830 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:32.826+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:32.932 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:32.928+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:32.978 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:32.979 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:32.993 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:33.033 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:33.030+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:33.134 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:33.132+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:33.156 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:33.157 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:33.170 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:33.236 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:33.230+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:33.337 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:33.334+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:33.343 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:33.343 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:33.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:33.438 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:33.434+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:33.480 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:33.480 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:33.493 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:33.539 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:33.538+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:33.616 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:33.616 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:33.630 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:33.631 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:32:33.639 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:33.634+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:33.740 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:33.734+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:33.750 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone39 from 0x801a316 (overlap 0x488decb) to 0x741647 2024-09-05T17:32:33.764 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:33.764 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:33.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:33.841 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:33.840+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:33.845 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:33.943 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:33.938+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:33.964 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:33.965 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:33.980 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:34.018 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:34.018 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:34.035 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:34.035 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:34.039 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-05T17:32:34.044 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:34.040+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:34.053 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:34.053 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:34.070 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:34.070 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:34.089 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:34.089 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:34.109 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:34.109 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:34.133 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:34.134 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:34.138 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:34.139 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:34.145 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:34.144+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:34.150 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:34.152 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:34.152 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:34.176 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:34.261 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:34.258+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16611 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6606848~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257182975000006, 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053110599000000001, 2024-09-05T17:32:34.342 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16611 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082763+0000", 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.8800000000000003e-07 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082770+0000", 2024-09-05T17:32:34.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9500000000000004e-06 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082777+0000", 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7469999999999999e-06 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082782+0000", 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7210000000000002e-06 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135744+0000", 2024-09-05T17:32:34.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.052962357000000002 2024-09-05T17:32:34.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135805+0000", 2024-09-05T17:32:34.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0645e-05 2024-09-05T17:32:34.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135874+0000", 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8690999999999997e-05 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257154559, 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:34.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257132632999998, 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:32:34.352 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:32:34.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:32:34.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.356 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257111186000003, 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.357 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:32:34.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:32:34.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:34.361 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257072895999997, 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257058079999993, 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.366 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.370 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257046880999994, 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:34.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257036041999996, 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:32:34.375 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:32:34.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:32:34.379 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257025565000006, 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.380 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257014742999999, 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:34.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.257004343000006, 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:32:34.389 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:32:34.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:32:34.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.256985990999993, 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.394 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:32:34.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.256802367000006, 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:32:34.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:32:34.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.248143072999994, 2024-09-05T17:32:34.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:34.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:32:34.407 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.248102532000004, 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.408 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:32:34.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:32:34.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:32:34.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:32:34.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:32:34.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.248062703000002, 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:32:34.413 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:32:34.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.417 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.248035228000006, 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.422 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.247996719, 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:32:34.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:32:34.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.247953979000002, 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.427 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:32:34.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:32:34.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.846675765000001, 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.432 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:32:34.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:32:34.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.439 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.440 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:34.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:34.442 INFO:teuthology.orchestra.run.smithi050.stdout:5871 write 0x157809c thru 0x158203f (0x9fa4 bytes) 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:get_pg_num_history pg_num_history pg_num_history(e103 pg_nums {1={16=1},2={19=8},3={24=32}} deleted_pools ) 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:Importing pgid 3.c 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:302a726f:::rbd_data.114070605229.0000000000000036:4# 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:302a726f:::rbd_data.114070605229.0000000000000036:head# 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 4=[]:{4=[4]} 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:30396c86:::rbd_data.114070605229.0000000000000122:4# 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:30396c86:::rbd_data.114070605229.0000000000000122:head# 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 4=[]:{4=[4]} 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:31bc3250:::rbd_data.1140c66ba109.0000000000000004:23# 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:31bc3250:::rbd_data.1140c66ba109.0000000000000004:head# 2024-09-05T17:32:34.447 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 23=[]:{23=[23]} 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:32928108:::rbd_data.114070605229.0000000000000127:4# 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:32928108:::rbd_data.114070605229.0000000000000127:head# 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 4=[]:{4=[4]} 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:32ac2821:::rbd_data.11402b8b869e.0000000000000009:head# 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:32cc3091:::rbd_data.1140e4bbd9e2.00000000000000af:head# 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:3308375d:::rbd_data.1140f0d7121a.0000000000000015:10# 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:3308375d:::rbd_data.1140f0d7121a.0000000000000015:head# 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 10=[]:{10=[10]} 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:33251906:::rbd_data.1140f3505917.0000000000000002:head# 2024-09-05T17:32:34.448 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 9=[]:{} 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:335df081:::rbd_data.114070605229.000000000000009a:4# 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:335df081:::rbd_data.114070605229.000000000000009a:head# 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 4=[]:{4=[4]} 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:337cf9fe:::rbd_data.1140e4bbd9e2.00000000000000a7:head# 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:33840839:::rbd_data.114076cffc4f.0000000000000007:head# 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:33baf03c:::rbd_data.1140e4bbd9e2.000000000000000b:head# 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:33d98fe8:::rbd_data.1140e4bbd9e2.00000000000001f9:head# 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:3454b815:::rbd_data.11402e02f3c2.0000000000000039:head# 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:34579730:::rbd_object_map.11402e02f3c2.000000000000001b:head# 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:34dc32f7:::rbd_data.1140c66ba109.0000000000000003:23# 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:34dc32f7:::rbd_data.1140c66ba109.0000000000000003:head# 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 23=[]:{23=[23]} 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:3548b700:::rbd_data.114070605229.000000000000007b:4# 2024-09-05T17:32:34.450 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:3548b700:::rbd_data.114070605229.000000000000007b:head# 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 4=[]:{4=[4]} 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:35999e1c:::rbd_data.1140e4bbd9e2.000000000000013d:head# 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:35e8a807:::rbd_data.1140c66ba109.0000000000000007:23# 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:35e8a807:::rbd_data.1140c66ba109.0000000000000007:head# 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 23=[]:{23=[23]} 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:35f84864:::rbd_data.1140f3505917.0000000000000025:9# 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:35f84864:::rbd_data.1140f3505917.0000000000000025:head# 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 9=[]:{9=[9]} 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:36427e6a:::rbd_data.1140e4bbd9e2.0000000000000030:head# 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.451 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:36b37c76:::rbd_data.1140f0d7121a.000000000000000f:10# 2024-09-05T17:32:34.452 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:34.440+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:36b37c76:::rbd_data.1140f0d7121a.000000000000000f:head# 2024-09-05T17:32:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 10=[]:{10=[10]} 2024-09-05T17:32:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:375190e0:::rbd_data.114070605229.0000000000000030:4# 2024-09-05T17:32:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:375190e0:::rbd_data.114070605229.0000000000000030:head# 2024-09-05T17:32:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 4=[]:{4=[4]} 2024-09-05T17:32:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:3779f3e6:::rbd_data.1140102563a7.0000000000000004:head# 2024-09-05T17:32:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.453 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:3793002e:::rbd_data.11402e02f3c2.0000000000000300:head# 2024-09-05T17:32:34.454 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.454 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:3799faa0:::rbd_data.1140e4bbd9e2.0000000000000065:head# 2024-09-05T17:32:34.454 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.454 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:37b66259:::rbd_data.1140cca6b281.0000000000000001:16# 2024-09-05T17:32:34.455 INFO:teuthology.orchestra.run.smithi050.stdout:5872 read 0x6023dbb thru 0x602f803 (0xba49 bytes) 2024-09-05T17:32:34.455 INFO:teuthology.orchestra.run.smithi050.stdout:5873 write 0x2397e4c thru 0x23997fb (0x19b0 bytes) 2024-09-05T17:32:34.464 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:37b66259:::rbd_data.1140cca6b281.0000000000000001:head# 2024-09-05T17:32:34.464 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 16=[]:{16=[16]} 2024-09-05T17:32:34.465 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:37ca48c5:::rbd_data.1140e4bbd9e2.0000000000000300:head# 2024-09-05T17:32:34.465 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.465 INFO:teuthology.orchestra.run.smithi110.stdout:Write #3:37e56a0e:::rbd_data.1140e4bbd9e2.00000000000000d3:head# 2024-09-05T17:32:34.465 INFO:teuthology.orchestra.run.smithi110.stdout:snapset 0=[]:{} 2024-09-05T17:32:34.466 INFO:teuthology.orchestra.run.smithi110.stdout:write_pg epoch 103 info 3.c( v 103'266 (0'0,103'266] local-lis/les=24/25 n=42 ec=24/24 lis/c=24/24 les/c/f=25/25/0 sis=24) 2024-09-05T17:32:34.468 INFO:teuthology.orchestra.run.smithi110.stdout:Import successful 2024-09-05T17:32:34.486 INFO:teuthology.orchestra.run.smithi050.stdout:5874 write 0x1665d71 thru 0x166bbf2 (0x5e82 bytes) 2024-09-05T17:32:34.496 INFO:teuthology.orchestra.run.smithi050.stdout:5875 trunc from 0x801a316 to 0xd08fa2a 2024-09-05T17:32:34.504 INFO:teuthology.orchestra.run.smithi050.stdout:5881 write 0xb13292 thru 0xb208a1 (0xd610 bytes) 2024-09-05T17:32:34.538 INFO:teuthology.orchestra.run.smithi050.stdout:5882 write 0xbdb59ae thru 0xbdc4764 (0xedb7 bytes) 2024-09-05T17:32:34.541 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:34.538+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:34.544 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:34.544 INFO:teuthology.orchestra.run.smithi050.stdout:5884 writesame 0x48d115f thru 0x48da4d2 data_size 0x2(0x9374 bytes) 2024-09-05T17:32:34.604 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:34.604 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:34.604 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:34.604 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:34.608 INFO:teuthology.orchestra.run.smithi050.stdout:5885 trunc from 0xd08fa2a to 0x134713 2024-09-05T17:32:34.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:34.665 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:34.662+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:34.726 INFO:teuthology.orchestra.run.smithi050.stdout:5886 clone 41 order 23 su 1048576 sc 6 2024-09-05T17:32:34.743 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:34.740+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:34.798 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:34.798 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:34.798 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:34.799 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:34.799 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:34.813 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:34.857 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:34.854+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:34.940 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:34.940 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:34.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:34.940 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:34.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78320 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2920448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102548640000002, 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064661845999999995, 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.941 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78320 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837282+0000", 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837285+0000", 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837296+0000", 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.11e-05 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837302+0000", 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6939999999999998e-06 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901848+0000", 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064545672999999998 2024-09-05T17:32:34.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901890+0000", 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1853000000000001e-05 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901943+0000", 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3362999999999997e-05 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102494544000002, 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:32:34.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:32:34.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:32:34.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:34.950 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102449085000003, 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:32:34.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:32:34.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:32:34.955 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.955 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.955 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.956 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.956 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:34.956 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102420897999998, 2024-09-05T17:32:34.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:32:34.956 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:32:34.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.958 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:34.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:34.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:32:34.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:32:34.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:32:34.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:32:34.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:32:34.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:32:34.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:32:34.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:32:34.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102393286999998, 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:32:34.966 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:34.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:32:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:32:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:32:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:32:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:32:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:32:34.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:32:34.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102366570999997, 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:32:34.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:32:34.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:32:34.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102337660000003, 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:32:34.977 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:32:34.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102306429000002, 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:32:34.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:32:34.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:32:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:32:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:32:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:32:34.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:32:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:32:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:32:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:32:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:32:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:32:34.988 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.989 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102276406999998, 2024-09-05T17:32:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:32:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:32:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:32:34.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.995 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102249510999997, 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:34.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:34.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:32:34.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:35.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102152771, 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:35.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:32:35.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.004 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102122166000001, 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:32:35.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:35.009 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102094837999999, 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:35.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:32:35.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102067951000002, 2024-09-05T17:32:35.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:35.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:32:35.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.102040639999998, 2024-09-05T17:32:35.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:35.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:32:35.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.024 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:35.025 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.101703456000003, 2024-09-05T17:32:35.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:32:35.025 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.025 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.025 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.025 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:32:35.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:32:35.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.100686377000002, 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:32:35.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:32:35.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.100576867999997, 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:32:35.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:32:35.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.100510387, 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:32:35.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.100450600999999, 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:32:35.045 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:32:35.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.050 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.050 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.050 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.050 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:35.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /var/log/ceph/exp.3.c.5 2024-09-05T17:32:35.052 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:35.048+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:35.052 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:35.153 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:35.146+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:35.224 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:35.224 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:35.224 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:35.224 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:35.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:35.282 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:35.278+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:35.355 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:35.352+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:35.410 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:35.410 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:35.410 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:35.410 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:35.410 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:35.425 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:35.455 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:35.456+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:35.549 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:35.549 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:35.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:35.549 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:35.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 105.30126244, 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:32:35.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:32:35.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:32:35.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:32:35.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:35.555 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 75.780319590000005, 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:32:35.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 71.576361689999999, 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.560 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:32:35.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:32:35.564 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 71.338366860999997, 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.565 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:32:35.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 71.325352320999997, 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.570 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:32:35.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 71.323088390999999, 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:32:35.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:32:35.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:32:35.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:32:35.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 71.320996617000006, 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.581 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:32:35.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51735 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'202, mlcod=54'198)", 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 67.409682654999997, 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032394590000000001, 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:35.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137895+0000", 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4780000000000001e-06 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137904+0000", 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137926+0000", 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1013999999999999e-05 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137939+0000", 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.342e-05 2024-09-05T17:32:35.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138024+0000", 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5167000000000006e-05 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138055+0000", 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0982000000000003e-05 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.140997+0000", 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029416329999999999 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141133+0000", 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013600799999999999 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:35.590 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 67.406208147000001, 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:32:35.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.014067159, 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:35.595 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:32:35.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.992429010000002, 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.599 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:32:35.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.602 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.603 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.416229129000001, 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:35.604 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.605 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.606 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:32:35.607 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.763231013999999, 2024-09-05T17:32:35.608 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.609 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.610 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.611 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:32:35.612 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.762625165999999, 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.613 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.614 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:32:35.615 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.616 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.617 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.762059235000002, 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.618 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.619 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:32:35.620 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.621 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:32:35.622 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.761404294000002, 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.623 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.624 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:32:35.625 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.626 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:35.627 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.760703905, 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:35.628 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.629 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.630 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:32:35.631 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.759435289000002, 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.632 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:35.633 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.634 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.635 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:100058 3.18 e87/86 3:1ad21172:::rbd_data.1140b9781f.0000000000000010:head v 87'192, mlcod=0'0)", 2024-09-05T17:32:35.636 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.610239432, 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003565824, 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.637 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937337+0000", 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7899999999999997e-07 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938048+0000", 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00071111099999999995 2024-09-05T17:32:35.638 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938066+0000", 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7958e-05 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938078+0000", 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1592e-05 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.639 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938155+0000", 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7541999999999997e-05 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938186+0000", 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0756000000000002e-05 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940856+0000", 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026697460000000002 2024-09-05T17:32:35.640 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940902+0000", 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.634e-05 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:117572 3.4 e110/24 3:2566fea6:::rbd_data.1140bb1b3dec.000000000000001f:head v 110'665, mlcod=108'663)", 2024-09-05T17:32:35.641 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.5240343880000005, 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049701290000000002, 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.642 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023543+0000", 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024795+0000", 2024-09-05T17:32:35.643 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001251903 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024824+0000", 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9431999999999999e-05 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024837+0000", 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2381000000000001e-05 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.644 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024909+0000", 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2520000000000004e-05 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024933+0000", 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3357999999999999e-05 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028413+0000", 2024-09-05T17:32:35.645 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034808370000000001 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028512+0000", 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8238000000000004e-05 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:35.646 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:35.648 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:35.648 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:35.644+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:35.664 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:32:35.749 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:35.746+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:35.789 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:35.789 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:35.802 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone40 from 0x134713 (overlap 0x134713) to 0x115991 2024-09-05T17:32:35.806 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:35.854 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:35.850+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:35.922 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-05T17:32:35.951 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:35.946+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:35.973 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:35.974 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:35.974 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:35.974 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:35.974 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:35.994 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:36.003 INFO:teuthology.orchestra.run.smithi050.stdout:5887 write 0xd0fde17 thru 0xd10d07e (0xf268 bytes) 2024-09-05T17:32:36.028 INFO:teuthology.orchestra.run.smithi050.stdout:5888 trunc from 0xd10d07f to 0x19a5494 2024-09-05T17:32:36.051 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:36.046+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:36.062 INFO:teuthology.orchestra.run.smithi050.stdout:5890 write 0x18df553 thru 0x18e9f67 (0xaa15 bytes) 2024-09-05T17:32:36.066 INFO:teuthology.orchestra.run.smithi050.stdout:5891 punch from 0x1008e33 to 0x10114c7, (0x8694 bytes) 2024-09-05T17:32:36.066 INFO:teuthology.orchestra.run.smithi050.stdout:5892 read 0x41a14f thru 0x42619c (0xc04e bytes) 2024-09-05T17:32:36.066 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:36.067 INFO:teuthology.orchestra.run.smithi050.stdout:5895 write 0x8551ab thru 0x85a07e (0x4ed4 bytes) 2024-09-05T17:32:36.089 INFO:teuthology.orchestra.run.smithi050.stdout:5896 write 0x4122a0b thru 0x41276cc (0x4cc2 bytes) 2024-09-05T17:32:36.095 INFO:teuthology.orchestra.run.smithi050.stdout:5897 write 0x3e0a970 thru 0x3e13806 (0x8e97 bytes) 2024-09-05T17:32:36.103 INFO:teuthology.orchestra.run.smithi050.stdout:5898 read 0x1f6f0d4 thru 0x1f7be2c (0xcd59 bytes) 2024-09-05T17:32:36.109 INFO:teuthology.orchestra.run.smithi050.stdout:5899 trunc from 0x41276cd to 0xe4c75a 2024-09-05T17:32:36.135 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:36.135 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:36.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:36.135 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:36.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.135 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:36.135 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 96.922670405999995, 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:36.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 96.921581907999993, 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:36.140 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:36.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 96.911239694000002, 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:36.145 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 96.910634294999994, 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.150 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:36.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.154 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 96.909575167, 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:36.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:36.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 96.907273795999998, 2024-09-05T17:32:36.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:36.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.164 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 96.906182405999999, 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.169 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 96.905164644999999, 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:36.174 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 29.129311031, 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:32:36.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:32:36.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.181 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 19.536880061000002, 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.182 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.185 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:36.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.199628217000001, 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:32:36.189 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:36.190 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.191 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.192 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:32:36.193 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.197654006, 2024-09-05T17:32:36.194 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.195 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.196 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.197 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.198 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.197624128000001, 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.199 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.200 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.201 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:32:36.202 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:32:36.203 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.204 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.194713789000001, 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.205 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.206 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.207 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.208 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.209 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.194373125999999, 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.210 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.211 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:32:36.212 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:32:36.213 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.214 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.192177654000002, 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.215 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.216 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:32:36.217 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:32:36.218 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.219 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.187489243999998, 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:32:36.220 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:32:36.221 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.222 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.223 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.224 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.184495434999999, 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.225 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:36.226 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.227 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.228 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.229 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.179559783999999, 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.230 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.231 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.232 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:32:36.233 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 16.176004382999999, 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:32:36.234 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.235 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:32:36.236 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.237 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:32:36.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:36.239 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:36.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:36.241 INFO:teuthology.orchestra.run.smithi050.stdout:5901 trunc from 0xe4c75a to 0xabd35f7 2024-09-05T17:32:36.242 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:36.242 INFO:teuthology.orchestra.run.smithi050.stdout:5902 read 0x16d70f5 thru 0x16daa60 (0x396c bytes) 2024-09-05T17:32:36.242 INFO:teuthology.orchestra.run.smithi050.stdout:5905 writesame 0x982adc4 thru 0x9837e4e data_size 0x1(0xd08b bytes) 2024-09-05T17:32:36.242 INFO:teuthology.orchestra.run.smithi050.stdout:5906 read 0x45e197d thru 0x45e6969 (0x4fed bytes) 2024-09-05T17:32:36.243 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:36.240+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:36.248 INFO:teuthology.orchestra.run.smithi050.stdout:5907 trunc from 0xabd35f7 to 0xe64c93b 2024-09-05T17:32:36.262 INFO:teuthology.orchestra.run.smithi050.stdout:5908 write 0x4b7f3f1 thru 0x4b8d978 (0xe588 bytes) 2024-09-05T17:32:36.268 INFO:teuthology.orchestra.run.smithi050.stdout:5909 punch from 0xb84efb1 to 0xb8546ba, (0x5709 bytes) 2024-09-05T17:32:36.283 INFO:teuthology.orchestra.run.smithi050.stdout:5912 trunc from 0xe64c93b to 0x73086ad 2024-09-05T17:32:36.315 INFO:teuthology.orchestra.run.smithi050.stdout:5913 writesame 0xa896661 thru 0xa89f760 data_size 0x1d(0x9100 bytes) 2024-09-05T17:32:36.315 INFO:teuthology.orchestra.run.smithi050.stdout:5914 read 0x5003a3d thru 0x500fb0b (0xc0cf bytes) 2024-09-05T17:32:36.315 INFO:teuthology.orchestra.run.smithi050.stdout:5915 read 0x8c62e56 thru 0x8c65a27 (0x2bd2 bytes) 2024-09-05T17:32:36.331 INFO:teuthology.orchestra.run.smithi050.stdout:5916 trunc from 0xa89f761 to 0x3962766 2024-09-05T17:32:36.343 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:36.340+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:36.348 INFO:teuthology.orchestra.run.smithi050.stdout:5917 read 0x1937fcd thru 0x1943dc9 (0xbdfd bytes) 2024-09-05T17:32:36.349 INFO:teuthology.orchestra.run.smithi050.stdout:5918 read 0x3221d23 thru 0x3228ff7 (0x72d5 bytes) 2024-09-05T17:32:36.349 INFO:teuthology.orchestra.run.smithi050.stdout:5919 read 0x1bdfd2 thru 0x1c4521 (0x6550 bytes) 2024-09-05T17:32:36.364 INFO:teuthology.orchestra.run.smithi050.stdout:5922 write 0x4cac555 thru 0x4cb34a3 (0x6f4f bytes) 2024-09-05T17:32:36.378 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:36.379 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:36.379 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:36.379 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:36.401 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:36.410 INFO:teuthology.orchestra.run.smithi050.stdout:5923 writesame 0xe61c483 thru 0xe629c3b data_size 0x19(0xd7b9 bytes) 2024-09-05T17:32:36.410 INFO:teuthology.orchestra.run.smithi050.stdout:5924 read 0x7411d46 thru 0x7412b11 (0xdcc bytes) 2024-09-05T17:32:36.411 INFO:teuthology.orchestra.run.smithi050.stdout:5925 write 0x1812050 thru 0x1812bf1 (0xba2 bytes) 2024-09-05T17:32:36.411 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:36.411 INFO:teuthology.orchestra.run.smithi050.stdout:5928 write 0x4ab56e3 thru 0x4abc948 (0x7266 bytes) 2024-09-05T17:32:36.413 INFO:teuthology.orchestra.run.smithi050.stdout:5930 read 0x4642ef9 thru 0x464542f (0x2537 bytes) 2024-09-05T17:32:36.413 INFO:teuthology.orchestra.run.smithi050.stdout:5931 read 0x8d665b1 thru 0x8d70b1a (0xa56a bytes) 2024-09-05T17:32:36.413 INFO:teuthology.orchestra.run.smithi050.stdout:5934 punch from 0x905407e to 0x905540b, (0x138d bytes) 2024-09-05T17:32:36.413 INFO:teuthology.orchestra.run.smithi050.stdout:5935 punch from 0x577376 to 0x586336, (0xefc0 bytes) 2024-09-05T17:32:36.413 INFO:teuthology.orchestra.run.smithi050.stdout:5936 punch from 0xe55b0ec to 0xe56aac6, (0xf9da bytes) 2024-09-05T17:32:36.413 INFO:teuthology.orchestra.run.smithi050.stdout:5937 write 0x326753b thru 0x32725f9 (0xb0bf bytes) 2024-09-05T17:32:36.413 INFO:teuthology.orchestra.run.smithi050.stdout:5938 punch from 0x432da65 to 0x433a165, (0xc700 bytes) 2024-09-05T17:32:36.414 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:36.414 INFO:teuthology.orchestra.run.smithi050.stdout:5940 write 0x266223c thru 0x2666c1d (0x49e2 bytes) 2024-09-05T17:32:36.414 INFO:teuthology.orchestra.run.smithi050.stdout:5941 write 0xbe60f70 thru 0xbe64ba1 (0x3c32 bytes) 2024-09-05T17:32:36.414 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:36.414 INFO:teuthology.orchestra.run.smithi050.stdout:5943 writesame 0x1099039 thru 0x109f43f data_size 0x1(0x6407 bytes) 2024-09-05T17:32:36.415 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:36.415 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:36.434 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:36.435 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:36.443 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:36.440+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:36.445 INFO:teuthology.orchestra.run.smithi050.stdout:5944 trunc from 0xe629c3c to 0x330185b 2024-09-05T17:32:36.454 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:36.454 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:36.473 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:36.473 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:36.475 INFO:teuthology.orchestra.run.smithi050.stdout:5945 trunc from 0x330185b to 0x8b8069d 2024-09-05T17:32:36.483 INFO:teuthology.orchestra.run.smithi050.stdout:5946 read 0x6533d00 thru 0x6538728 (0x4a29 bytes) 2024-09-05T17:32:36.483 INFO:teuthology.orchestra.run.smithi050.stdout:5947 punch from 0x84d5ca1 to 0x84deb71, (0x8ed0 bytes) 2024-09-05T17:32:36.483 INFO:teuthology.orchestra.run.smithi050.stdout:5949 read 0x59a2164 thru 0x59af02d (0xceca bytes) 2024-09-05T17:32:36.483 INFO:teuthology.orchestra.run.smithi050.stdout:5950 read 0x592030d thru 0x59243e4 (0x40d8 bytes) 2024-09-05T17:32:36.483 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:36.483 INFO:teuthology.orchestra.run.smithi050.stdout:5952 writesame 0x4672b85 thru 0x4681a28 data_size 0x12(0xeea4 bytes) 2024-09-05T17:32:36.487 INFO:teuthology.orchestra.run.smithi050.stdout:5954 writesame 0x83f3025 thru 0x83fb8a7 data_size 0x21(0x8883 bytes) 2024-09-05T17:32:36.493 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:36.493 INFO:teuthology.orchestra.run.smithi050.stdout:5956 writesame 0x5af1dde thru 0x5afdc88 data_size 0x13(0xbeab bytes) 2024-09-05T17:32:36.493 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:36.494 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:36.498 INFO:teuthology.orchestra.run.smithi050.stdout:5957 read 0x6f38e85 thru 0x6f39d2f (0xeab bytes) 2024-09-05T17:32:36.498 INFO:teuthology.orchestra.run.smithi050.stdout:5958 write 0x6993ac thru 0x6a34a1 (0xa0f6 bytes) 2024-09-05T17:32:36.501 INFO:teuthology.orchestra.run.smithi050.stdout:5961 write 0x673c6be thru 0x6743f82 (0x78c5 bytes) 2024-09-05T17:32:36.504 INFO:teuthology.orchestra.run.smithi050.stdout:5962 read 0x755a4d0 thru 0x756104f (0x6b80 bytes) 2024-09-05T17:32:36.504 INFO:teuthology.orchestra.run.smithi050.stdout:5963 punch from 0x89b2daa to 0x89b5af7, (0x2d4d bytes) 2024-09-05T17:32:36.505 INFO:teuthology.orchestra.run.smithi050.stdout:5964 write 0x65aedbf thru 0x65bd1c1 (0xe403 bytes) 2024-09-05T17:32:36.506 INFO:teuthology.orchestra.run.smithi050.stdout:5965 writesame 0x58f7f35 thru 0x58fd13c data_size 0x2a(0x5208 bytes) 2024-09-05T17:32:36.508 INFO:teuthology.orchestra.run.smithi050.stdout:5966 read 0x35dfa78 thru 0x35e1455 (0x19de bytes) 2024-09-05T17:32:36.508 INFO:teuthology.orchestra.run.smithi050.stdout:5968 write 0x285a13c thru 0x286384f (0x9714 bytes) 2024-09-05T17:32:36.511 INFO:teuthology.orchestra.run.smithi050.stdout:5969 write 0x6b94cb9 thru 0x6b9b13e (0x6486 bytes) 2024-09-05T17:32:36.515 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:36.515 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:36.517 INFO:teuthology.orchestra.run.smithi050.stdout:5970 trunc from 0x8b8069d to 0xa6d325f 2024-09-05T17:32:36.526 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:36.526 INFO:teuthology.orchestra.run.smithi050.stdout:5972 punch from 0xd42aa8 to 0xd4c18a, (0x96e2 bytes) 2024-09-05T17:32:36.526 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:36.535 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:36.535 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:36.538 INFO:teuthology.orchestra.run.smithi050.stdout:5974 writesame 0xb12c6d3 thru 0xb1365f8 data_size 0xd(0x9f26 bytes) 2024-09-05T17:32:36.538 INFO:teuthology.orchestra.run.smithi050.stdout:5975 write 0x11549fc thru 0x11569b8 (0x1fbd bytes) 2024-09-05T17:32:36.541 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:36.541 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:36.551 INFO:teuthology.orchestra.run.smithi050.stdout:5976 trunc from 0xb1365f9 to 0x50ea59e 2024-09-05T17:32:36.552 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:36.546+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:36.577 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:36.577 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:36.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:36.594 INFO:teuthology.orchestra.run.smithi050.stdout:5977 writesame 0xdf4f2dd thru 0xdf5785f data_size 0x1(0x8583 bytes) 2024-09-05T17:32:36.594 INFO:teuthology.orchestra.run.smithi050.stdout:5978 write 0xbb66dac thru 0xbb68673 (0x18c8 bytes) 2024-09-05T17:32:36.621 INFO:teuthology.orchestra.run.smithi050.stdout:5979 trunc from 0xdf57860 to 0x5792dda 2024-09-05T17:32:36.640 INFO:teuthology.orchestra.run.smithi050.stdout:5980 write 0xc6562 thru 0xcbb8e (0x562d bytes) 2024-09-05T17:32:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:5981 read 0x3d77b63 thru 0x3d7909d (0x153b bytes) 2024-09-05T17:32:36.642 INFO:teuthology.orchestra.run.smithi050.stdout:5983 read 0x2af5fbc thru 0x2b0096b (0xa9b0 bytes) 2024-09-05T17:32:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:5985 punch from 0x1362054 to 0x1370baa, (0xeb56 bytes) 2024-09-05T17:32:36.643 INFO:teuthology.orchestra.run.smithi050.stdout:5986 read 0x29d81b9 thru 0x29e55b0 (0xd3f8 bytes) 2024-09-05T17:32:36.644 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:36.640+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:36.671 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:32:36.681 INFO:teuthology.orchestra.run.smithi050.stdout:5987 write 0xd4ad534 thru 0xd4b6a3b (0x9508 bytes) 2024-09-05T17:32:36.687 INFO:teuthology.orchestra.run.smithi050.stdout:5988 write 0x2a25b44 thru 0x2a2a767 (0x4c24 bytes) 2024-09-05T17:32:36.690 INFO:teuthology.orchestra.run.smithi050.stdout:5989 clone 42 order 23 su 32768 sc 9 2024-09-05T17:32:36.722 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:36.723 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:36.737 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:36.781 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:36.780+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:36.846 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:36.842+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:36.903 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:36.903 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:36.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:36.965 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:36.964+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:37.039 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:37.039 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:37.048 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:37.044+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:37.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:37.149 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:37.146+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:37.221 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:37.221 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:37.235 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:37.250 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:37.246+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:37.351 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:37.350+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:37.354 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:37.354 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:37.369 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:37.452 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:37.446+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:37.489 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:37.489 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:37.503 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:37.553 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:37.552+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:37.621 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:37.622 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:37.638 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:37.685 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:37.682+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:37.755 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:37.750+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:37.778 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:37.778 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:37.793 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:37.844 INFO:teuthology.orchestra.run.smithi050.stdout:truncating image image_client.0-clone41 from 0xd4b6a3c (overlap 0x134713) to 0xf6c0f 2024-09-05T17:32:37.856 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:37.850+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:37.957 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:37.950+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:37.975 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:37.975 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:37.991 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:38.037 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-05T17:32:38.046 INFO:teuthology.orchestra.run.smithi050.stdout:5991 punch from 0x85ef30d to 0x85f8f27, (0x9c1a bytes) 2024-09-05T17:32:38.052 INFO:teuthology.orchestra.run.smithi050.stdout:5994 read 0x6fa7a00 thru 0x6fabbdb (0x41dc bytes) 2024-09-05T17:32:38.052 INFO:teuthology.orchestra.run.smithi050.stdout:5995 read 0x6fb5a52 thru 0x6fb93ab (0x395a bytes) 2024-09-05T17:32:38.052 INFO:teuthology.orchestra.run.smithi050.stdout:compare and write disabled 2024-09-05T17:32:38.052 INFO:teuthology.orchestra.run.smithi050.stdout:5999 write 0xa4fc0d thru 0xa521e7 (0x25db bytes) 2024-09-05T17:32:38.058 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:38.056+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:38.130 INFO:teuthology.orchestra.run.smithi050.stdout:6000 trunc from 0xd4b6a3c to 0x8a4fbeb 2024-09-05T17:32:38.158 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:38.156+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:38.187 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:38.187 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:38.205 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:38.259 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:38.256+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:38.301 INFO:teuthology.orchestra.run.smithi050.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-05T17:32:38.361 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:38.354+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:38.383 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:38.383 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:38.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:38.481 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:38.478+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:38.542 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:38.562 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:38.560+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:38.579 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:38.595 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:38.665 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:38.664+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:38.696 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:32:38.703 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:38.704 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:38.725 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:38.725 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:38.760 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:38.760 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:38.764 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:38.758+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:38.778 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78320 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2920448~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.941138123999998, 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064661845999999995, 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78320 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837281+0000", 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837282+0000", 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0299999999999999e-07 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837285+0000", 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837296+0000", 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.11e-05 2024-09-05T17:32:38.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837302+0000", 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6939999999999998e-06 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901848+0000", 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064545672999999998 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901890+0000", 2024-09-05T17:32:38.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1853000000000001e-05 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901943+0000", 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3362999999999997e-05 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.941084027999999, 2024-09-05T17:32:38.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:38.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:32:38.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.941038569, 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.788 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:38.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:32:38.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.941010382000002, 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.793 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:32:38.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.797 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940982771000002, 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:38.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:32:38.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:32:38.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940956055000001, 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:32:38.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.806 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940927144, 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:32:38.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:32:38.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.811 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940895912999999, 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:38.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940865891000001, 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.816 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:32:38.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:32:38.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.820 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940838995, 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.821 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.822 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:32:38.823 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940742255000004, 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.826 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:32:38.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940711649999997, 2024-09-05T17:32:38.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:38.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:32:38.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940684322000003, 2024-09-05T17:32:38.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:32:38.839 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940657434999999, 2024-09-05T17:32:38.840 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:38.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:32:38.844 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940630124000002, 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.845 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:32:38.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.848 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:38.849 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.940292939999999, 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:32:38.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:32:38.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.939275860999999, 2024-09-05T17:32:38.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:38.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.939166352000001, 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.861 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:32:38.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.939099871000003, 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:32:38.866 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:32:38.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 41.939040085000002, 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:32:38.871 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:32:38.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:38.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.875 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:38.876 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:38.876 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:38.877 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:38.877 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:38.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:38.878 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:38.879 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:38.879 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:38.880 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:38.880 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:38.880 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:38.881 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:38.881 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:38.874+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:38.978 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:38.976+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:39.040 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:39.041 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:39.041 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:39.057 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:39.079 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:39.076+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:39.174 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:39.175 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:39.175 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:39.180 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:39.176+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:39.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:39.281 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:39.274+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:39.317 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:39.317 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:39.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.07066313599999, 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:32:39.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:39.322 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 79.549720285999996, 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:32:39.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 75.345762386000004, 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:32:39.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:32:39.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 75.107767557000003, 2024-09-05T17:32:39.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:39.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:32:39.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 75.094753017000002, 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:32:39.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:32:39.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:32:39.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:32:39.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:32:39.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:32:39.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.341 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.342 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 75.092489087000004, 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:32:39.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 75.090397312999997, 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51735 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'202, mlcod=54'198)", 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 71.179083351000003, 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032394590000000001, 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137893+0000", 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137895+0000", 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4780000000000001e-06 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137904+0000", 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137926+0000", 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1013999999999999e-05 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.137939+0000", 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.342e-05 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138024+0000", 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5167000000000006e-05 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.138055+0000", 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0982000000000003e-05 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.140997+0000", 2024-09-05T17:32:39.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029416329999999999 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141133+0000", 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013600799999999999 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:39.357 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 71.175608843000006, 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:32:39.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.783467854999998, 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:39.362 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:32:39.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:32:39.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:39.366 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.761829706, 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:32:39.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:32:39.371 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.185629824999999, 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:32:39.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:32:39.376 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.532631709999997, 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:39.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:32:39.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.532025861999998, 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.381 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:32:39.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.531459931000001, 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:39.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:32:39.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.53080499, 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:32:39.390 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:32:39.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.394 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.530104600999998, 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:32:39.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:32:39.399 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.528835985000001, 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:32:39.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:32:39.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:100058 3.18 e87/86 3:1ad21172:::rbd_data.1140b9781f.0000000000000010:head v 87'192, mlcod=0'0)", 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 33.379640127999998, 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003565824, 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.404 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937337+0000", 2024-09-05T17:32:39.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7899999999999997e-07 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938048+0000", 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00071111099999999995 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938066+0000", 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7958e-05 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938078+0000", 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1592e-05 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938155+0000", 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7541999999999997e-05 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938186+0000", 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0756000000000002e-05 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940856+0000", 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026697460000000002 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940902+0000", 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.634e-05 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.408 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:117572 3.4 e110/24 3:2566fea6:::rbd_data.1140bb1b3dec.000000000000001f:head v 110'665, mlcod=108'663)", 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.2934350840000004, 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049701290000000002, 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023543+0000", 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024795+0000", 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001251903 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024824+0000", 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9431999999999999e-05 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024837+0000", 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2381000000000001e-05 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024909+0000", 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2520000000000004e-05 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024933+0000", 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3357999999999999e-05 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028413+0000", 2024-09-05T17:32:39.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034808370000000001 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028512+0000", 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8238000000000004e-05 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.413 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:39.415 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:39.415 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:39.410+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:39.515 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:39.510+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:39.588 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:39.588 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:39.588 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:39.588 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:39.602 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:39.645 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:39.646+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:39.693 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:32:39.717 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:39.714+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:39.782 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:39.782 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:39.782 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:39.783 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:39.783 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:39.797 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:39.818 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:39.816+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:39.919 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:39.916+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:39.974 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 100.762445821, 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.975 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:39.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:39.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 100.761357323, 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:39.980 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:39.984 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 100.75101510899999, 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:39.985 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:39.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.989 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 100.75040971, 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.990 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:39.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 100.74935058200001, 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.995 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:39.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:39.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:39.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 100.747049211, 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:40.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:40.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 100.745957821, 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:40.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:40.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:40.010 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 100.74494006, 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:40.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 32.969086445999999, 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.015 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:32:40.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:40.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:32:40.022 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.376655476, 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:32:40.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.025 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:32:40.026 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:40.027 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.039403631999999, 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.030 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:32:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:32:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:32:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:32:40.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.037429420999999, 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.040 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.037399542999999, 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:40.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:32:40.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:32:40.045 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.034489204, 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.046 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:32:40.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:32:40.050 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.034148541, 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.051 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.052 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:32:40.053 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.054 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.055 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.031953069, 2024-09-05T17:32:40.056 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.057 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.058 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.059 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.060 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.061 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.027264659, 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.062 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.063 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:32:40.064 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.065 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.066 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.024270850000001, 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.067 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.068 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.069 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.070 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:32:40.071 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.019335199, 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.072 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.073 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.074 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:32:40.075 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.076 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 20.015779798000001, 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:32:40.077 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.078 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:32:40.079 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.080 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:32:40.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:40.082 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:40.084 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:40.084 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:40.082+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:40.113 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-05T17:32:40.113 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:32:40.113 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-05T17:32:40.113 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.824966 2024-09-05T17:32:40.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0.8249664416005501 2024-09-05T17:32:40.184 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:40.180+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:40.217 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:40.217 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:40.217 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:40.217 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:40.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:40.325 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:40.324+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:40.386 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:40.382+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:40.401 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:40.402 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:40.416 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:40.489 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:40.486+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:40.583 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:40.583 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:40.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:40.583 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:40.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.583 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.583 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.878187756000003, 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:32:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:32:40.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:32:40.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:32:40.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.589 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.589 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.589 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:40.590 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.878140372000004, 2024-09-05T17:32:40.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:32:40.590 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.591 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:32:40.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.592 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:40.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:40.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:32:40.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:32:40.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:32:40.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:32:40.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:32:40.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:32:40.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:32:40.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:32:40.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:32:40.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:32:40.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:32:40.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:32:40.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:32:40.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:32:40.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.600 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.601 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.601 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:40.601 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.878095700000003, 2024-09-05T17:32:40.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:32:40.602 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.603 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:32:40.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.603 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:40.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:40.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:32:40.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:32:40.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:32:40.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:32:40.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:32:40.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:32:40.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:32:40.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:32:40.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:32:40.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:32:40.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:32:40.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:32:40.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:32:40.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:32:40.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.611 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.612 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.612 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:40.612 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.878050357999996, 2024-09-05T17:32:40.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:32:40.612 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.613 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.613 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.613 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:32:40.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.614 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:40.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:40.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:32:40.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:32:40.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:32:40.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:32:40.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:32:40.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:32:40.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:32:40.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:32:40.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.877981348000006, 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:40.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:32:40.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:32:40.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:32:40.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.877932911000002, 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:32:40.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.877886552999996, 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.631 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.635 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.877223963000006, 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:32:40.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:32:40.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.877132617000001, 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.640 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:32:40.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.877071137000001, 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:32:40.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.877014236999997, 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.649 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:32:40.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.876920995999996, 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:32:40.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.876861468000001, 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.658 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.869705506000003, 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:32:40.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:32:40.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.869644038999994, 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:32:40.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.867776070000005, 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:32:40.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.86773556, 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:32:40.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:32:40.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:40.681 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.867697093999993, 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:32:40.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.867638987000007, 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.686 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:40.690 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.867581685999994, 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:32:40.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:40.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:40.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:40.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:32:40.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:32:40.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.695 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:40.695 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:40.695 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:40.696 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.5 primary-affinity to 0.824966 (8540652) 2024-09-05T17:32:40.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:40.697 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:40.696+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:40.798 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:40.794+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:40.882 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:40.884 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:40.884 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:40.884 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:40.884 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:40.899 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:40.899 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:40.896+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:41.000 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:40.998+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:41.031 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:41.032 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:41.048 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:41.048 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:41.065 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:41.065 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:41.065 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:41.065 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:41.065 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:41.066 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:41.066 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:41.079 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:41.081 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:41.081 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:41.101 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:41.101 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:41.102 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:41.121 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:41.121 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:41.125 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:41.124+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:41.138 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:41.139 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:41.143 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:41.143 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:41.202 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:41.202+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:41.202 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:41.202 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:41.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:41.305 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:41.306+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:41.385 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:41.385 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:41.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:41.406 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:41.406+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:41.507 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:41.506+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:41.521 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:41.521 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:41.535 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:41.608 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:41.606+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:41.652 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:41.652 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:41.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:41.708 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:41.704+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:41.716 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:32:41.809 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:41.806+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:41.821 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:41.822 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:41.841 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:41.925 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:41.926+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:42.000 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:42.000 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:42.011 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:42.010+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:42.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:42.111 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:42.110+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:42.174 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:42.174 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:42.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:42.233 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:42.234+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:42.313 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:42.314+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:42.359 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:42.359 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:42.373 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:42.414 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:42.412+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:42.515 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:42.514+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:42.544 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:42.544 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:42.559 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:42.646 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:42.646+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:42.716 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:42.712+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:42.719 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:32:42.739 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:42.739 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:42.757 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:42.853 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:42.854+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:42.918 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:42.918+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:42.949 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:42.949 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:42.963 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:43.054 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:43.054+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:43.120 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:43.116+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:43.135 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:43.144 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:43.149 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:43.241 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:43.242+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:43.292 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:43.293 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:43.309 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:43.310 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:43.319 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:43.320 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:43.322 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:43.322+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:43.326 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:43.326 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:43.335 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:43.343 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:43.343 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:43.364 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:43.364 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:43.365 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:43.386 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:43.386 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:43.406 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:43.407 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:43.411 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:43.411 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:43.453 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:43.454+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:43.459 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:43.459 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:43.459 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:43.459 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:43.474 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:43.561 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:43.562+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:43.626 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:43.624+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:43.647 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:43.648 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:43.648 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:43.648 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:43.648 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:43.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:43.757 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:43.758+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:43.828 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:43.826+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:43.856 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:43.856 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:43.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:43.856 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:43.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 104.643730112, 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:43.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.861 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 104.642641614, 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.862 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:43.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:43.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:43.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 104.63229939999999, 2024-09-05T17:32:43.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:43.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:43.871 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 104.631694001, 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.872 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:43.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.874 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:43.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 104.63063487300001, 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.877 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:43.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:43.881 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 104.628333502, 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:43.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:43.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:43.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:43.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:43.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:43.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:43.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:43.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:43.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 104.627242112, 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:43.888 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:43.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 104.626224351, 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:43.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:43.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 36.850370736999999, 2024-09-05T17:32:43.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:32:43.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:32:43.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.905 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.257939767, 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.906 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:43.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:32:43.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:43.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:32:43.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:43.913 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.920687922999999, 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:43.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:32:43.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.918 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.918713711999999, 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.919 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:32:43.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:32:43.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:32:43.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:32:43.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:32:43.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.918683833999999, 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:32:43.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:32:43.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.930 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.915773495, 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.931 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.932 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.932 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:32:43.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.932 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:32:43.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.915432832, 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.937 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:32:43.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.941 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.91323736, 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.942 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:32:43.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:32:43.946 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.90854895, 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.947 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:32:43.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.951 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.905555141000001, 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.952 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:32:43.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:32:43.956 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.90061949, 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:32:43.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 23.897064089000001, 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:43.962 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:43.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:43.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.968 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:43.969 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:43.969 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:43.971 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:43.971 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:43.968+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:44.072 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:44.070+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:44.102 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:44.102 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:44.102 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:44.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:44.173 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:44.174+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:44.235 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:44.235 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:44.235 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:44.235 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:44.235 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:44.249 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:44.297 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:44.296+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.664413753000005, 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:32:44.369 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:32:44.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:32:44.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.664366369000007, 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.664321697000005, 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:32:44.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.664276354999998, 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:32:44.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.664207344999994, 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:32:44.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.392 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.664158908000005, 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:32:44.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.664112549999999, 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.397 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.663449959999994, 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.663358614000003, 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:32:44.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.663297134000004, 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.411 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:32:44.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:32:44.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.663240234, 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.663146992999998, 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:44.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.663087465000004, 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:32:44.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:32:44.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.655931503000005, 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:32:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:32:44.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.655870035999996, 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.434 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:32:44.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.654002066999993, 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.438 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:32:44.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.653961557000002, 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.443 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:32:44.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.653923090999996, 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.447 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:32:44.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:32:44.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.653864983999995, 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.452 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:32:44.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.653807682999997, 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:32:44.456 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:32:44.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:44.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.460 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:44.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:44.461 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:44.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:44.463 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:44.462+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:44.563 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:44.560+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:44.632 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:44.632 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:44.646 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:44.664 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:44.662+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:44.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:32:44.765 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:44.764+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:44.826 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:44.827 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:44.827 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:44.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:44.866 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:44.866+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:44.967 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:44.966+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:45.013 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:45.013 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554576331, 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:32:45.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:32:45.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554528048999998, 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:32:45.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554481688999999, 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:32:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:32:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:32:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:32:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:32:45.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:32:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:32:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:32:45.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:32:45.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:32:45.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:32:45.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.030 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.031 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:45.031 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554433088000003, 2024-09-05T17:32:45.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:32:45.031 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.031 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.031 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:32:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:45.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:45.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:32:45.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:32:45.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:32:45.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:32:45.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:32:45.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:32:45.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:32:45.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:32:45.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:32:45.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:32:45.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:32:45.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:32:45.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.037 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.038 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.038 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:45.038 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554377488999997, 2024-09-05T17:32:45.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:32:45.038 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.039 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.039 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.039 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:32:45.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.039 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:45.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:32:45.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554332244999998, 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:32:45.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554287746, 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:32:45.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554243788999997, 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:32:45.052 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:45.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554198452000001, 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:32:45.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554152002999999, 2024-09-05T17:32:45.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:32:45.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.065 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554108440999997, 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:32:45.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554063065999998, 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.071 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:32:45.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.554013955000002, 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:32:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:32:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:32:45.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:32:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:32:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:32:45.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:32:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:32:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:32:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:32:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:32:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:32:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.553975020999999, 2024-09-05T17:32:45.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:32:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:32:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:32:45.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:32:45.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.089 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.553905358999998, 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:32:45.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.553852808000002, 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:32:45.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.099 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.553707252000002, 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:32:45.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:32:45.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.553655671000001, 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:32:45.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.109 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.321633300000002, 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.110 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:32:45.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:32:45.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:116533 3.7 3:e6924f8b:::rbd_data.11402f0626d4.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.739379599999999, 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.069225986000000003, 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:45.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116533 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272329+0000", 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272340+0000", 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.172e-05 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272372+0000", 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1192000000000002e-05 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272387+0000", 2024-09-05T17:32:45.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5339999999999999e-05 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272494+0000", 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650300000000001 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272629+0000", 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135845 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.286878+0000", 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014248241 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341353+0000", 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054475896000000003 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:45.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341387+0000", 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3043000000000002e-05 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341475+0000", 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8103000000000007e-05 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341552+0000", 2024-09-05T17:32:45.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7539000000000004e-05 2024-09-05T17:32:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.124 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.124 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:45.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:45.126 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:45.126+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:45.226 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:45.224+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:45.251 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:45.252 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:45.252 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:45.252 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:45.266 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:45.326 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:45.326+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:45.412 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:45.437 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:45.437 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:45.437 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:45.437 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:45.438 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:45.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:45.457 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:45.458+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:45.528 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:45.526+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:45.569 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:45.569 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:45.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:45.569 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:45.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.569 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:32:45.569 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 138.55224571100001, 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:45.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:32:45.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.185254348000001, 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.581 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.582 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:45.582 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.185203432000002, 2024-09-05T17:32:45.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:32:45.582 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.582 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.582 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.185153585999998, 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:32:45.587 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:32:45.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:32:45.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:32:45.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.185108278000001, 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:32:45.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.598 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.598 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:45.598 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.185060262, 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:32:45.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:45.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:32:45.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.604 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.184987130000003, 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.605 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:45.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:32:45.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.609 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.184938103999997, 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:45.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:32:45.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.184853087, 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:45.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:32:45.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.184797365000001, 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:32:45.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.184734507000002, 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.625 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:32:45.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:32:45.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.629 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.184587934, 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:32:45.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.177684702999997, 2024-09-05T17:32:45.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:45.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:32:45.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.177662908999999, 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:32:45.639 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:32:45.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.177619446000001, 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.644 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.177582774999998, 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.649 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.177542467999999, 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:32:45.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.177503762000001, 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.659 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:45.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:32:45.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.397497515000001, 2024-09-05T17:32:45.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:32:45.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:32:45.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.026166938999999, 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:45.671 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:32:45.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:45.677 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:45.678 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:45.679 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:45.680 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:45.680 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:45.680 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:45.676+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:45.681 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:45.681 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:45.681 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:45.682 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:45.682 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:45.682 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:45.683 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:45.683 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:45.691 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:45.691 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:45.696 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:45.697 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:45.730 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:32:45.735 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-05T17:32:45.735 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:32:45.735 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-05T17:32:45.736 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-05T17:32:45.780 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:45.776+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:45.825 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:45.825 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:45.842 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:45.880 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:45.876+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:45.981 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:45.982+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:45.990 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:45.990 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:46.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:46.085 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:32:46.085 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:46.085 INFO:teuthology.orchestra.run.smithi050.stdout: "epoch": 123, 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "fsid": "229efc05-fdc4-4e1f-8246-413b49f3eeda", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "created": "2024-09-05T17:30:12.762369+0000", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "modified": "2024-09-05T17:32:45.729054+0000", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "last_up_change": "2024-09-05T17:32:22.531076+0000", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "last_in_change": "2024-09-05T17:32:09.963211+0000", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_num": 5806080, 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_set": [ 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "nodeep-scrub", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "noscrub", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "pglog_hardlimit", 2024-09-05T17:32:46.086 INFO:teuthology.orchestra.run.smithi050.stdout: "purged_snapdirs", 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "recovery_deletes", 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "sortbitwise" 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_version": 5, 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "full_ratio": 0.94999998807907104, 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_snapshot": "", 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_max": 3, 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "max_osd": 8, 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "require_min_compat_client": "luminous", 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "min_compat_client": "luminous", 2024-09-05T17:32:46.087 INFO:teuthology.orchestra.run.smithi050.stdout: "require_osd_release": "squid", 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "allow_crimson": false, 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "pools": [ 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 1, 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": ".mgr", 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:25.818485+0000", 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 1, 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool", 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:32:46.088 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 1, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 1, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 1, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 1, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 1, 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:32:46.089 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "18", 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:32:46.090 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 0, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 0, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:32:46.091 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:32:46.092 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "options": { 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_max": 32, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_min": 1 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: "mgr": {} 2024-09-05T17:32:46.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 8, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 8, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.25, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 2, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 2, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.88731002807617188, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 2, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "rbd", 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:30.943478+0000", 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:32:46.095 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 8, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 8, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 8, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 8, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 8, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:32:46.096 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "22", 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 2, 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 22, 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:32:46.097 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:32:46.098 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:32:46.099 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:32:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:32:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:32:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:32:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:32:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:32:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:32:46.100 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.88731002807617188, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_name": "pool_client.0", 2024-09-05T17:32:46.101 INFO:teuthology.orchestra.run.smithi050.stdout: "create_time": "2024-09-05T17:30:42.082168+0000", 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flags": 8193, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "type": 1, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 2, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "min_size": 1, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_rule": 0, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_count": 0, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_target": 0, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_barrier": 0, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "is_stretch_pool": false, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "object_hash": 2, 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_autoscale_mode": "off", 2024-09-05T17:32:46.102 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num": 32, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num": 32, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_placement_num_target": 32, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_target": 32, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_num_pending": 32, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "last_pg_merge_meta": { 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "source_pgid": "0.0", 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "ready_epoch": 0, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_started": 0, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "last_epoch_clean": 0, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "source_version": "0'0", 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "target_version": "0'0" 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "last_change": "123", 2024-09-05T17:32:46.103 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend": "0", 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "last_force_op_resend_preluminous": "0", 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "auid": 0, 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_mode": "selfmanaged", 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_seq": 44, 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "snap_epoch": 123, 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "pool_snaps": [], 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps": "[]", 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_bytes": 0, 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "quota_max_objects": 0, 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tiers": [], 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tier_of": -1, 2024-09-05T17:32:46.104 INFO:teuthology.orchestra.run.smithi050.stdout: "read_tier": -1, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "write_tier": -1, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_mode": "none", 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_bytes": 0, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "target_max_objects": 0, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_flush_age": 0, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "cache_min_evict_age": 0, 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profile": "", 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_params": { 2024-09-05T17:32:46.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "none" 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_period": 0, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_count": 0, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "use_gmt_hitset": true, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "min_read_recency_for_promote": 0, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "min_write_recency_for_promote": 0, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_grade_decay_rate": 0, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "hit_set_search_last_n": 0, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "grade_table": [], 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "stripe_width": 0, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "expected_num_objects": 0, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "fast_read": false, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "options": {}, 2024-09-05T17:32:46.106 INFO:teuthology.orchestra.run.smithi050.stdout: "application_metadata": { 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "rbd": {} 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "read_balance": { 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "score_type": "Fair distribution", 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "score_acting": 1.9900000095367432, 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "score_stable": 1.9900000095367432, 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "optimal_score": 0.87999999523162842, 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_acting": 1.75, 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "raw_score_stable": 1.75, 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity_weighted": 0.88731002807617188, 2024-09-05T17:32:46.107 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity": 0.88999998569488525, 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "average_primary_affinity_weighted": 0.88999998569488525 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "38dd1565-a37f-4055-acb3-aa82457cf9e7", 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:46.108 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 104, 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6824", 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6825", 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6826", 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6827", 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6830", 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.111 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6831", 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6828", 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6829", 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1446480840 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6825/1446480840", 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6827/1446480840", 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6831/1446480840", 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6829/1446480840", 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:46.113 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f5ef5f03-d714-4329-b14b-1881ad1e7358", 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 0.545806884765625, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:46.114 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 104, 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6808", 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.115 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6809", 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6810", 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:46.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6811", 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6814", 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:46.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6815", 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6812", 2024-09-05T17:32:46.118 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6813", 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3885625462 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6809/3885625462", 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6811/3885625462", 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6815/3885625462", 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6813/3885625462", 2024-09-05T17:32:46.119 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "7b87b0cc-2484-4a66-be1b-232a7e36dc11", 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:46.120 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 104, 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6800", 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.121 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6801", 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6802", 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.122 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6803", 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6806", 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6807", 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6804", 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:46.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6805", 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 3027840955 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6801/3027840955", 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6803/3027840955", 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6807/3027840955", 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6805/3027840955", 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:46.125 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "f6d63b1e-2673-4542-a2e2-fbb0c4577864", 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:46.126 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 104, 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6816", 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6817", 2024-09-05T17:32:46.127 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6818", 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.128 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6819", 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6822", 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6823", 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6820", 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.50:6821", 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2889879466 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.50:6817/2889879466", 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.50:6819/2889879466", 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.50:6823/2889879466", 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.50:6821/2889879466", 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:46.131 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "273ec4c6-0c2a-41d5-90c1-68b317365484", 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 0.2735137939453125, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 104, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:46.132 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6808", 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6809", 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.133 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6810", 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6811", 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:46.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6814", 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6815", 2024-09-05T17:32:46.135 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6812", 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.136 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6813", 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1774319792 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6809/1774319792", 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6811/1774319792", 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6815/1774319792", 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6813/1774319792", 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "5f6cf36b-2dd0-47de-97c4-42e98f849734", 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 0, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 0.8249664306640625, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 94, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 104, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:46.138 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6816", 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6817", 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.139 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6818", 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6819", 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6822", 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6823", 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.141 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6820", 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6821", 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 1348894681 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.142 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6817/1348894681", 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6819/1348894681", 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6823/1348894681", 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6821/1348894681", 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "exists" 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "2d6ed4a6-3d83-4c9d-9e96-2dbab049448a", 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:46.143 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 95, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.144 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6824", 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6825", 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6826", 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6827", 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:46.146 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6830", 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6831", 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.147 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6828", 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6829", 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 792585226 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6825/792585226", 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6827/792585226", 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6831/792585226", 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6829/792585226", 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "uuid": "dbe1901b-5f78-419f-864a-89946452f4a6", 2024-09-05T17:32:46.149 INFO:teuthology.orchestra.run.smithi050.stdout: "up": 1, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "in": 1, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "weight": 1, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_affinity": 1, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_begin": 0, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "last_clean_end": 0, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "up_from": 14, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "up_thru": 104, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "down_at": 0, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "lost_at": 0, 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addrs": { 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.150 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6800", 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6801", 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addrs": { 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.151 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6802", 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6803", 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addrs": { 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6806", 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6807", 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addrs": { 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addrvec": [ 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v2", 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6804", 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type": "v1", 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "addr": "172.21.15.110:6805", 2024-09-05T17:32:46.154 INFO:teuthology.orchestra.run.smithi050.stdout: "nonce": 2161010500 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "public_addr": "172.21.15.110:6801/2161010500", 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "cluster_addr": "172.21.15.110:6803/2161010500", 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2161010500", 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2161010500", 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "state": [ 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "exists", 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "up" 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:46.155 INFO:teuthology.orchestra.run.smithi050.stdout: "osd_xinfo": [ 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 0, 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:22.246726+0000", 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 1, 2024-09-05T17:32:46.156 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.638940+0000", 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 2, 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:46.157 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.694544+0000", 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 3, 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.653253+0000", 2024-09-05T17:32:46.158 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 4, 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.467561+0000", 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 5, 2024-09-05T17:32:46.159 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.797765+0000", 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 104 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 6, 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:46.160 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.649372+0000", 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "osd": 7, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "down_stamp": "0.000000", 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_probability": 0, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "laggy_interval": 0, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "features": 4540719139924082687, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "old_weight": 0, 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "last_purged_snaps_scrub": "2024-09-05T17:30:21.242988+0000", 2024-09-05T17:32:46.161 INFO:teuthology.orchestra.run.smithi050.stdout: "dead_epoch": 0 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap": [ 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "pgid": "3.7", 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "osds": [ 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: 6, 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: 7 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_items": [ 2024-09-05T17:32:46.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "pgid": "3.8", 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "mappings": [ 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "from": 7, 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "to": 4 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_upmap_primaries": [], 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "pg_temp": [], 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "primary_temp": [], 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "blocklist": {}, 2024-09-05T17:32:46.163 INFO:teuthology.orchestra.run.smithi050.stdout: "range_blocklist": {}, 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "erasure_code_profiles": { 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "default": { 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "crush-failure-domain": "osd", 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "k": "2", 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "m": "1", 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "plugin": "jerasure", 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "technique": "reed_sol_van" 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "removed_snaps_queue": [ 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:32:46.164 INFO:teuthology.orchestra.run.smithi050.stdout: "snaps": [ 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "begin": 37, 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "length": 8 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "new_removed_snaps": [ 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "pool": 3, 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "snaps": [ 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:46.165 INFO:teuthology.orchestra.run.smithi050.stdout: "begin": 37, 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "length": 1 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "new_purged_snaps": [], 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "crush_node_flags": {}, 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "device_class_flags": {}, 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode": { 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_enabled": false, 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_bucket_count": 0, 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "degraded_stretch_mode": 0, 2024-09-05T17:32:46.166 INFO:teuthology.orchestra.run.smithi050.stdout: "recovering_stretch_mode": 0, 2024-09-05T17:32:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: "stretch_mode_bucket": 0 2024-09-05T17:32:46.167 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:46.167 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:46.167 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:46.086+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:46.168 INFO:tasks.thrashosds.thrasher:j is {'epoch': 123, 'fsid': '229efc05-fdc4-4e1f-8246-413b49f3eeda', 'created': '2024-09-05T17:30:12.762369+0000', 'modified': '2024-09-05T17:32:45.729054+0000', 'last_up_change': '2024-09-05T17:32:22.531076+0000', 'last_in_change': '2024-09-05T17:32:09.963211+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T17:30:25.818485+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8873100280761719, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-05T17:30:30.943478+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 22, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8873100280761719, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-05T17:30:42.082168+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 44, 'snap_epoch': 123, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.8873100280761719, 'average_primary_affinity': 0.8899999856948853, 'average_primary_affinity_weighted': 0.8899999856948853}}], 'osds': [{'osd': 0, 'uuid': '38dd1565-a37f-4055-acb3-aa82457cf9e7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 104, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6824', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6825', 'nonce': 1446480840}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6826', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6827', 'nonce': 1446480840}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6830', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6831', 'nonce': 1446480840}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6828', 'nonce': 1446480840}, {'type': 'v1', 'addr': '172.21.15.50:6829', 'nonce': 1446480840}]}, 'public_addr': '172.21.15.50:6825/1446480840', 'cluster_addr': '172.21.15.50:6827/1446480840', 'heartbeat_back_addr': '172.21.15.50:6831/1446480840', 'heartbeat_front_addr': '172.21.15.50:6829/1446480840', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'f5ef5f03-d714-4329-b14b-1881ad1e7358', 'up': 1, 'in': 1, 'weight': 0.545806884765625, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 104, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6808', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6809', 'nonce': 3885625462}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6810', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6811', 'nonce': 3885625462}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6814', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6815', 'nonce': 3885625462}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6812', 'nonce': 3885625462}, {'type': 'v1', 'addr': '172.21.15.50:6813', 'nonce': 3885625462}]}, 'public_addr': '172.21.15.50:6809/3885625462', 'cluster_addr': '172.21.15.50:6811/3885625462', 'heartbeat_back_addr': '172.21.15.50:6815/3885625462', 'heartbeat_front_addr': '172.21.15.50:6813/3885625462', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '7b87b0cc-2484-4a66-be1b-232a7e36dc11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 104, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6800', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6801', 'nonce': 3027840955}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6802', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6803', 'nonce': 3027840955}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6806', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6807', 'nonce': 3027840955}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6804', 'nonce': 3027840955}, {'type': 'v1', 'addr': '172.21.15.50:6805', 'nonce': 3027840955}]}, 'public_addr': '172.21.15.50:6801/3027840955', 'cluster_addr': '172.21.15.50:6803/3027840955', 'heartbeat_back_addr': '172.21.15.50:6807/3027840955', 'heartbeat_front_addr': '172.21.15.50:6805/3027840955', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'f6d63b1e-2673-4542-a2e2-fbb0c4577864', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 104, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6816', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6817', 'nonce': 2889879466}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6818', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6819', 'nonce': 2889879466}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6822', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6823', 'nonce': 2889879466}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.50:6820', 'nonce': 2889879466}, {'type': 'v1', 'addr': '172.21.15.50:6821', 'nonce': 2889879466}]}, 'public_addr': '172.21.15.50:6817/2889879466', 'cluster_addr': '172.21.15.50:6819/2889879466', 'heartbeat_back_addr': '172.21.15.50:6823/2889879466', 'heartbeat_front_addr': '172.21.15.50:6821/2889879466', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '273ec4c6-0c2a-41d5-90c1-68b317365484', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.2735137939453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 104, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 1774319792}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 1774319792}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 1774319792}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 1774319792}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 1774319792}]}, 'public_addr': '172.21.15.110:6809/1774319792', 'cluster_addr': '172.21.15.110:6811/1774319792', 'heartbeat_back_addr': '172.21.15.110:6815/1774319792', 'heartbeat_front_addr': '172.21.15.110:6813/1774319792', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '5f6cf36b-2dd0-47de-97c4-42e98f849734', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.8249664306640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 94, 'down_at': 104, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 1348894681}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 1348894681}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 1348894681}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 1348894681}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 1348894681}]}, 'public_addr': '172.21.15.110:6817/1348894681', 'cluster_addr': '172.21.15.110:6819/1348894681', 'heartbeat_back_addr': '172.21.15.110:6823/1348894681', 'heartbeat_front_addr': '172.21.15.110:6821/1348894681', 'state': ['exists']}, {'osd': 6, 'uuid': '2d6ed4a6-3d83-4c9d-9e96-2dbab049448a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 95, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 792585226}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 792585226}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 792585226}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 792585226}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 792585226}]}, 'public_addr': '172.21.15.110:6825/792585226', 'cluster_addr': '172.21.15.110:6827/792585226', 'heartbeat_back_addr': '172.21.15.110:6831/792585226', 'heartbeat_front_addr': '172.21.15.110:6829/792585226', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dbe1901b-5f78-419f-864a-89946452f4a6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 104, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2161010500}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2161010500}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2161010500}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2161010500}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2161010500}]}, 'public_addr': '172.21.15.110:6801/2161010500', 'cluster_addr': '172.21.15.110:6803/2161010500', 'heartbeat_back_addr': '172.21.15.110:6807/2161010500', 'heartbeat_front_addr': '172.21.15.110:6805/2161010500', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:22.246726+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.638940+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.694544+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.653253+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.467561+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.797765+0000', 'dead_epoch': 104}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.649372+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-05T17:30:21.242988+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.7', 'osds': [6, 7]}], 'pg_upmap_items': [{'pgid': '3.8', 'mappings': [{'from': 7, 'to': 4}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 37, 'length': 8}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 37, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-05T17:32:46.169 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:32:46.177 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:46.177 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:46.192 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:46.192 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:46.190+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:46.283 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:46.282+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:46.358 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:46.359 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:46.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:46.421 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:46.418+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:46.486 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:32:46.486 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:32:46.487 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:46.486+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:46.505 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-09-05T17:32:45.805205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1326604868,"num_objects":1578,"num_object_clones":389,"num_object_copies":3156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":486,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1578,"num_whiteouts":322,"num_read":165357,"num_read_kb":798123,"num_write":21800,"num_write_kb":365167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1848,"num_bytes_recovered":66499048,"num_keys_recovered":191,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17025,"ondisk_log_size":17025,"up":71,"acting":71,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":476700,"kb_used_data":49096,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754498020,"statfs":{"total":773094113280,"available":772605972480,"internally_reserved":0,"allocated":50274304,"data_stored":302960017,"data_compressed":11760625,"data_compressed_allocated":25755648,"data_compressed_original":289831030,"omap_allocated":12751,"internal_metadata":437243441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-188005023,"num_objects":-112,"num_object_clones":-32,"num_object_copies":-224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-9,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-112,"num_whiteouts":0,"num_read":1231,"num_read_kb":1054,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001130"},"pg_stats":[{"pgid":"3.1f","version":"119'370","reported_seq":2980,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.754659+0000","last_change":"2024-09-05T17:32:23.554494+0000","last_active":"2024-09-05T17:32:44.754659+0000","last_peered":"2024-09-05T17:32:44.754659+0000","last_clean":"2024-09-05T17:32:21.912427+0000","last_became_active":"2024-09-05T17:32:23.554494+0000","last_became_peered":"2024-09-05T17:32:23.554494+0000","last_unstale":"2024-09-05T17:32:44.754659+0000","last_undegraded":"2024-09-05T17:32:23.549205+0000","last_fullsized":"2024-09-05T17:32:23.549122+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:17:35.182822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023314770000000002,"stat_sum":{"num_bytes":51940031,"num_objects":55,"num_object_clones":14,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":55,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":12,"num_read":2989,"num_read_kb":16704,"num_write":478,"num_write_kb":14003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":6784530,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":55}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"117'289","reported_seq":1783,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.751725+0000","last_change":"2024-09-05T17:32:44.751725+0000","last_active":"2024-09-05T17:32:44.751725+0000","last_peered":"2024-09-05T17:32:44.751725+0000","last_clean":"2024-09-05T17:32:44.751725+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:32:44.751725+0000","last_undegraded":"2024-09-05T17:32:44.751725+0000","last_fullsized":"2024-09-05T17:32:44.751725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:53:48.360451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048432010000000001,"stat_sum":{"num_bytes":13914608,"num_objects":29,"num_object_clones":5,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":6,"num_read":2143,"num_read_kb":10598,"num_write":311,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.1d","version":"121'446","reported_seq":3052,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.734729+0000","last_change":"2024-09-05T17:32:23.554944+0000","last_active":"2024-09-05T17:32:44.734729+0000","last_peered":"2024-09-05T17:32:44.734729+0000","last_clean":"2024-09-05T17:32:16.181778+0000","last_became_active":"2024-09-05T17:32:23.554944+0000","last_became_peered":"2024-09-05T17:32:23.554944+0000","last_unstale":"2024-09-05T17:32:44.734729+0000","last_undegraded":"2024-09-05T17:32:23.553459+0000","last_fullsized":"2024-09-05T17:32:23.553224+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:33:12.719988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064572499999999999,"stat_sum":{"num_bytes":60431784,"num_objects":52,"num_object_clones":15,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":52,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":12,"num_read":3598,"num_read_kb":19582,"num_write":515,"num_write_kb":7606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":52}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"122'455","reported_seq":3168,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.805889+0000","last_change":"2024-09-05T17:32:23.554281+0000","last_active":"2024-09-05T17:32:44.805889+0000","last_peered":"2024-09-05T17:32:44.805889+0000","last_clean":"2024-09-05T17:32:21.575172+0000","last_became_active":"2024-09-05T17:32:23.554281+0000","last_became_peered":"2024-09-05T17:32:23.554281+0000","last_unstale":"2024-09-05T17:32:44.805889+0000","last_undegraded":"2024-09-05T17:32:23.553320+0000","last_fullsized":"2024-09-05T17:32:23.553000+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:56:42.278528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015056150000000001,"stat_sum":{"num_bytes":23349973,"num_objects":50,"num_object_clones":9,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":50,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":8,"num_read":3653,"num_read_kb":20301,"num_write":513,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4],"avail_no_missing":["4"],"object_location_counts":[{"shards":"4","objects":50}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"121'399","reported_seq":2101,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.755293+0000","last_change":"2024-09-05T17:32:44.756795+0000","last_active":"2024-09-05T17:32:44.755293+0000","last_peered":"2024-09-05T17:32:44.755293+0000","last_clean":"2024-09-05T17:32:44.755293+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:32:44.755293+0000","last_undegraded":"2024-09-05T17:32:44.755293+0000","last_fullsized":"2024-09-05T17:32:44.755293+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:51:16.153857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034560189999999998,"stat_sum":{"num_bytes":56514407,"num_objects":40,"num_object_clones":10,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":7,"num_read":2378,"num_read_kb":34000,"num_write":435,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.1a","version":"116'578","reported_seq":5414,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.781648+0000","last_change":"2024-09-05T17:32:44.769390+0000","last_active":"2024-09-05T17:32:44.781648+0000","last_peered":"2024-09-05T17:32:44.781648+0000","last_clean":"2024-09-05T17:32:44.781648+0000","last_became_active":"2024-09-05T17:31:31.708688+0000","last_became_peered":"2024-09-05T17:31:31.708688+0000","last_unstale":"2024-09-05T17:32:44.781648+0000","last_undegraded":"2024-09-05T17:32:44.781648+0000","last_fullsized":"2024-09-05T17:32:44.781648+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:40:55.063043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099052800000000007,"stat_sum":{"num_bytes":25425337,"num_objects":49,"num_object_clones":11,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":11,"num_read":6898,"num_read_kb":18058,"num_write":673,"num_write_kb":4658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.19","version":"121'542","reported_seq":7831,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.769331+0000","last_change":"2024-09-05T17:32:44.770029+0000","last_active":"2024-09-05T17:32:44.769331+0000","last_peered":"2024-09-05T17:32:44.769331+0000","last_clean":"2024-09-05T17:32:44.769331+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:32:44.769331+0000","last_undegraded":"2024-09-05T17:32:44.769331+0000","last_fullsized":"2024-09-05T17:32:44.769331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:42:56.379603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014485749999999999,"stat_sum":{"num_bytes":57922021,"num_objects":41,"num_object_clones":5,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":6,"num_read":8553,"num_read_kb":36990,"num_write":639,"num_write_kb":9663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.18","version":"122'418","reported_seq":2551,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.823554+0000","last_change":"2024-09-05T17:32:44.749849+0000","last_active":"2024-09-05T17:32:44.823554+0000","last_peered":"2024-09-05T17:32:44.823554+0000","last_clean":"2024-09-05T17:32:44.823554+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:32:44.823554+0000","last_undegraded":"2024-09-05T17:32:44.823554+0000","last_fullsized":"2024-09-05T17:32:44.823554+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:21:04.018257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033911280000000002,"stat_sum":{"num_bytes":10999238,"num_objects":39,"num_object_clones":12,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":8,"num_read":2242,"num_read_kb":32575,"num_write":521,"num_write_kb":10677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.17","version":"119'670","reported_seq":2212,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.753703+0000","last_change":"2024-09-05T17:32:23.551050+0000","last_active":"2024-09-05T17:32:44.753703+0000","last_peered":"2024-09-05T17:32:44.753703+0000","last_clean":"2024-09-05T17:32:21.640929+0000","last_became_active":"2024-09-05T17:32:23.551050+0000","last_became_peered":"2024-09-05T17:32:23.551050+0000","last_unstale":"2024-09-05T17:32:44.753703+0000","last_undegraded":"2024-09-05T17:32:23.548891+0000","last_fullsized":"2024-09-05T17:32:23.548797+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:27:44.202546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024520119999999999,"stat_sum":{"num_bytes":19899617,"num_objects":42,"num_object_clones":7,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":42,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":7,"num_read":3340,"num_read_kb":12534,"num_write":949,"num_write_kb":5547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":135,"num_bytes_recovered":710624,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":42}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"122'669","reported_seq":2254,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.833238+0000","last_change":"2024-09-05T17:32:23.549558+0000","last_active":"2024-09-05T17:32:44.833238+0000","last_peered":"2024-09-05T17:32:44.833238+0000","last_clean":"2024-09-05T17:32:18.891823+0000","last_became_active":"2024-09-05T17:32:23.549558+0000","last_became_peered":"2024-09-05T17:32:23.549558+0000","last_unstale":"2024-09-05T17:32:44.833238+0000","last_undegraded":"2024-09-05T17:32:23.548437+0000","last_fullsized":"2024-09-05T17:32:23.548205+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:11:13.114696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017597120000000001,"stat_sum":{"num_bytes":31450989,"num_objects":64,"num_object_clones":16,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":64,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":12,"num_read":4005,"num_read_kb":14042,"num_write":884,"num_write_kb":13309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":64}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"118'269","reported_seq":1264,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.738507+0000","last_change":"2024-09-05T17:32:44.739048+0000","last_active":"2024-09-05T17:32:44.738507+0000","last_peered":"2024-09-05T17:32:44.738507+0000","last_clean":"2024-09-05T17:32:44.738507+0000","last_became_active":"2024-09-05T17:30:43.598646+0000","last_became_peered":"2024-09-05T17:30:43.598646+0000","last_unstale":"2024-09-05T17:32:44.738507+0000","last_undegraded":"2024-09-05T17:32:44.738507+0000","last_fullsized":"2024-09-05T17:32:44.738507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:30:11.552017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012980520000000001,"stat_sum":{"num_bytes":31292042,"num_objects":49,"num_object_clones":15,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":13,"num_read":829,"num_read_kb":16268,"num_write":231,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.14","version":"121'389","reported_seq":14035,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.739173+0000","last_change":"2024-09-05T17:32:44.739752+0000","last_active":"2024-09-05T17:32:44.739173+0000","last_peered":"2024-09-05T17:32:44.739173+0000","last_clean":"2024-09-05T17:32:44.739173+0000","last_became_active":"2024-09-05T17:31:31.707629+0000","last_became_peered":"2024-09-05T17:31:31.707629+0000","last_unstale":"2024-09-05T17:32:44.739173+0000","last_undegraded":"2024-09-05T17:32:44.739173+0000","last_fullsized":"2024-09-05T17:32:44.739173+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:48:39.181784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886895,"stat_sum":{"num_bytes":58888881,"num_objects":55,"num_object_clones":15,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":12,"num_read":14636,"num_read_kb":36810,"num_write":376,"num_write_kb":4431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"2.7","version":"0'0","reported_seq":221,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.732962+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:32:44.732962+0000","last_peered":"2024-09-05T17:32:44.732962+0000","last_clean":"2024-09-05T17:32:44.732962+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:32:44.732962+0000","last_undegraded":"2024-09-05T17:32:44.732962+0000","last_fullsized":"2024-09-05T17:32:44.732962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"121'411","reported_seq":5515,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.756975+0000","last_change":"2024-09-05T17:32:44.757879+0000","last_active":"2024-09-05T17:32:44.756975+0000","last_peered":"2024-09-05T17:32:44.756975+0000","last_clean":"2024-09-05T17:32:44.756975+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:32:44.756975+0000","last_undegraded":"2024-09-05T17:32:44.756975+0000","last_fullsized":"2024-09-05T17:32:44.756975+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:57:12.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045285170000000001,"stat_sum":{"num_bytes":47385348,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":11,"num_read":6256,"num_read_kb":26195,"num_write":395,"num_write_kb":8488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.732442+0000","last_change":"2024-09-05T17:32:05.421784+0000","last_active":"2024-09-05T17:32:44.732442+0000","last_peered":"2024-09-05T17:32:44.732442+0000","last_clean":"2024-09-05T17:32:44.732442+0000","last_became_active":"2024-09-05T17:32:05.420725+0000","last_became_peered":"2024-09-05T17:32:05.420725+0000","last_unstale":"2024-09-05T17:32:44.732442+0000","last_undegraded":"2024-09-05T17:32:44.732442+0000","last_fullsized":"2024-09-05T17:32:44.732442+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:29:14.852745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"120'401","reported_seq":1601,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.733510+0000","last_change":"2024-09-05T17:32:44.733819+0000","last_active":"2024-09-05T17:32:44.733510+0000","last_peered":"2024-09-05T17:32:44.733510+0000","last_clean":"2024-09-05T17:32:44.733510+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:32:44.733510+0000","last_undegraded":"2024-09-05T17:32:44.733510+0000","last_fullsized":"2024-09-05T17:32:44.733510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:19:22.065606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010633789999999999,"stat_sum":{"num_bytes":22694416,"num_objects":35,"num_object_clones":5,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":6,"num_read":1477,"num_read_kb":31656,"num_write":477,"num_write_kb":12079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"2.5","version":"0'0","reported_seq":233,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.738093+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:32:44.738093+0000","last_peered":"2024-09-05T17:32:44.738093+0000","last_clean":"2024-09-05T17:32:44.738093+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:32:44.738093+0000","last_undegraded":"2024-09-05T17:32:44.738093+0000","last_fullsized":"2024-09-05T17:32:44.738093+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"121'677","reported_seq":3352,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.769616+0000","last_change":"2024-09-05T17:32:44.769892+0000","last_active":"2024-09-05T17:32:44.769616+0000","last_peered":"2024-09-05T17:32:44.769616+0000","last_clean":"2024-09-05T17:32:44.769616+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:32:44.769616+0000","last_undegraded":"2024-09-05T17:32:44.769616+0000","last_fullsized":"2024-09-05T17:32:44.769616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:43:00.909961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011761569999999999,"stat_sum":{"num_bytes":24164738,"num_objects":41,"num_object_clones":7,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":7,"num_read":5731,"num_read_kb":20520,"num_write":936,"num_write_kb":10147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.768675+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:32:44.768675+0000","last_peered":"2024-09-05T17:32:44.768675+0000","last_clean":"2024-09-05T17:32:44.768675+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:32:44.768675+0000","last_undegraded":"2024-09-05T17:32:44.768675+0000","last_fullsized":"2024-09-05T17:32:44.768675+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"119'463","reported_seq":2682,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.747046+0000","last_change":"2024-09-05T17:32:23.550216+0000","last_active":"2024-09-05T17:32:44.747046+0000","last_peered":"2024-09-05T17:32:44.747046+0000","last_clean":"2024-09-05T17:32:21.637655+0000","last_became_active":"2024-09-05T17:32:23.550216+0000","last_became_peered":"2024-09-05T17:32:23.550216+0000","last_unstale":"2024-09-05T17:32:44.747046+0000","last_undegraded":"2024-09-05T17:32:23.548314+0000","last_fullsized":"2024-09-05T17:32:23.548093+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:40:21.150007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010231579999999999,"stat_sum":{"num_bytes":80070274,"num_objects":70,"num_object_clones":19,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":70,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":15,"num_read":3023,"num_read_kb":48266,"num_write":521,"num_write_kb":29607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":70}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"122'427","reported_seq":6787,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.848809+0000","last_change":"2024-09-05T17:32:44.756798+0000","last_active":"2024-09-05T17:32:44.848809+0000","last_peered":"2024-09-05T17:32:44.848809+0000","last_clean":"2024-09-05T17:32:44.848809+0000","last_became_active":"2024-09-05T17:32:16.016556+0000","last_became_peered":"2024-09-05T17:32:16.016556+0000","last_unstale":"2024-09-05T17:32:44.848809+0000","last_undegraded":"2024-09-05T17:32:44.848809+0000","last_fullsized":"2024-09-05T17:32:44.848809+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:42:37.158570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003634834,"stat_sum":{"num_bytes":16693263,"num_objects":42,"num_object_clones":13,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":8,"num_read":6992,"num_read_kb":46425,"num_write":460,"num_write_kb":18981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"2.2","version":"22'2","reported_seq":59,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.768340+0000","last_change":"2024-09-05T17:32:23.558190+0000","last_active":"2024-09-05T17:32:44.768340+0000","last_peered":"2024-09-05T17:32:44.768340+0000","last_clean":"2024-09-05T17:30:34.066908+0000","last_became_active":"2024-09-05T17:32:23.558190+0000","last_became_peered":"2024-09-05T17:32:23.558190+0000","last_unstale":"2024-09-05T17:32:44.768340+0000","last_undegraded":"2024-09-05T17:32:23.556399+0000","last_fullsized":"2024-09-05T17:32:23.556175+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:24:58.704074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"121'1290","reported_seq":3297,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.768963+0000","last_change":"2024-09-05T17:32:44.768963+0000","last_active":"2024-09-05T17:32:44.768963+0000","last_peered":"2024-09-05T17:32:44.768963+0000","last_clean":"2024-09-05T17:32:44.768963+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:32:44.768963+0000","last_undegraded":"2024-09-05T17:32:44.768963+0000","last_fullsized":"2024-09-05T17:32:44.768963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1290,"log_dups_size":0,"ondisk_log_size":1290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:40:51.253022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057616000000000004,"stat_sum":{"num_bytes":29729203,"num_objects":57,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":15,"num_read":7976,"num_read_kb":10095,"num_write":2118,"num_write_kb":5693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"2.1","version":"0'0","reported_seq":220,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.733362+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:32:44.733362+0000","last_peered":"2024-09-05T17:32:44.733362+0000","last_clean":"2024-09-05T17:32:44.733362+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:32:44.733362+0000","last_undegraded":"2024-09-05T17:32:44.733362+0000","last_fullsized":"2024-09-05T17:32:44.733362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"121'499","reported_seq":8502,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.753903+0000","last_change":"2024-09-05T17:32:44.755048+0000","last_active":"2024-09-05T17:32:44.753903+0000","last_peered":"2024-09-05T17:32:44.753903+0000","last_clean":"2024-09-05T17:32:44.753903+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:32:44.753903+0000","last_undegraded":"2024-09-05T17:32:44.753903+0000","last_fullsized":"2024-09-05T17:32:44.753903+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:04:13.644958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019282819999999999,"stat_sum":{"num_bytes":41012736,"num_objects":53,"num_object_clones":13,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":10,"num_read":9697,"num_read_kb":43929,"num_write":566,"num_write_kb":11385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"2.0","version":"0'0","reported_seq":239,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.737488+0000","last_change":"2024-09-05T17:32:10.998471+0000","last_active":"2024-09-05T17:32:44.737488+0000","last_peered":"2024-09-05T17:32:44.737488+0000","last_clean":"2024-09-05T17:32:44.737488+0000","last_became_active":"2024-09-05T17:32:10.997586+0000","last_became_peered":"2024-09-05T17:32:10.997586+0000","last_unstale":"2024-09-05T17:32:44.737488+0000","last_undegraded":"2024-09-05T17:32:44.737488+0000","last_fullsized":"2024-09-05T17:32:44.737488+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:35:48.493112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"112'1570","reported_seq":5275,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.746752+0000","last_change":"2024-09-05T17:32:23.549968+0000","last_active":"2024-09-05T17:32:44.746752+0000","last_peered":"2024-09-05T17:32:44.746752+0000","last_clean":"2024-09-05T17:32:21.668429+0000","last_became_active":"2024-09-05T17:32:23.549968+0000","last_became_peered":"2024-09-05T17:32:23.549968+0000","last_unstale":"2024-09-05T17:32:44.746752+0000","last_undegraded":"2024-09-05T17:32:23.548218+0000","last_fullsized":"2024-09-05T17:32:23.547990+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1570,"log_dups_size":0,"ondisk_log_size":1570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:34:47.931974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069190400000000002,"stat_sum":{"num_bytes":69079129,"num_objects":57,"num_object_clones":17,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":57,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":15,"num_read":11139,"num_read_kb":20159,"num_write":2739,"num_write_kb":11124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":57}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":50,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.733133+0000","last_change":"2024-09-05T17:32:23.558343+0000","last_active":"2024-09-05T17:32:44.733133+0000","last_peered":"2024-09-05T17:32:44.733133+0000","last_clean":"2024-09-05T17:30:32.045423+0000","last_became_active":"2024-09-05T17:32:23.558343+0000","last_became_peered":"2024-09-05T17:32:23.558343+0000","last_unstale":"2024-09-05T17:32:44.733133+0000","last_undegraded":"2024-09-05T17:32:23.557216+0000","last_fullsized":"2024-09-05T17:32:23.557034+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:01:21.121375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":336,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.737746+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:32:44.737746+0000","last_peered":"2024-09-05T17:32:44.737746+0000","last_clean":"2024-09-05T17:32:44.737746+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:32:44.737746+0000","last_undegraded":"2024-09-05T17:32:44.737746+0000","last_fullsized":"2024-09-05T17:32:44.737746+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"119'307","reported_seq":2960,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.747420+0000","last_change":"2024-09-05T17:32:44.748869+0000","last_active":"2024-09-05T17:32:44.747420+0000","last_peered":"2024-09-05T17:32:44.747420+0000","last_clean":"2024-09-05T17:32:44.747420+0000","last_became_active":"2024-09-05T17:32:20.527382+0000","last_became_peered":"2024-09-05T17:32:20.527382+0000","last_unstale":"2024-09-05T17:32:44.747420+0000","last_undegraded":"2024-09-05T17:32:44.747420+0000","last_fullsized":"2024-09-05T17:32:44.747420+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:19:14.000076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024424630000000002,"stat_sum":{"num_bytes":73750583,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":13,"num_read":2154,"num_read_kb":21973,"num_write":334,"num_write_kb":23331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":10573315,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.9","version":"121'659","reported_seq":4683,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.734220+0000","last_change":"2024-09-05T17:32:44.735024+0000","last_active":"2024-09-05T17:32:44.734220+0000","last_peered":"2024-09-05T17:32:44.734220+0000","last_clean":"2024-09-05T17:32:44.734220+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:32:44.734220+0000","last_undegraded":"2024-09-05T17:32:44.734220+0000","last_fullsized":"2024-09-05T17:32:44.734220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:36:12.361781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015075620000000001,"stat_sum":{"num_bytes":42932122,"num_objects":56,"num_object_clones":13,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":9,"num_read":6849,"num_read_kb":21959,"num_write":930,"num_write_kb":4562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.a","version":"121'499","reported_seq":4006,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.733084+0000","last_change":"2024-09-05T17:32:44.734338+0000","last_active":"2024-09-05T17:32:44.733084+0000","last_peered":"2024-09-05T17:32:44.733084+0000","last_clean":"2024-09-05T17:32:44.733084+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:32:44.733084+0000","last_undegraded":"2024-09-05T17:32:44.733084+0000","last_fullsized":"2024-09-05T17:32:44.733084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:38:40.687268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013008049999999999,"stat_sum":{"num_bytes":32106419,"num_objects":45,"num_object_clones":9,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":8,"num_read":4050,"num_read_kb":25705,"num_write":589,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.b","version":"121'952","reported_seq":10545,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.749142+0000","last_change":"2024-09-05T17:32:44.750740+0000","last_active":"2024-09-05T17:32:44.749142+0000","last_peered":"2024-09-05T17:32:44.749142+0000","last_clean":"2024-09-05T17:32:44.749142+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:32:44.749142+0000","last_undegraded":"2024-09-05T17:32:44.749142+0000","last_fullsized":"2024-09-05T17:32:44.749142+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":952,"log_dups_size":0,"ondisk_log_size":952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:01:46.542403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039902000000000002,"stat_sum":{"num_bytes":66367555,"num_objects":53,"num_object_clones":14,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":8,"num_read":13241,"num_read_kb":36757,"num_write":1377,"num_write_kb":15738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.c","version":"120'293","reported_seq":2324,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.746888+0000","last_change":"2024-09-05T17:32:23.550210+0000","last_active":"2024-09-05T17:32:44.746888+0000","last_peered":"2024-09-05T17:32:44.746888+0000","last_clean":"2024-09-05T17:32:21.681903+0000","last_became_active":"2024-09-05T17:32:23.550210+0000","last_became_peered":"2024-09-05T17:32:23.550210+0000","last_unstale":"2024-09-05T17:32:44.746888+0000","last_undegraded":"2024-09-05T17:32:23.548543+0000","last_fullsized":"2024-09-05T17:32:23.548408+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:56:53.046972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012305,"stat_sum":{"num_bytes":48313706,"num_objects":46,"num_object_clones":15,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":46,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":13,"num_read":1853,"num_read_kb":26569,"num_write":279,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[{"shards":"3","objects":46}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"122'364","reported_seq":1700,"reported_epoch":122,"state":"active+undersized+degraded","last_fresh":"2024-09-05T17:32:44.738780+0000","last_change":"2024-09-05T17:32:23.549779+0000","last_active":"2024-09-05T17:32:44.738780+0000","last_peered":"2024-09-05T17:32:44.738780+0000","last_clean":"2024-09-05T17:32:22.171251+0000","last_became_active":"2024-09-05T17:32:23.549779+0000","last_became_peered":"2024-09-05T17:32:23.549779+0000","last_unstale":"2024-09-05T17:32:44.738780+0000","last_undegraded":"2024-09-05T17:32:23.548604+0000","last_fullsized":"2024-09-05T17:32:23.548380+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:33:34.952515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002229342,"stat_sum":{"num_bytes":54087467,"num_objects":48,"num_object_clones":13,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":48,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":10,"num_read":2144,"num_read_kb":17890,"num_write":393,"num_write_kb":14023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[{"shards":"7","objects":48}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"121'231","reported_seq":1890,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.739720+0000","last_change":"2024-09-05T17:32:44.741377+0000","last_active":"2024-09-05T17:32:44.739720+0000","last_peered":"2024-09-05T17:32:44.739720+0000","last_clean":"2024-09-05T17:32:44.739720+0000","last_became_active":"2024-09-05T17:30:43.600952+0000","last_became_peered":"2024-09-05T17:30:43.600952+0000","last_unstale":"2024-09-05T17:32:44.739720+0000","last_undegraded":"2024-09-05T17:32:44.739720+0000","last_fullsized":"2024-09-05T17:32:44.739720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:19:31.639486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029977139999999998,"stat_sum":{"num_bytes":50790519,"num_objects":42,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":10,"num_read":1468,"num_read_kb":36539,"num_write":247,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.f","version":"121'404","reported_seq":4442,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.740940+0000","last_change":"2024-09-05T17:32:44.742179+0000","last_active":"2024-09-05T17:32:44.740940+0000","last_peered":"2024-09-05T17:32:44.740940+0000","last_clean":"2024-09-05T17:32:44.740940+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:32:44.740940+0000","last_undegraded":"2024-09-05T17:32:44.740940+0000","last_fullsized":"2024-09-05T17:32:44.740940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:42:31.133143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001717662,"stat_sum":{"num_bytes":25970285,"num_objects":54,"num_object_clones":13,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":9,"num_read":4772,"num_read_kb":16384,"num_write":477,"num_write_kb":6022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.10","version":"121'527","reported_seq":4364,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.733014+0000","last_change":"2024-09-05T17:32:44.733393+0000","last_active":"2024-09-05T17:32:44.733014+0000","last_peered":"2024-09-05T17:32:44.733014+0000","last_clean":"2024-09-05T17:32:44.733014+0000","last_became_active":"2024-09-05T17:32:15.016683+0000","last_became_peered":"2024-09-05T17:32:15.016683+0000","last_unstale":"2024-09-05T17:32:44.733014+0000","last_undegraded":"2024-09-05T17:32:44.733014+0000","last_fullsized":"2024-09-05T17:32:44.733014+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:18:02.764647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001005604,"stat_sum":{"num_bytes":29848913,"num_objects":43,"num_object_clones":10,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":8,"num_read":4933,"num_read_kb":22042,"num_write":670,"num_write_kb":9417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":2696193,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.11","version":"121'298","reported_seq":1658,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.737934+0000","last_change":"2024-09-05T17:32:44.739640+0000","last_active":"2024-09-05T17:32:44.737934+0000","last_peered":"2024-09-05T17:32:44.737934+0000","last_clean":"2024-09-05T17:32:44.737934+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:32:44.737934+0000","last_undegraded":"2024-09-05T17:32:44.737934+0000","last_fullsized":"2024-09-05T17:32:44.737934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:57:38.883403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020620399999999998,"stat_sum":{"num_bytes":29999053,"num_objects":51,"num_object_clones":9,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":8,"num_read":1373,"num_read_kb":23473,"num_write":292,"num_write_kb":9251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.12","version":"119'513","reported_seq":8278,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.754033+0000","last_change":"2024-09-05T17:32:44.755155+0000","last_active":"2024-09-05T17:32:44.754033+0000","last_peered":"2024-09-05T17:32:44.754033+0000","last_clean":"2024-09-05T17:32:44.754033+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:32:44.754033+0000","last_undegraded":"2024-09-05T17:32:44.754033+0000","last_fullsized":"2024-09-05T17:32:44.754033+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:52:36.121160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020189420000000001,"stat_sum":{"num_bytes":70277013,"num_objects":58,"num_object_clones":18,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":15,"num_read":9067,"num_read_kb":23288,"num_write":569,"num_write_kb":9508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"26","length":"7"}]},{"pgid":"3.13","version":"117'671","reported_seq":2652,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-09-05T17:32:44.737837+0000","last_change":"2024-09-05T17:32:44.738442+0000","last_active":"2024-09-05T17:32:44.737837+0000","last_peered":"2024-09-05T17:32:44.737837+0000","last_clean":"2024-09-05T17:32:44.737837+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:32:44.737837+0000","last_undegraded":"2024-09-05T17:32:44.737837+0000","last_fullsized":"2024-09-05T17:32:44.737837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:12:02.765541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088440000000000003,"stat_sum":{"num_bytes":28712811,"num_objects":54,"num_object_clones":11,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":10,"num_read":5832,"num_read_kb":9782,"num_write":803,"num_write_kb":5557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"26","length":"7"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1326014481,"num_objects":1574,"num_object_clones":389,"num_object_copies":3148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":484,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1574,"num_whiteouts":322,"num_read":165291,"num_read_kb":798068,"num_write":21697,"num_write_kb":363537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1844,"num_bytes_recovered":65318312,"num_keys_recovered":191,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38932480,"data_stored":296586299,"data_compressed":11769115,"data_compressed_allocated":25706496,"data_compressed_original":288753782,"omap_allocated":0,"internal_metadata":0},"log_size":16950,"ondisk_log_size":16950,"up":55,"acting":55,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":14,"acting":14,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542176,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38704,"kb_used_data":7516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333136,"statfs":{"total":96636764160,"available":96597131264,"internally_reserved":0,"allocated":7696384,"data_stored":49953914,"data_compressed":1820386,"data_compressed_allocated":3997696,"data_compressed_original":47930351,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542176,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42204,"kb_used_data":2684,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329636,"statfs":{"total":96636764160,"available":96593547264,"internally_reserved":0,"allocated":2748416,"data_stored":6843118,"data_compressed":337186,"data_compressed_allocated":634880,"data_compressed_original":5775360,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77636,"kb_used_data":6184,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94294204,"statfs":{"total":96636764160,"available":96557264896,"internally_reserved":0,"allocated":6332416,"data_stored":37045317,"data_compressed":1656096,"data_compressed_allocated":3317760,"data_compressed_original":35382965,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66780,"kb_used_data":9168,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94305060,"statfs":{"total":96636764160,"available":96568381440,"internally_reserved":0,"allocated":9388032,"data_stored":58023821,"data_compressed":2281583,"data_compressed_allocated":5009408,"data_compressed_original":55613717,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85116,"kb_used_data":9512,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94286724,"statfs":{"total":96636764160,"available":96549605376,"internally_reserved":0,"allocated":9740288,"data_stored":74093426,"data_compressed":2810311,"data_compressed_allocated":6311936,"data_compressed_original":72224142,"omap_allocated":1593,"internal_metadata":77396423},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542176,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47612,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324228,"statfs":{"total":96636764160,"available":96588009472,"internally_reserved":0,"allocated":2588672,"data_stored":6477329,"data_compressed":340017,"data_compressed_allocated":581632,"data_compressed_original":5482789,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53236,"kb_used_data":4000,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94318604,"statfs":{"total":96636764160,"available":96582250496,"internally_reserved":0,"allocated":4096000,"data_stored":21104985,"data_compressed":661071,"data_compressed_allocated":1617920,"data_compressed_original":19869633,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65412,"kb_used_data":7504,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94306428,"statfs":{"total":96636764160,"available":96569782272,"internally_reserved":0,"allocated":7684096,"data_stored":49418107,"data_compressed":1853975,"data_compressed_allocated":4284416,"data_compressed_original":47552073,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6197248,"data_stored":48149976,"data_compressed":1847567,"data_compressed_allocated":4247552,"data_compressed_original":46962249,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2650112,"data_stored":20427313,"data_compressed":661071,"data_compressed_allocated":1617920,"data_compressed_original":19869633,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1146880,"data_stored":5799676,"data_compressed":340017,"data_compressed_allocated":581632,"data_compressed_original":5482789,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8298496,"data_stored":73415773,"data_compressed":2810311,"data_compressed_allocated":6311936,"data_compressed_original":72224142,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":7946240,"data_stored":57346168,"data_compressed":2281583,"data_compressed_allocated":5009408,"data_compressed_original":55613717,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5193728,"data_stored":36596051,"data_compressed":1676588,"data_compressed_allocated":3342336,"data_compressed_original":35468981,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1306624,"data_stored":6165465,"data_compressed":337186,"data_compressed_allocated":634880,"data_compressed_original":5775360,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6193152,"data_stored":48685877,"data_compressed":1814792,"data_compressed_allocated":3960832,"data_compressed_original":47356911,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:32:46.507 INFO:tasks.thrashosds.thrasher:Setting 3.10 to [1, 7] 2024-09-05T17:32:46.508 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.10', '1', '7'] 2024-09-05T17:32:46.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.10 1 7 2024-09-05T17:32:46.545 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:46.545 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:46.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:46.586 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:46.584+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:46.687 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:46.686+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:46.724 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:46.724 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:46.739 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:46.788 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:46.784+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:46.889 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:46.888+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:46.911 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:46.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:46.990 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:46.988+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:47.048 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:47.062 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:47.109 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:47.110+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:47.187 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:47.187 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:47.192 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:47.190+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:47.200 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:47.292 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:47.290+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:47.369 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:47.369 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:47.383 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:47.425 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:47.426+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:47.494 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:47.492+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:47.552 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:47.552 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:47.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:47.613 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:47.614+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:47.694 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:47.694 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:47.695 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:47.694+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:47.697 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:47.709 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:47.750 INFO:teuthology.orchestra.run.smithi050.stderr:set 3.10 pg_upmap mapping to [1,7] 2024-09-05T17:32:47.759 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:32:47.825 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:47.826+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:47.855 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:47.855 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:47.861 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:47.861 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:47.874 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:47.880 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:47.881 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:47.897 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:47.894+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:47.898 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:47.898 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:47.924 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:47.925 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:47.945 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:47.945 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:47.945 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:47.980 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:47.980 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:47.991 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:47.991 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:47.991 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:47.991 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:47.991 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:47.998 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:47.998+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:48.006 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:48.008 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:48.009 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:48.012 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:48.013 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:48.099 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:48.098+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:48.129 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:48.129 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:48.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:48.129 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:48.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.129 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.129 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:48.129 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.424705299, 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:48.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:32:48.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.424657915, 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:32:48.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.424613243, 2024-09-05T17:32:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:32:48.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.142 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.424567901, 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:32:48.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:32:48.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.147 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.424498891, 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:32:48.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:32:48.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.424450454, 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:32:48.152 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:48.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:32:48.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:32:48.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.424404096, 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.423741506, 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:32:48.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:32:48.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.42365015999999, 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:32:48.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.42358867999999, 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:32:48.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:32:48.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.42353178, 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:32:48.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:48.179 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.423438539, 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.183 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.42337901099999, 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.184 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:32:48.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:32:48.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.416223049, 2024-09-05T17:32:48.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:32:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.416161582, 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:32:48.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:48.197 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.414293613, 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:32:48.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.41425310299999, 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:32:48.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:32:48.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.414214637, 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:32:48.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:32:48.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:48.211 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.41415653, 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:32:48.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:32:48.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.414099229, 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:32:48.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.221 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.221 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:48.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:48.223 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:48.222+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:48.323 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:48.320+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:48.347 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:48.348 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:48.348 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:48.362 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:48.424 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:48.422+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:48.522 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:48.522 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:48.525 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:48.524+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:48.536 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:48.626 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:48.624+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243725478000002, 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:32:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:32:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243677196, 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243630836000001, 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:32:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:32:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243582234999998, 2024-09-05T17:32:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243526635999999, 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:32:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:32:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243481392, 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:32:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:32:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:32:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243436893000002, 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:32:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243392935999999, 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:32:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:32:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243347599000003, 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243301150000001, 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:32:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:32:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243257587999999, 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:32:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243212213, 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:32:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:32:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243163101999997, 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:32:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:32:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:32:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243124168000001, 2024-09-05T17:32:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:32:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243054506, 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:32:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.243001954999997, 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:32:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.242856398999997, 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.770 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.242804818000003, 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:32:48.774 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:32:48.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.010782446999997, 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:32:48.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:48.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:116533 3.7 3:e6924f8b:::rbd_data.11402f0626d4.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:32:48.784 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.428528747000001, 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.069225986000000003, 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116533 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272329+0000", 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272340+0000", 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.172e-05 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272372+0000", 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1192000000000002e-05 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272387+0000", 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5339999999999999e-05 2024-09-05T17:32:48.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272494+0000", 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650300000000001 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272629+0000", 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135845 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:48.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.286878+0000", 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014248241 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341353+0000", 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054475896000000003 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341387+0000", 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3043000000000002e-05 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341475+0000", 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8103000000000007e-05 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341552+0000", 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7539000000000004e-05 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:48.790 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:48.792 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:32:48.793 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:48.793 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:48.790+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:48.893 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:48.892+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:48.963 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:48.963 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:48.963 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:48.963 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:48.977 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:48.994 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:48.994+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:49.095 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:49.094+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:49.137 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:49.137 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:49.151 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:49.196 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:49.194+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:49.278 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:49.278 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 142.26023827700001, 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:32:49.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:32:49.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:32:49.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:49.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.286 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.893246914000002, 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.288 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:32:49.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.292 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.893195998000003, 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:32:49.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:32:49.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.893146152, 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:32:49.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:32:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:32:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:32:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:32:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:32:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:32:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:32:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:32:49.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.893100844000003, 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.305 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:32:49.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.309 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.893052828000002, 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:32:49.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:32:49.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:32:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:32:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:32:49.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.892979695999998, 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:49.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:32:49.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:32:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:32:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:32:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.892930669999998, 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:32:49.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:32:49.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.892845653000002, 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:32:49.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:32:49.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.892789931000003, 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:32:49.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:32:49.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.892727073000003, 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:32:49.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.339 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.892580500000001, 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.340 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.885677268999999, 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:32:49.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.885655475, 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:32:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:49.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.885612012000003, 2024-09-05T17:32:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:32:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.356 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:49.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:32:49.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:32:49.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:32:49.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:32:49.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:32:49.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:49.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:32:49.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:32:49.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:32:49.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:32:49.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:32:49.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:32:49.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:32:49.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:32:49.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.364 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.365 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.365 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:49.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.885575340999999, 2024-09-05T17:32:49.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:32:49.366 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.366 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.367 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:32:49.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:49.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:49.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:32:49.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:32:49.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:32:49.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:32:49.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:32:49.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:32:49.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:32:49.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:32:49.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:32:49.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:32:49.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:32:49.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:32:49.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:32:49.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:32:49.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.375 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.376 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.376 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.376 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:49.377 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.885535034, 2024-09-05T17:32:49.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:32:49.377 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.377 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.378 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:32:49.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:49.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:49.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:32:49.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:32:49.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:32:49.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:32:49.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:32:49.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:32:49.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:32:49.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:32:49.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:32:49.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:32:49.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:32:49.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:32:49.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:32:49.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:32:49.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.885496328000002, 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:32:49.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:32:49.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.105490080999999, 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:32:49.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:32:49.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:32:49.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:32:49.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:32:49.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.400 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.734159505000001, 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.401 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:49.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:49.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:49.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:49.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:32:49.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:32:49.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:49.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:32:49.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:49.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:32:49.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:32:49.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:49.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:32:49.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:32:49.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:49.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:32:49.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:32:49.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:49.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:49.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:49.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:32:49.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:32:49.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:49.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:49.411 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:49.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:49.414 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:49.410+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:49.513 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:49.510+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:49.550 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:127565 3.10 3.bb351dd0 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e126)", 2024-09-05T17:32:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 0.78873439700000003, 2024-09-05T17:32:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.78877513600000004, 2024-09-05T17:32:49.550 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "waiting for peered", 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 127565 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761933+0000", 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6700000000000002e-06 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761953+0000", 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0472999999999999e-05 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762007+0000", 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4135000000000003e-05 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762037+0000", 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9992999999999999e-05 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.554 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762279+0000", 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024152900000000001 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762304+0000", 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4922999999999998e-05 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.767683+0000", 2024-09-05T17:32:49.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053790729999999998 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.767696+0000", 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2914e-05 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: ], 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 1 2024-09-05T17:32:49.556 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:49.565 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:49.653 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:49.654+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:49.715 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:49.714+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:49.736 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:49.736 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:49.736 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:49.737 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:49.737 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:49.751 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:49.816 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:49.812+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:49.916 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:49.912+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:49.922 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:49.922 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:49.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:49.922 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:49.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.838797926, 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:32:49.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:32:49.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.927 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.838776, 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:32:49.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.838754553, 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:32:49.932 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:32:49.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.83871626299999, 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.937 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:32:49.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.83870144700001, 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.946 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.83869024800001, 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.947 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:32:49.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.951 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.83867940899999, 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:32:49.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:32:49.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.838668932, 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:32:49.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:32:49.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.83865811, 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.961 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.962 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.962 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.962 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:32:49.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:49.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.83864771, 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.83862935800001, 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:32:49.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:32:49.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.838445734, 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:49.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:32:49.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16658 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7376896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:49.981 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.82978644000001, 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053306620999999998, 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16658 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091803+0000", 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3300000000000002e-07 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091815+0000", 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1371e-05 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091827+0000", 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091833+0000", 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3169999999999998e-06 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144888+0000", 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053054832000000003 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.144988+0000", 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9807000000000002e-05 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145109+0000", 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012171399999999999 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.829745899, 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.986 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.988 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.82970607, 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:32:49.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.829678595, 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:32:49.995 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:32:49.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:49.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:32:49.999 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.829640086, 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:50.000 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:50.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:32:50.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:50.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.004 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 109.829597346, 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:32:50.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:50.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:32:50.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.428319131999999, 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:32:50.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:50.011 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:32:50.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:32:50.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:32:50.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:124216 3.12 3:48c94c2b:::rbd_data.1140e0d69f44.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.747737463, 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.066132150000000001, 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:50.018 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 124216 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:50.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173855+0000", 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1370000000000002e-06 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173869+0000", 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4362000000000001e-05 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:50.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173905+0000", 2024-09-05T17:32:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6022000000000002e-05 2024-09-05T17:32:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173922+0000", 2024-09-05T17:32:50.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-05 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.174085+0000", 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016325000000000001 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.174317+0000", 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023151500000000001 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.186040+0000", 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011722784999999999 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239783+0000", 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053742749999999999 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239815+0000", 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2212000000000003e-05 2024-09-05T17:32:50.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239906+0000", 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1667000000000002e-05 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239984+0000", 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7579999999999999e-05 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:50.024 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:50.025 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:50.025 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:50.025 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:50.027 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:50.028 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:50.024+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:50.127 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:50.126+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:50.214 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:50.214 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:50.215 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:50.215 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:50.228 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:50.224+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:50.233 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:50.239 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:50.240 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:50.259 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:50.259 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:50.292 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:50.292 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:50.312 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:50.312 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:50.329 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:50.326+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:50.336 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:50.336 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:50.337 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:50.359 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:50.359 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:50.377 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:50.377 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:50.380 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:50.380 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:50.383 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:50.383 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:50.393 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:50.430 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:50.428+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:50.530 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:50.528+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:50.559 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:50.559 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:50.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:50.632 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:50.628+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:50.695 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:50.695 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:50.710 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:50.757 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:50.758+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:50.794 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:32:50.834 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:50.832+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:50.845 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:50.845 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:50.860 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:50.945 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:50.946+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:51.032 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:51.033 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:51.036 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:51.034+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:51.047 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:51.137 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:51.138+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:51.211 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:51.211 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:51.225 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:51.238 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:51.236+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:51.342 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:51.340+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:51.392 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:51.393 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:51.407 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:51.453 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:51.454+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:51.534 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:51.534 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:51.545 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:51.546+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:51.548 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:51.646 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:51.644+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:51.681 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:51.681 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:51.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:51.781 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:51.780+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:51.785 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:32:51.848 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:51.844+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:51.870 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:51.870 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:51.887 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:51.973 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:51.972+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:52.049 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:52.050+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:52.055 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:52.055 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:52.070 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:52.157 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:52.156+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:52.237 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:52.238 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:52.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:52.252 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:52.248+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:52.353 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:52.352+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:52.384 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:52.410 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:52.410 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:52.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:52.453 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:52.454+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:52.545 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:52.546 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:52.554 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:52.552+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:52.562 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:52.563 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:52.581 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:52.581 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:52.599 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:52.600 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:52.600 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:52.600 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:52.613 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:52.618 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:52.618 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:52.636 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:52.636 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:52.656 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:52.657 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:52.657 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:52.656+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:52.662 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:52.663 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:52.756 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:52.754+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:52.778 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:32:52.778 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:52.784 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-09-05T17:32:52.784 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:32:52.784 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2024-09-05T17:32:52.784 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-05T17:32:52.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-05T17:32:52.787 INFO:tasks.ceph.osd.5:Started 2024-09-05T17:32:52.787 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:32:52.792 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:52.857 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:52.858+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:52.906 INFO:teuthology.orchestra.run.smithi110.stderr:no valid command found; 10 closest matches: 2024-09-05T17:32:52.906 INFO:teuthology.orchestra.run.smithi110.stderr:0 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:1 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:2 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:abort 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:assert 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:config diff 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:config diff get 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:config get 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:config help [] 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:config set ... 2024-09-05T17:32:52.907 INFO:teuthology.orchestra.run.smithi110.stderr:admin_socket: invalid command 2024-09-05T17:32:52.909 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:32:52.909 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-09-05T17:32:52.955 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:32:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:32:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:32:52.955 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:52.958 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:52.956+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:52.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:53.061 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:53.060+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:53.137 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:32:53.137 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:32:53.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:32:53.137 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:32:53.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 146.12016732800001, 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.138 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:32:53.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:53.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:32:53.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.753175964999997, 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.145 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:32:53.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.149 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.753125048999998, 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:32:53.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.753075203000002, 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.154 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:32:53.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.753029894999997, 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:32:53.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:32:53.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.752981879000004, 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:32:53.163 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:32:53.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:32:53.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:32:53.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.752908746999999, 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.168 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:32:53.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:32:53.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.752859721, 2024-09-05T17:32:53.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:53.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:32:53.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.752774703999997, 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.178 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:32:53.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.184 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.184 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:53.184 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.752718981999998, 2024-09-05T17:32:53.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:32:53.184 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:32:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:32:53.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.188 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.752656123999998, 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.189 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:32:53.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:32:53.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:32:53.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.752509551000003, 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:32:53.193 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:32:53.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.74560632, 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:32:53.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:32:53.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.202 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.745584526000002, 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:32:53.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.745541062999997, 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.211 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.745504392000001, 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:32:53.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:32:53.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:32:53.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:32:53.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:53.217 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.745464085000002, 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:53.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:32:53.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.222 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 54.745425378999997, 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:32:53.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.965419132000001, 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:32:53.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:32:53.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.594088555999999, 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:32:53.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:32:53.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:32:53.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:32:53.240 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:32:53.242 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:53.240+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:53.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:53.343 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:53.340+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:53.382 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:53.382 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:53.382 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:53.382 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:53.397 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:53.444 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:53.440+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:53.517 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:53.518 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:53.518 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:53.533 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:53.544 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:53.540+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:53.645 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:53.646+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:53.667 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:53.667 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:53.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.582077766, 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.668 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.670 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.672 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.58205584, 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:32:53.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.582034393, 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:32:53.677 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:32:53.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.681 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.58199610299999, 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.682 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.684 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.686 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.581981287, 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:53.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.689 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:32:53.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.58197008800001, 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:32:53.691 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:32:53.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:32:53.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.695 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.58195924899999, 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.696 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:53.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:32:53.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.581948772, 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.701 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:53.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:32:53.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:32:53.705 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.58193795, 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.706 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:32:53.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.58192755, 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.711 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:32:53.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:32:53.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:32:53.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:32:53.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:32:53.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:32:53.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:32:53.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:32:53.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:32:53.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:32:53.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:32:53.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.718 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.718 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.718 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:53.719 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.58190919800001, 2024-09-05T17:32:53.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:32:53.719 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.719 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.719 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.720 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.720 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.720 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.720 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:32:53.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.720 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:53.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:53.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:32:53.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:32:53.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:32:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:32:53.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:32:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:32:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:32:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:32:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:32:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:32:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:32:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:32:53.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:32:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.581725574, 2024-09-05T17:32:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:32:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:32:53.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:32:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:32:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:32:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:32:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:32:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:32:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:32:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:32:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:32:53.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:32:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:32:53.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:32:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:32:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:32:53.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.740 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.573025739, 2024-09-05T17:32:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:32:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.741 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:32:53.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.57298591, 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.746 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:32:53.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:32:53.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:53.750 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.572958435, 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:32:53.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.572919926, 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.755 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:32:53.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 113.572877186, 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.760 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:32:53.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:53.764 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 76.171598971999998, 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:32:53.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:32:53.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:32:53.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:124216 3.12 3:48c94c2b:::rbd_data.1140e0d69f44.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 17.491017303, 2024-09-05T17:32:53.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.066132150000000001, 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 124216 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173855+0000", 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1370000000000002e-06 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173869+0000", 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4362000000000001e-05 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173905+0000", 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6022000000000002e-05 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173922+0000", 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-05 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.174085+0000", 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016325000000000001 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.174317+0000", 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023151500000000001 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.186040+0000", 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011722784999999999 2024-09-05T17:32:53.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239783+0000", 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053742749999999999 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239815+0000", 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2212000000000003e-05 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:53.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239906+0000", 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1667000000000002e-05 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239984+0000", 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7579999999999999e-05 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:127565 3.10 3:0bb8acdd:::rbd_header.114045ce5fbb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e126)", 2024-09-05T17:32:53.778 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 4.902941137, 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2227427259999999, 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 127565 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:53.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761933+0000", 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6700000000000002e-06 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761953+0000", 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0472999999999999e-05 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762007+0000", 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4135000000000003e-05 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762037+0000", 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9992999999999999e-05 2024-09-05T17:32:53.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762279+0000", 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024152900000000001 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762304+0000", 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4922999999999998e-05 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.767683+0000", 2024-09-05T17:32:53.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053790729999999998 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.767696+0000", 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2914e-05 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.983967+0000", 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.216271307 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:53.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.984288+0000", 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032119199999999998 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.984671+0000", 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038251700000000002 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:53.784 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:53.786 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:53.786 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:53.786+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:53.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:32:53.886 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:53.886+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:53.902 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:53.900+0000 7fe5e70197c0 -1 Falling back to public interface 2024-09-05T17:32:53.987 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:53.986+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:53.989 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:53.989 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:53.989 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:53.989 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:54.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:54.093 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:54.094+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:54.166 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:54.166 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:54.166 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:54.166 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:54.166 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:54.180 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:54.221 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:54.222+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:54.290 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:54.288+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:54.345 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:54.345 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:54.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:54.345 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.506064209000002, 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:32:54.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:32:54.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.506018750000003, 2024-09-05T17:32:54.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.354 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505990562999997, 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:32:54.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505962951999997, 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:32:54.359 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:32:54.363 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505936235999997, 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.364 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:54.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505907325000003, 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.369 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505876094000001, 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:32:54.373 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:32:54.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:32:54.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505846071999997, 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.378 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:32:54.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505819176000003, 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:54.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:32:54.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:32:54.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505722435999999, 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:32:54.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505691831, 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:32:54.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.397 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505664502999998, 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:32:54.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:32:54.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505637616000001, 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.402 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:32:54.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505610304999998, 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.407 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:54.411 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.505273121000002, 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:32:54.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:32:54.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:32:54.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.504256042000002, 2024-09-05T17:32:54.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:32:54.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:32:54.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.504146532999997, 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.422 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:54.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.426 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.504080051999999, 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:32:54.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:32:54.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.504020265999998, 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:32:54.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:54.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:127565 3.10 3.bb351dd0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:32:54.435 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.4546160099999996, 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.88126017199999995, 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 127565 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:54.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888785+0000", 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6360000000000001e-06 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888792+0000", 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9280000000000004e-06 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888808+0000", 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5889999999999999e-05 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888818+0000", 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0202e-05 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888877+0000", 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8641999999999999e-05 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888884+0000", 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2479999999999999e-06 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.770018+0000", 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.88113417199999999 2024-09-05T17:32:54.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.770044+0000", 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5454000000000001e-05 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:54.440 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:54.442 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:54.442 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:54.442+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:54.542 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:54.542+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:54.616 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:54.616 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:54.616 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:54.616 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:54.630 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:54.644 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:54.644+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:54.663 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:54.744 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:54.742+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:54.795 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:54.795 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:54.795 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:54.795 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:54.796 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:54.813 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:32:54.815 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:54.829 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:54.830 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:54.846 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:54.844+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:54.847 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:54.847 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:54.864 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:54.865 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:54.882 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:54.882 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:54.904 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:54.905 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:54.946 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:54.946 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:54.946 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:54.946+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:54.979 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:54.979 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:54.982 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:54.983 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:54.986 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:54.987 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:54.995 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:55.081 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:55.082+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:55.148 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:55.146+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:55.163 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:55.163 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:55.177 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:55.265 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:55.266+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:55.350 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:55.350+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:55.351 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:55.351 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:55.365 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:55.453 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:55.454+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:55.534 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:55.535 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:55.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:55.597 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:55.598+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:55.653 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:55.654+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:55.682 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:55.682 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:55.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:55.754 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:55.754+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:55.820 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:55.821 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:55.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:55.855 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:55.854+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:55.957 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:55.954+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:55.967 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:55.967 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:55.984 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:32:56.058 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:56.056+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:56.127 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:56.127 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:56.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:32:56.158 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:56.158+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:56.259 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:56.258+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:56.307 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:56.307 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:56.321 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:32:56.365 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:56.364+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:56.442 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:56.442 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:56.456 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:32:56.462 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:56.462+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:56.563 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:56.560+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:56.624 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:56.624 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:56.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:32:56.664 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:56.662+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:56.765 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:56.764+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:56.800 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:56.800 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:56.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:32:56.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:32:56.901 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:56.900+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:56.967 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:56.964+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:56.988 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:32:56.988 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:56.989 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:57.003 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:32:57.069 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:57.068+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:57.130 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:57.130 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:57.156 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:57.156 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:57.156 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:57.156 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:57.163 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:57.163 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:57.169 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:57.170+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:57.174 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:32:57.184 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:57.185 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:57.201 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:57.201 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:57.221 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:57.222 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:57.222 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:57.242 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:57.242 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:57.260 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:57.261 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:57.264 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:57.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:57.311 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:57.311 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:57.312 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:57.312 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:57.312 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:57.312 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:57.310+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:57.325 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:32:57.371 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:57.368+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:57.471 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:57.468+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:57.501 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416878037, 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.502 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.506 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416856111, 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.507 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:32:57.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:32:57.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.41683466400001, 2024-09-05T17:32:57.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:57.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.515 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416796374, 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.516 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:32:57.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.520 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416781558, 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:32:57.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:32:57.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416770359, 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.525 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:32:57.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:32:57.529 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.41675952, 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.530 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.534 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416749043, 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:32:57.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416738221, 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.539 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:32:57.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:32:57.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.41672782099999, 2024-09-05T17:32:57.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.546 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.547 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:32:57.548 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416709469, 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.549 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:32:57.550 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.551 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.552 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.553 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.416525845, 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.554 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:32:57.555 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.556 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.557 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.40782600999999, 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.558 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.559 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.560 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:32:57.561 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.562 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.40778618100001, 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.563 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.564 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.565 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:32:57.566 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.567 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.407758706, 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.568 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:32:57.569 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.570 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.571 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.407720197, 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:32:57.572 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.573 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:32:57.574 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:32:57.575 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.576 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 117.40767745700001, 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.578 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:32:57.579 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.580 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:32:57.581 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.006399243000004, 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.582 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:32:57.583 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:32:57.584 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.585 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.586 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:32:57.587 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:57.588 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:124216 3.12 3:48c94c2b:::rbd_data.1140e0d69f44.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-05T17:32:57.589 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 21.325817573999998, 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.066132150000000001, 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 124216 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.590 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173855+0000", 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1370000000000002e-06 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.591 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173869+0000", 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4362000000000001e-05 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173905+0000", 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6022000000000002e-05 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173922+0000", 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-05 2024-09-05T17:32:57.592 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.174085+0000", 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016325000000000001 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.174317+0000", 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023151500000000001 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:57.593 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.186040+0000", 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011722784999999999 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239783+0000", 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053742749999999999 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239815+0000", 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2212000000000003e-05 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.594 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239906+0000", 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1667000000000002e-05 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239984+0000", 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7579999999999999e-05 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:127565 3.10 3:0bb8acdd:::rbd_header.114045ce5fbb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e126)", 2024-09-05T17:32:57.595 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 8.7377414079999998, 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2227427259999999, 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 127565 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:57.596 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761933+0000", 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6700000000000002e-06 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.597 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761953+0000", 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0472999999999999e-05 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762007+0000", 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4135000000000003e-05 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762037+0000", 2024-09-05T17:32:57.598 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9992999999999999e-05 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762279+0000", 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024152900000000001 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762304+0000", 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4922999999999998e-05 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.599 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.767683+0000", 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053790729999999998 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.767696+0000", 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2914e-05 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.983967+0000", 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.216271307 2024-09-05T17:32:57.600 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.984288+0000", 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032119199999999998 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.984671+0000", 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038251700000000002 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:57.601 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:57.602 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:57.603 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:32:57.603 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:57.600+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:57.704 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:57.704+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:57.732 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:57.733 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:57.733 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:57.748 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:32:57.805 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:57.804+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:57.846 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:32:57.886 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:57.886 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:57.886 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:57.904 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:32:57.905 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:32:57.904+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:32:57.910 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:32:58.006 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:58.004+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:58.047 INFO:teuthology.orchestra.run.smithi110.stderr:no valid command found; 10 closest matches: 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:0 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:1 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:2 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:abort 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:assert 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:config diff 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:config diff get 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:config get 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:config help [] 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:config set ... 2024-09-05T17:32:58.048 INFO:teuthology.orchestra.run.smithi110.stderr:admin_socket: invalid command 2024-09-05T17:32:58.050 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-05T17:32:58.051 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-09-05T17:32:58.080 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.080 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240746686000001, 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.081 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.082 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:32:58.083 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.084 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240701227000002, 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.085 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.086 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:32:58.088 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240673039999997, 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:32:58.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:32:58.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240645428999997, 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:32:58.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:58.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:32:58.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.099 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240618713000003, 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.100 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.104 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240589802000002, 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:32:58.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:32:58.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240558571000001, 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.109 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:32:58.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.113 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240528548999997, 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:32:58.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.115 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:32:58.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.118 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240501653000003, 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:32:58.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240404912999999, 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.123 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:32:58.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:32:58.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240374308, 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:32:58.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240346979999998, 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:32:58.132 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:32:58.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.136 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240320093000001, 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.137 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.139 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:32:58.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:32:58.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.139 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:32:58.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.142 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.240292781999997, 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.144 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:32:58.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.239955598000002, 2024-09-05T17:32:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:32:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.148 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.149 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:32:58.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:32:58.152 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.238938519000001, 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.153 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.154 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.238829010000003, 2024-09-05T17:32:58.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:58.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:32:58.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:58.163 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.238762528999999, 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.164 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:32:58.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.238702742999997, 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:32:58.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:32:58.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.173 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:127565 3.10 3.bb351dd0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 10.189298487, 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.88126017199999995, 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:58.174 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 127565 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888785+0000", 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6360000000000001e-06 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888792+0000", 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9280000000000004e-06 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888808+0000", 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5889999999999999e-05 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888818+0000", 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0202e-05 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888877+0000", 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8641999999999999e-05 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888884+0000", 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2479999999999999e-06 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.770018+0000", 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.88113417199999999 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.770044+0000", 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5454000000000001e-05 2024-09-05T17:32:58.179 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.180 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.180 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.180 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:58.181 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:32:58.182 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:32:58.182+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:32:58.282 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:58.282+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:58.355 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:58.355 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:58.355 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:58.355 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:58.369 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:32:58.382 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:58.380+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:58.457 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:58.456+0000 7fe5e70197c0 -1 osd.5 103 log_to_monitors true 2024-09-05T17:32:58.483 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:32:58.482+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:32:58.541 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:58.541 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:58.541 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:58.541 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:58.541 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:58.556 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:32:58.584 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:58.580+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:58.685 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:58.684+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:58.726 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.478489491, 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:32:58.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.731 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 98.957546640999993, 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:32:58.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:32:58.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.753588741000002, 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.736 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:32:58.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.740 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.515593912, 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:32:58.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:32:58.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.745 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.502579372, 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:32:58.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.500315442000002, 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:32:58.750 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:32:58.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:32:58.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.498223667999994, 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:32:58.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 90.583435198000004, 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.759 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:32:58.761 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:32:58.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.763 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.191294209999995, 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:58.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.767 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 80.169656060999998, 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:32:58.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.772 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 75.593456180000004, 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.773 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:32:58.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.776 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.940458065000001, 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.777 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:32:58.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.781 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.939852217000002, 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.783 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:32:58.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:32:58.786 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.939286285999998, 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:32:58.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.938631344999997, 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.791 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:32:58.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:32:58.795 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.937930956000002, 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:32:58.799 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 61.936662339999998, 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:32:58.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:32:58.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:100058 3.18 e87/86 3:1ad21172:::rbd_data.1140b9781f.0000000000000010:head v 87'192, mlcod=0'0)", 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.787466483000003, 2024-09-05T17:32:58.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003565824, 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937337+0000", 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7899999999999997e-07 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938048+0000", 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00071111099999999995 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938066+0000", 2024-09-05T17:32:58.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7958e-05 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938078+0000", 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1592e-05 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938155+0000", 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7541999999999997e-05 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938186+0000", 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0756000000000002e-05 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940856+0000", 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026697460000000002 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940902+0000", 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.634e-05 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.808 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:117572 3.4 e110/24 3:2566fea6:::rbd_data.1140bb1b3dec.000000000000001f:head v 110'665, mlcod=108'663)", 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 27.701261439, 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049701290000000002, 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:58.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023543+0000", 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024795+0000", 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001251903 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024824+0000", 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9431999999999999e-05 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024837+0000", 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2381000000000001e-05 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024909+0000", 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2520000000000004e-05 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024933+0000", 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3357999999999999e-05 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028413+0000", 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034808370000000001 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028512+0000", 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8238000000000004e-05 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:127894 3.4 e130/24 3:2020dbca:::rbd_data.1140ab1a27a4.00000000000000e2:head v 130'693, mlcod=124'690)", 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 5.7492049810000001, 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037922519999999999, 2024-09-05T17:32:58.813 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:58.910 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975599+0000", 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2299999999999999e-07 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975608+0000", 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3170000000000008e-06 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:58.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975632+0000", 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3581999999999999e-05 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975645+0000", 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-05 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975799+0000", 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015321599999999999 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975860+0000", 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1791999999999994e-05 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.979300+0000", 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034398369999999998 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.979390+0000", 2024-09-05T17:32:58.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0044999999999996e-05 2024-09-05T17:32:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:58.915 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:58.915 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:58.916 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:32:58.908+0000 7fe5dadf4640 -1 osd.5 136 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T17:32:58.917 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:32:58.917 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:58.914+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:59.018 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:59.016+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:59.112 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:59.112 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:59.112 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:32:59.112 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:59.119 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:59.116+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:59.129 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:32:59.220 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:59.216+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:59.258 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:32:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:32:59.258 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:32:59.258 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:59.266 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:32:59.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:32:59.365 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:59.366+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:59.418 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:32:59.419 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:32:59.422 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:59.420+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:59.436 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:32:59.437 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:32:59.440 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:32:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:32:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:32:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:32:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:59.441 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 120.229707496, 2024-09-05T17:32:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:32:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.442 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:32:59.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.446 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 120.228618998, 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:59.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:32:59.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 120.218276784, 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:32:59.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:32:59.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:32:59.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:32:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.456 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 120.217671385, 2024-09-05T17:32:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:32:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:32:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:32:59.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:32:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:32:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:32:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:32:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:32:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:32:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:32:59.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:32:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:32:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:32:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:32:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:32:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 120.21661225699999, 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:32:59.465 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:32:59.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:32:59.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 120.21431088600001, 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.470 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:32:59.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:59.474 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 120.21321949599999, 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:59.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:32:59.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 120.21220173499999, 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.479 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:32:59.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.436348121000002, 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:32:59.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:32:59.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:32:59.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:32:59.490 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 42.843917150999999, 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.491 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:32:59.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:32:59.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:32:59.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:32:59.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:59.497 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.506665306999999, 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:59.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:32:59.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.504691096000002, 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.502 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:32:59.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:32:59.505 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.504661218000003, 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.507 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.510 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.511 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.501750878999999, 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.512 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:32:59.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.516 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.501410215999996, 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:32:59.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.521 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.499214744, 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:32:59.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:32:59.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.494526334, 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:32:59.526 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:32:59.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:32:59.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:32:59.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.491532524999997, 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.531 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.532 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:32:59.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:32:59.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.486596874, 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.536 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:32:59.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 39.483041473, 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:32:59.541 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:32:59.542 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:32:59.543 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:32:59.544 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:32:59.545 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:32:59.546 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:32:59.546 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:32:59.547 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:32:59.548 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:32:59.548 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:32:59.548 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:32:59.549 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:32:59.549 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:32:59.549 INFO:teuthology.orchestra.run.smithi050.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-09-05T17:32:59.549 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:32:59.550 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:32:59.550 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:32:59.550 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-05T17:32:59.551 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:32:59.551 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-05T17:32:59.551 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:32:59.544+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:32:59.648 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:32:59.645+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:32:59.683 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:59.683 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:59.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:32:59.749 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:59.749+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:59.820 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:59.820 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:59.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:32:59.850 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:32:59.849+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:32:59.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:32:59.951 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:32:59.948+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:32:59.965 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:32:59.965 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:32:59.979 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:33:00.065 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:00.064+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:00.157 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:00.149+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:00.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:33:00.254 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:00.252+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:00.319 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:00.319 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:00.335 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:33:00.381 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:00.380+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:00.455 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:00.453+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:00.506 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:00.506 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:00.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:33:00.569 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:00.568+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:00.649 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:00.649 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:00.657 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:00.653+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:00.666 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:33:00.757 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:00.753+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:00.831 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:00.832 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:00.847 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:33:00.873 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:33:00.893 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:00.892+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:00.958 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:00.957+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:01.017 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:01.017 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:01.036 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:33:01.085 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:01.085+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:01.160 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:01.157+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:01.174 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:01.174 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:01.189 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:33:01.277 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:01.277+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:01.362 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:01.360+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:01.362 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:01.362 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:01.377 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:33:01.463 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:01.460+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:01.551 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:01.551 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:01.552 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:33:01.567 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:33:01.567 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:01.565+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:01.664 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:01.660+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:01.704 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:01.704 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:01.721 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:01.721 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:01.730 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:01.730 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:01.730 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:01.730 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:01.738 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:01.738 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:01.745 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:33:01.756 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:01.756 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:01.765 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:01.765+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:01.777 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:01.777 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:01.862 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:01.863 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:01.863 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:01.866 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:01.864+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:01.881 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:33:01.973 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:01.973+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:02.017 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:02.017 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-05T17:33:02.057 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:02.057 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:02.068 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:02.065+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:02.084 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:02.084 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:02.086 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:02.086 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:02.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:02.087 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:02.087 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.087 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.087 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:33:02.087 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247882953000001, 2024-09-05T17:33:02.087 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:33:02.087 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.088 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.088 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.088 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.088 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:33:02.088 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.088 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.089 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:33:02.089 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.089 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.089 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.089 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.090 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:33:02.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:33:02.091 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.091 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.091 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.091 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:33:02.091 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:33:02.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.092 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:33:02.092 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:33:02.092 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.092 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.092 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.093 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247837493999995, 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.094 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.095 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:33:02.096 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.097 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:33:02.098 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247809306999997, 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.099 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:33:02.100 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.101 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:33:02.102 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.103 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247781696000004, 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:33:02.104 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.105 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:33:02.106 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.107 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.107 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:33:02.107 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:33:02.107 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.107 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:33:02.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:33:02.108 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.108 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.108 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.108 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:33:02.108 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:33:02.109 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247754979999996, 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.110 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:33:02.111 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.112 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:33:02.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:33:02.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.113 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.113 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:33:02.113 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:33:02.113 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.113 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.114 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247726068999995, 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.115 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.116 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:33:02.117 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:33:02.118 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.119 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247694838000001, 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.120 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.121 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.122 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.123 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.124 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247664815999997, 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.125 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.126 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.127 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:33:02.128 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247637920000003, 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:33:02.129 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.130 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.131 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.132 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:33:02.133 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247541179999999, 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.134 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:33:02.135 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.136 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.137 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:33:02.138 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247510575000007, 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.139 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:33:02.140 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.141 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.142 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.143 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247483247000005, 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.144 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.145 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.146 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:33:02.147 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.148 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.149 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:33:02.149 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247456360000001, 2024-09-05T17:33:02.149 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:33:02.149 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.149 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.149 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.149 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.149 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.150 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:33:02.151 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.152 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:33:02.153 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247429049000004, 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.154 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:33:02.155 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:33:02.156 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.157 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:33:02.158 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.247091865000002, 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.159 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.160 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:33:02.161 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.162 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.163 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.246074785999994, 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.164 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.165 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:33:02.166 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.167 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:33:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:33:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:33:02.168 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.169 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.245965276999996, 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.170 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:33:02.171 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:33:02.172 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:33:02.173 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.174 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.245898796000006, 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.175 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.176 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.177 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:33:02.178 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.179 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.245839009999997, 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:33:02.180 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:33:02.181 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.182 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.183 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.184 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:127565 3.10 3.bb351dd0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 14.196434754, 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.88126017199999995, 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:02.185 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 127565 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.186 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888785+0000", 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6360000000000001e-06 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888792+0000", 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9280000000000004e-06 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888808+0000", 2024-09-05T17:33:02.187 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5889999999999999e-05 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888818+0000", 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0202e-05 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888877+0000", 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8641999999999999e-05 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.188 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888884+0000", 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2479999999999999e-06 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.770018+0000", 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.88113417199999999 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.770044+0000", 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5454000000000001e-05 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.189 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.190 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.190 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:02.191 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:33:02.192 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:02.189+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:02.292 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:02.292+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:02.367 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:02.367 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:02.367 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:02.382 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:33:02.433 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:02.433+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:02.493 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:02.493+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:02.501 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:02.502 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:02.502 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:02.502 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:02.502 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:02.521 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:33:02.609 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:02.609+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:02.695 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:02.693+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:02.697 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:02.697 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:02.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.44926298199999, 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:33:02.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:33:02.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:33:02.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:33:02.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:33:02.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:33:02.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.702 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 102.928320132, 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.703 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:33:02.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 98.724362232000004, 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.708 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:33:02.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 98.486367403000003, 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:02.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:33:02.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:33:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:33:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:33:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:33:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:33:02.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:33:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:33:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:33:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.718 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:33:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 98.473352863000002, 2024-09-05T17:33:02.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:33:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:33:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:33:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:33:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:33:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:33:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:33:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:33:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:33:02.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:33:02.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 98.471088933000004, 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:02.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:33:02.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:33:02.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:02.731 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 98.468997158999997, 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:33:02.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:33:02.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.735 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 94.554208689000006, 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.736 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:33:02.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 84.162067700999998, 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:02.741 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:33:02.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:33:02.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:33:02.745 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 84.140429552000001, 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:33:02.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:33:02.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 79.564229671000007, 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:33:02.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.911231556000004, 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:02.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:33:02.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:33:02.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:33:02.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.760 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.910625707999998, 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.761 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.762 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.763 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.764 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.765 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.910059777000001, 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:02.766 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.767 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.768 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:33:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:33:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:33:02.769 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:33:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:33:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:33:02.770 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:33:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:33:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.771 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:33:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:33:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.772 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:33:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.909404835999993, 2024-09-05T17:33:02.773 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:33:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.774 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.775 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.776 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:33:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:33:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.777 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:33:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:33:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.778 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:33:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:33:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:33:02.779 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:33:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:33:02.780 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:33:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:33:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:33:02.781 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:33:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:33:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.782 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:33:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:33:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.783 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:33:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.908704447000005, 2024-09-05T17:33:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:33:02.784 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.785 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.786 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.787 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.788 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:33:02.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.907435831000001, 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:33:02.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.794 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:100058 3.18 e87/86 3:1ad21172:::rbd_data.1140b9781f.0000000000000010:head v 87'192, mlcod=0'0)", 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.758239973999999, 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003565824, 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937337+0000", 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7899999999999997e-07 2024-09-05T17:33:02.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938048+0000", 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00071111099999999995 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938066+0000", 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7958e-05 2024-09-05T17:33:02.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938078+0000", 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1592e-05 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938155+0000", 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7541999999999997e-05 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938186+0000", 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0756000000000002e-05 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940856+0000", 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026697460000000002 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940902+0000", 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.634e-05 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.799 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:117572 3.4 e110/24 3:2566fea6:::rbd_data.1140bb1b3dec.000000000000001f:head v 110'665, mlcod=108'663)", 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 31.672034929999999, 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049701290000000002, 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.801 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023543+0000", 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024795+0000", 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001251903 2024-09-05T17:33:02.802 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024824+0000", 2024-09-05T17:33:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9431999999999999e-05 2024-09-05T17:33:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024837+0000", 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2381000000000001e-05 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024909+0000", 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2520000000000004e-05 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024933+0000", 2024-09-05T17:33:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3357999999999999e-05 2024-09-05T17:33:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028413+0000", 2024-09-05T17:33:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034808370000000001 2024-09-05T17:33:02.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028512+0000", 2024-09-05T17:33:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8238000000000004e-05 2024-09-05T17:33:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:127894 3.4 e130/24 3:2020dbca:::rbd_data.1140ab1a27a4.00000000000000e2:head v 130'693, mlcod=124'690)", 2024-09-05T17:33:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 9.7199784719999993, 2024-09-05T17:33:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037922519999999999, 2024-09-05T17:33:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:02.807 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975599+0000", 2024-09-05T17:33:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2299999999999999e-07 2024-09-05T17:33:02.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975608+0000", 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3170000000000008e-06 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975632+0000", 2024-09-05T17:33:02.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3581999999999999e-05 2024-09-05T17:33:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975645+0000", 2024-09-05T17:33:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-05 2024-09-05T17:33:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.811 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975799+0000", 2024-09-05T17:33:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015321599999999999 2024-09-05T17:33:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975860+0000", 2024-09-05T17:33:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1791999999999994e-05 2024-09-05T17:33:02.812 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.979300+0000", 2024-09-05T17:33:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034398369999999998 2024-09-05T17:33:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:02.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.979390+0000", 2024-09-05T17:33:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0044999999999996e-05 2024-09-05T17:33:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.814 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:02.816 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:02.816 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:02.818 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:33:02.819 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:02.817+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:02.906 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:33:02.919 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:02.916+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:02.994 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:02.994 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:02.994 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:02.994 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:03.010 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:33:03.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:33:03.057 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:03.057+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:03.122 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:03.121+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:03.131 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:03.131 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:03.131 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:03.131 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:03.131 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:03.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:33:03.184 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:03.184 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:03.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.185 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:129438 3.1c 3.30a98c1c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e140)", 2024-09-05T17:33:03.185 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:03.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.64643117000000005, 2024-09-05T17:33:03.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.64647602999999998, 2024-09-05T17:33:03.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129438 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539389+0000", 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0429999999999999e-06 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539399+0000", 2024-09-05T17:33:03.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0547000000000001e-05 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539421+0000", 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1710000000000001e-05 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539435+0000", 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4303e-05 2024-09-05T17:33:03.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539565+0000", 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012969500000000001 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539581+0000", 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6347000000000001e-05 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.189 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-05T17:33:03.190 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-05T17:33:03.190 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:03.237 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:03.237+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:03.323 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:03.321+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:03.324 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:03.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.111906909, 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:33:03.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:33:03.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:03.329 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.110818411, 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:33:03.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.10047619700001, 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:33:03.334 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:33:03.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.099870798, 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.339 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.342 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:33:03.343 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.09881167, 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.344 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:03.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.348 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.096510299, 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.349 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:33:03.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:33:03.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.095418909, 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:33:03.353 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:33:03.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.094401148, 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.358 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:33:03.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.318547533999997, 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:33:03.363 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:33:03.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:33:03.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:33:03.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 46.726116564000002, 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.370 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:33:03.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.388864720000001, 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.377 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:33:03.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.381 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.386890508999997, 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.382 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:33:03.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.386860630999998, 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.387 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:33:03.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:33:03.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:03.392 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.383950292000002, 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:03.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:33:03.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:03.397 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.383609628999999, 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:03.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:33:03.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:33:03.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.381414157000002, 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.405 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:33:03.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.376725747000002, 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:33:03.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:33:03.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.373731937999999, 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:03.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.419 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.368796287000002, 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:33:03.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.424 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 43.365240886000002, 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:03.425 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:33:03.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.429 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.430 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:03.430 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:03.430 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:03.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:33:03.432 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:03.428+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:03.511 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:33:03.531 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:03.528+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:03.579 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:03.579 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:03.579 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:03.579 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:03.595 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:33:03.633 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:03.633+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:03.734 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:03.733+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:03.759 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:03.759 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:03.759 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:03.759 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:03.759 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:03.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:33:03.835 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:03.832+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:03.893 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.18981682, 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:33:03.894 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:33:03.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.18976943600001, 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:33:03.899 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:33:03.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:33:03.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.904 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.189724764, 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:33:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:33:03.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:33:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:33:03.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:33:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:33:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:33:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:33:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:33:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:33:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.911 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.189679422, 2024-09-05T17:33:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:33:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:33:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:33:03.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:33:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:33:03.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:33:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:33:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:33:03.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:33:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:33:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:33:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:33:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:33:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:33:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:33:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:33:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.18961041199999, 2024-09-05T17:33:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:33:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:33:03.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:03.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:03.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:33:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:33:03.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:33:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:33:03.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:33:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:33:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:33:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:33:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:33:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:33:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:33:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:33:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:33:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:33:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.189561975, 2024-09-05T17:33:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:33:03.933 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.934 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.934 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.935 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:33:03.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.935 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:03.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:03.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:33:03.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:33:03.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:33:03.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.189515617, 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:33:03.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.945 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.18885302699999, 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.946 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.950 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.188761681, 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:33:03.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:33:03.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.188700201, 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:33:03.955 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:33:03.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:33:03.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.188643301, 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:33:03.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.18855006, 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.965 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:33:03.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.188490532, 2024-09-05T17:33:03.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:33:03.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.18133457, 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.974 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:33:03.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.978 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.181273103, 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.979 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:33:03.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:33:03.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.17940513400001, 2024-09-05T17:33:03.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:33:03.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.179364624, 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:33:03.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:03.992 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.17932615799999, 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:33:03.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.17926805099999, 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:03.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:03.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:03.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 118.17921075, 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:33:04.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:33:04.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:04.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:04.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:33:04.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:33:04.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:04.006 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:04.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:04.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:04.006 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:04.006 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:04.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:33:04.008 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:04.004+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:04.109 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:04.105+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:04.176 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:04.177 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:04.177 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:04.190 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:33:04.193 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:33:04.242 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:04.241+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:04.311 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:04.308+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:04.315 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:04.315 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:04.315 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:04.315 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:04.315 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:04.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:33:04.354 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:04.354 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:04.371 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:04.371 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:04.388 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:04.389 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:04.405 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:04.406 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:04.412 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:04.409+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:04.424 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:04.424 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:04.443 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:04.443 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:04.464 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:04.464 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:04.487 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:04.487 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:04.499 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:04.514 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:33:04.549 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:04.549+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:04.614 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:04.612+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:04.640 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:04.640 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:04.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:33:04.741 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:04.740+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:04.816 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:04.813+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:04.817 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:04.817 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:04.831 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:33:04.925 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:04.924+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:05.001 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:05.001 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:05.014 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:33:05.057 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:05.056+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:05.119 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:05.117+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:05.174 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:05.174 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:05.188 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:33:05.220 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:05.217+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:05.307 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:05.307 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:05.321 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:33:05.322 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:05.320+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:05.422 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:05.420+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:05.488 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:05.488 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:05.502 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:33:05.537 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:33:05.545 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:05.545+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:05.624 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:05.620+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:05.651 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:05.651 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:05.670 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:33:05.725 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:05.724+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:05.796 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:05.796 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:05.810 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:33:05.857 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:05.857+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:05.927 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:05.924+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:05.928 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:05.928 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:05.942 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:33:06.028 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:06.024+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:06.115 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:06.115 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:06.128 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:06.124+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:06.130 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:33:06.230 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:06.228+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:06.257 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:06.257 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:06.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:33:06.331 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:06.328+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:06.400 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:06.400 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:06.413 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:33:06.457 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:06.457+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:06.506 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:33:06.538 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:33:06.538 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:06.537+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:06.549 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:06.549 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:06.568 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:33:06.661 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:06.661+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:06.668 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:06.668 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:06.685 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:06.686 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:06.702 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:06.702 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:06.720 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:06.720 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:06.735 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:06.733+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:06.740 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:06.740 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:06.740 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:06.740 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:06.740 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:06.741 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:06.741 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:06.756 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:33:06.762 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:06.762 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:06.784 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:06.784 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:06.807 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:06.808 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:06.836 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:06.836+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:06.884 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:06.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 136.637375816, 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:06.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:33:06.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 107.116432966, 2024-09-05T17:33:06.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:33:06.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 102.912475066, 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:33:06.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:33:06.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 102.674480237, 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:33:06.898 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:33:06.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 102.661465697, 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:06.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:33:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:33:06.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:33:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:33:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:06.908 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 102.659201767, 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.913 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:33:06.914 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 102.65710999300001, 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:33:06.915 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.916 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:33:06.917 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.918 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.919 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 98.742321523000001, 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:06.920 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.921 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.922 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.923 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 88.350180535000007, 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:33:06.924 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.925 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:33:06.926 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:33:06.927 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:54997 3.0 e62/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 62'378, mlcod=60'373)", 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 88.328542385999995, 2024-09-05T17:33:06.928 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032746709999999998, 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555147+0000", 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.929 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555149+0000", 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555161+0000", 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2152e-05 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.930 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555186+0000", 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5663000000000001e-05 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555202+0000", 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5336999999999999e-05 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555507+0000", 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030497800000000002 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.931 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.555548+0000", 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1415000000000002e-05 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558331+0000", 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002782545 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.558422+0000", 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0821000000000003e-05 2024-09-05T17:33:06.932 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 83.752342505000001, 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.933 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.934 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:33:06.935 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:33:06.936 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 70.099344389999999, 2024-09-05T17:33:06.937 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.938 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:33:06.939 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.940 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.941 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 70.098738542000007, 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.942 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.943 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:33:06.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 70.098172610999995, 2024-09-05T17:33:06.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:33:06.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.950 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 70.097517670000002, 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:33:06.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:33:06.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 70.096817281, 2024-09-05T17:33:06.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:33:06.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.959 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 70.095548664999995, 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:33:06.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:33:06.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:33:06.964 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.964 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:100058 3.18 e87/86 3:1ad21172:::rbd_data.1140b9781f.0000000000000010:head v 87'192, mlcod=0'0)", 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.946352808, 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003565824, 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937337+0000", 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7899999999999997e-07 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938048+0000", 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00071111099999999995 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938066+0000", 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7958e-05 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938078+0000", 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1592e-05 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938155+0000", 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7541999999999997e-05 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938186+0000", 2024-09-05T17:33:06.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0756000000000002e-05 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940856+0000", 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026697460000000002 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940902+0000", 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.634e-05 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:117572 3.4 e110/24 3:2566fea6:::rbd_data.1140bb1b3dec.000000000000001f:head v 110'665, mlcod=108'663)", 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 35.860147763999997, 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049701290000000002, 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023543+0000", 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024795+0000", 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001251903 2024-09-05T17:33:06.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024824+0000", 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9431999999999999e-05 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024837+0000", 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2381000000000001e-05 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.972 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024909+0000", 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2520000000000004e-05 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024933+0000", 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3357999999999999e-05 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028413+0000", 2024-09-05T17:33:06.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034808370000000001 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028512+0000", 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8238000000000004e-05 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:127894 3.4 e130/24 3:2020dbca:::rbd_data.1140ab1a27a4.00000000000000e2:head v 130'693, mlcod=124'690)", 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 13.908091305999999, 2024-09-05T17:33:06.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037922519999999999, 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:06.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975599+0000", 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2299999999999999e-07 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975608+0000", 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3170000000000008e-06 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:06.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975632+0000", 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3581999999999999e-05 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975645+0000", 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-05 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975799+0000", 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015321599999999999 2024-09-05T17:33:06.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:06.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975860+0000", 2024-09-05T17:33:06.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1791999999999994e-05 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.979300+0000", 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034398369999999998 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:06.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.979390+0000", 2024-09-05T17:33:06.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0044999999999996e-05 2024-09-05T17:33:06.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.980 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:06.980 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:06.980 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:06.982 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:33:06.982 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:06.981+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:07.083 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:07.084+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:07.159 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:07.159 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:07.159 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:07.159 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:07.173 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:33:07.184 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:07.180+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:07.285 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:07.284+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:07.292 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:07.292 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:07.293 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:07.293 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:07.293 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:07.307 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:33:07.385 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:07.385+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:07.429 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:07.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.217170474, 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:07.430 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:33:07.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:33:07.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.216081976, 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.436 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.20573976200001, 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.441 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:33:07.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.20513436300001, 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:33:07.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:33:07.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.204075235, 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:33:07.450 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.454 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.20177386399999, 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.455 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:33:07.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:33:07.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.20068247399999, 2024-09-05T17:33:07.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:33:07.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:33:07.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.463 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 128.199664713, 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.464 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:33:07.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:33:07.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 60.423811098999998, 2024-09-05T17:33:07.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:33:07.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:33:07.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 50.831380129000003, 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:33:07.475 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.476 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:33:07.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:33:07.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:33:07.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:07.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:33:07.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:33:07.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.481 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:07.481 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:33:07.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:33:07.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:33:07.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:07.483 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.494128285000002, 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:33:07.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.492154073999998, 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.489 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:33:07.493 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.492124195999999, 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.494 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.496 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:33:07.497 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.498 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.489213857000003, 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.499 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.500 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:33:07.501 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:33:07.502 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.503 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.488873194, 2024-09-05T17:33:07.504 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.505 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:07.506 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.507 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.508 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.509 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.510 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.510 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:07.510 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.486677722000003, 2024-09-05T17:33:07.510 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:33:07.510 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.510 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.510 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:07.511 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.512 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.513 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:33:07.514 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.515 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:07.516 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.481989312000003, 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.517 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.518 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:33:07.519 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:33:07.520 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:33:07.521 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.478995503, 2024-09-05T17:33:07.522 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:07.523 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.524 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.525 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:33:07.526 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.527 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.474059852000003, 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.528 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.529 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.530 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:33:07.531 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.532 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:33:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:33:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:33:07.533 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:07.534 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 47.470504450999996, 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:07.535 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.536 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.537 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.538 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:33:07.539 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.540 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.540 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:07.540 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:07.540 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:07.542 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:33:07.543 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:07.540+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:07.642 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:07.640+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:07.682 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:07.682 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:07.682 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:07.698 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:33:07.744 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:07.741+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:07.845 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:07.844+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:07.868 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:07.868 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:07.869 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:07.869 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:07.869 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:07.882 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:33:07.946 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:07.945+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:08.047 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:08.045+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:08.049 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:08.049 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:08.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:08.049 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:08.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.049 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.344915216, 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:33:08.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:33:08.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.34486783200001, 2024-09-05T17:33:08.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:33:08.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:33:08.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:33:08.060 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.34482316, 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.061 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.344777818, 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:33:08.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:33:08.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:33:08.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:33:08.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:33:08.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:33:08.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.072 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.34470880799999, 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:08.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.344660371, 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.078 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:08.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:33:08.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:33:08.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:33:08.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:33:08.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:33:08.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:33:08.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:33:08.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.084 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.344614013, 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:33:08.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.34395142299999, 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:33:08.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:33:08.095 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.343860077, 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.096 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:33:08.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.343798597, 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.102 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:33:08.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.343741697, 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.107 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:33:08.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.112 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.343648456, 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:33:08.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:33:08.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:33:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:33:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:33:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.343588928, 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:33:08.118 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:08.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:33:08.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.336432966, 2024-09-05T17:33:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:33:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:33:08.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:33:08.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.33637149899999, 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:33:08.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.135 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.33450353000001, 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:33:08.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:33:08.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:33:08.140 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.141 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.141 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.141 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.141 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:08.141 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.33446302, 2024-09-05T17:33:08.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:33:08.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:33:08.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.33442455399999, 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.149 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.33436644699999, 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:33:08.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.334309146, 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:33:08.158 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:33:08.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:33:08.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.163 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:08.165 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:33:08.165 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:08.164+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:08.199 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-09-05T17:33:08.199 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:33:08.199 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-05T17:33:08.199 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-05T17:33:08.199 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-05T17:33:08.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-05T17:33:08.265 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:08.265+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:08.331 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:08.332 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:08.332 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:08.332 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:08.336 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:08.336 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-05T17:33:08.336 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:08.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:33:08.366 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:08.365+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:08.467 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:08.464+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:08.472 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:08.472 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:08.472 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:08.472 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:08.472 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:08.487 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:33:08.562 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:33:08.573 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:08.572+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:08.665 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:08.665 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:08.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:08.665 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:08.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.665 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.665 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207879485000007, 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:33:08.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:08.670 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207831202999998, 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:33:08.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:08.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:33:08.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207784842999999, 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:33:08.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:33:08.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:33:08.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207736241999996, 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:33:08.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.684 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207680643000003, 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:33:08.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207635398999997, 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.2075909, 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.693 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:33:08.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:08.697 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207546942999997, 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:33:08.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.701 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207501605999994, 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:33:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207455156999998, 2024-09-05T17:33:08.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:33:08.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.711 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:08.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207411594999996, 2024-09-05T17:33:08.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:33:08.712 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.712 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:33:08.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:33:08.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:33:08.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207366219999997, 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:33:08.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207317109000002, 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.722 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:33:08.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207278174999999, 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.726 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:33:08.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.730 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207208512999998, 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:33:08.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207155962000002, 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.207010405999995, 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.743 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.206958825000001, 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.974936454000002, 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:33:08.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:116533 3.7 3:e6924f8b:::rbd_data.11402f0626d4.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.392682753999999, 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.069225986000000003, 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:08.754 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:08.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:08.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:08.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:08.755 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116533 2024-09-05T17:33:08.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.755 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:08.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:08.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:08.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272329+0000", 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:08.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272340+0000", 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.172e-05 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272372+0000", 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1192000000000002e-05 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272387+0000", 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5339999999999999e-05 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272494+0000", 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650300000000001 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272629+0000", 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135845 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.286878+0000", 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014248241 2024-09-05T17:33:08.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341353+0000", 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054475896000000003 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341387+0000", 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3043000000000002e-05 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:08.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341475+0000", 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8103000000000007e-05 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341552+0000", 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7539000000000004e-05 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:08.762 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:08.764 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:33:08.764 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:08.761+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:08.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:33:08.864 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:08.864+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:08.938 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:08.938 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:08.938 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:08.938 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:08.952 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:33:08.977 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:08.977 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:08.994 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:08.994 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:08.997 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:08.996+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:09.011 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:09.011 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:09.028 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:09.028 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:09.046 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:09.047 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:09.064 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:09.065 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:09.066 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:09.064+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:09.083 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:09.083 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:09.102 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:09.102 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:09.116 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:09.117 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:09.131 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:33:09.173 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:09.172+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:09.270 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:09.268+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:09.297 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:09.298 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:09.311 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:33:09.371 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:09.369+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:09.472 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:09.469+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:09.478 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:09.479 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:09.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:33:09.549 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:33:09.576 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:09.572+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:09.625 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:09.625 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:09.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:33:09.685 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:09.684+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:09.775 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:09.773+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:09.814 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:09.814 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:09.828 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:33:09.875 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:09.873+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:09.965 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:09.965 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:09.975 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:09.972+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:09.979 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:33:10.077 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:10.076+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:10.139 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:10.139 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:10.154 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:33:10.197 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:10.197+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:10.278 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:10.276+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:10.280 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:10.280 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:10.296 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:33:10.379 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:10.376+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:10.468 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:10.468 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:10.480 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:10.477+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:10.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:33:10.581 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:10.581+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:10.666 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:10.666 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:10.683 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:33:10.684 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:10.680+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:10.783 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:10.780+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:10.860 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:10.861 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:10.876 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:33:10.926 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:10.925+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:10.985 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:10.984+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:11.002 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:11.002 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:11.017 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:33:11.087 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:11.084+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:11.120 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:33:11.187 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:11.185+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:11.191 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:11.191 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:11.206 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:33:11.266 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:11.266 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:11.283 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:11.284 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:11.288 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:11.285+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:11.302 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:11.302 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:11.319 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:11.319 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:11.340 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:11.340 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:11.360 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:11.361 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:3448 3.9 e28/24 3:914c0a22:::rbd_data.114070605229.00000000000000ad:head v 28'6, mlcod=28'4)", 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 141.12126795099999, 2024-09-05T17:33:11.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036647530000000002, 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246313+0000", 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246315+0000", 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6589999999999999e-06 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246354+0000", 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8563999999999999e-05 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246373+0000", 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8989999999999999e-05 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246382+0000", 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8120000000000002e-06 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246474+0000", 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1902000000000002e-05 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.246509+0000", 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4520000000000002e-05 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249910+0000", 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034011499999999999 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:50.249978+0000", 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8156000000000003e-05 2024-09-05T17:33:11.372 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:47310 3.4 e49/24 3:219f5231:::rbd_data.1140bd729420.0000000000000007:head v 49'130, mlcod=46'127)", 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 111.600325101, 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003777622, 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767256+0000", 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767257+0000", 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.147e-06 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767269+0000", 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1719000000000001e-05 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767324+0000", 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5056000000000003e-05 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767348+0000", 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3657999999999999e-05 2024-09-05T17:33:11.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767557+0000", 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020871400000000001 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.767613+0000", 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5912000000000003e-05 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.770925+0000", 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033121209999999999 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:19.771034+0000", 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000109295 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.377 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50306 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'167, mlcod=52'165)", 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 107.396367201, 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033440399999999999, 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.378 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971214+0000", 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971216+0000", 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7409999999999999e-06 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971226+0000", 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0210000000000001e-05 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971249+0000", 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2940999999999999e-05 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971260+0000", 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0609e-05 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971398+0000", 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013852299999999999 2024-09-05T17:33:11.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.971464+0000", 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5871999999999995e-05 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974431+0000", 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002966846 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:23.974558+0000", 2024-09-05T17:33:11.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000127298 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50528 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'194, mlcod=52'192)", 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 107.158372372, 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033268630000000002, 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.382 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209209+0000", 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209211+0000", 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.356e-06 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209232+0000", 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0959e-05 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209286+0000", 2024-09-05T17:33:11.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3199999999999999e-05 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209309+0000", 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3057999999999998e-05 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209447+0000", 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013839899999999999 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.209498+0000", 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1360000000000003e-05 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212404+0000", 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029058930000000001 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.212536+0000", 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000131638 2024-09-05T17:33:11.386 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 107.145357832, 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.388 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:33:11.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 107.143093902, 2024-09-05T17:33:11.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.393 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:33:11.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50565 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'200, mlcod=52'196)", 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 107.141002128, 2024-09-05T17:33:11.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0036033100000000002, 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226579+0000", 2024-09-05T17:33:11.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226582+0000", 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.357e-06 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226597+0000", 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4959e-05 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226632+0000", 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5564e-05 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226652+0000", 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9395e-05 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226794+0000", 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000141965 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.226844+0000", 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0556999999999997e-05 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230071+0000", 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0032268029999999999 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.230183+0000", 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011171 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.400 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:51737 3.0 e54/24 3:02056168:::rbd_object_map.11402b8b869e:head v 54'204, mlcod=54'200)", 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 103.22621365800001, 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033270800000000001, 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141368+0000", 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141369+0000", 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.497e-06 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141382+0000", 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3049e-05 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141418+0000", 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5984e-05 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141437+0000", 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8295999999999999e-05 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141594+0000", 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015740400000000001 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.141650+0000", 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5899999999999997e-05 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144553+0000", 2024-09-05T17:33:11.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029032390000000002 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:28.144695+0000", 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014171100000000001 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 92.834072669999998, 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:33:11.405 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:33:11.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:56657 3.0 e66/24 3:012b337d:::rbd_data.11401726a543.000000000000000c:head v 66'467, mlcod=66'465)", 2024-09-05T17:33:11.409 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 88.236234640000006, 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003420153, 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131347+0000", 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131350+0000", 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1530000000000001e-06 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131492+0000", 2024-09-05T17:33:11.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014196799999999999 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131532+0000", 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0105000000000003e-05 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131551+0000", 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8848999999999999e-05 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131714+0000", 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016327400000000001 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.131767+0000", 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3275000000000001e-05 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134680+0000", 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0029121559999999999 2024-09-05T17:33:11.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:43.134767+0000", 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7373000000000005e-05 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 74.583236525000004, 2024-09-05T17:33:11.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:33:11.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 74.582630676999997, 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:11.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:33:11.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 74.582064746, 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.423 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:33:11.427 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 74.581409805000007, 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:11.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:33:11.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77671 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'755, mlcod=77'749)", 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 74.580709416000005, 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037066439999999998, 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786872+0000", 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786873+0000", 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9599999999999998e-07 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786880+0000", 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.4569999999999999e-06 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786896+0000", 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5252999999999999e-05 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786905+0000", 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7219999999999994e-06 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789349+0000", 2024-09-05T17:33:11.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024434119999999998 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789361+0000", 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2247e-05 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790546+0000", 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0011847730000000001 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790579+0000", 2024-09-05T17:33:11.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2984000000000001e-05 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77673 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'757, mlcod=77'749)", 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 74.5794408, 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034621510000000001, 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788141+0000", 2024-09-05T17:33:11.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.16e-07 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788147+0000", 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5099999999999998e-06 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788158+0000", 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1551e-05 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788165+0000", 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4400000000000002e-06 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790193+0000", 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020278000000000002 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790203+0000", 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0161e-05 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791580+0000", 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001376805 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.791603+0000", 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3068e-05 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:100058 3.18 e87/86 3:1ad21172:::rbd_data.1140b9781f.0000000000000010:head v 87'192, mlcod=0'0)", 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 65.430244943000005, 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003565824, 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937336+0000", 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.937337+0000", 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7899999999999997e-07 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938048+0000", 2024-09-05T17:33:11.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00071111099999999995 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938066+0000", 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7958e-05 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938078+0000", 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1592e-05 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938155+0000", 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7541999999999997e-05 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.938186+0000", 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0756000000000002e-05 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940856+0000", 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0026697460000000002 2024-09-05T17:33:11.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:05.940902+0000", 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.634e-05 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:117572 3.4 e110/24 3:2566fea6:::rbd_data.1140bb1b3dec.000000000000001f:head v 110'665, mlcod=108'663)", 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 40.344039899000002, 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049701290000000002, 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.445 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023543+0000", 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024795+0000", 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001251903 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024824+0000", 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9431999999999999e-05 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.447 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024837+0000", 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2381000000000001e-05 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024909+0000", 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2520000000000004e-05 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024933+0000", 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3357999999999999e-05 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028413+0000", 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034808370000000001 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028512+0000", 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8238000000000004e-05 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.449 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:127894 3.4 e130/24 3:2020dbca:::rbd_data.1140ab1a27a4.00000000000000e2:head v 130'693, mlcod=124'690)", 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 18.391983441000001, 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0037922519999999999, 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975598+0000", 2024-09-05T17:33:11.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975599+0000", 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2299999999999999e-07 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975608+0000", 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3170000000000008e-06 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975632+0000", 2024-09-05T17:33:11.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3581999999999999e-05 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975645+0000", 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3540000000000001e-05 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975799+0000", 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015321599999999999 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.975860+0000", 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1791999999999994e-05 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.979300+0000", 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034398369999999998 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:52.979390+0000", 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0044999999999996e-05 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.453 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:130220 3.0 e145/24 3:0415e6a1:::rbd_object_map.1140fc6eb649:head v 145'1333, mlcod=144'1331)", 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:07.541997+0000", 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 3.825584659, 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0038406920000000002, 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.541997+0000", 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.541997+0000", 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.541997+0000", 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9400000000000005e-07 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.542006+0000", 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.6629999999999999e-06 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.542026+0000", 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9530000000000001e-05 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.542042+0000", 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6498999999999999e-05 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.542169+0000", 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012637299999999999 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.542222+0000", 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3409000000000003e-05 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.545769+0000", 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003547152 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:07.545837+0000", 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8372000000000002e-05 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.458 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:11.459 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:33:11.460 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:11.460 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:11.460 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:11.461 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:11.461 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:11.457+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:11.561 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:11.560+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:11.581 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:33:11.648 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:11.648 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:11.649 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:11.649 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:11.661 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:11.660+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:11.666 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:33:11.762 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:11.760+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:11.805 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:11.806 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:11.806 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:11.806 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:11.806 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:11.821 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:33:11.863 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:11.860+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:11.943 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:11.943 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:11.943 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:11.943 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:11.943 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.943 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:11.943 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.731983052, 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.944 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:33:11.945 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.946 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.947 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.730894554, 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:33:11.948 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.949 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:33:11.950 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.951 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.952 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.72055234000001, 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.953 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.954 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:33:11.955 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:33:11.956 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:11.957 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.71994694099999, 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:11.958 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.959 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:33:11.960 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.961 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.71888781300001, 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.962 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:11.963 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.964 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:33:11.965 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.966 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.71658644199999, 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:33:11.967 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.968 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:33:11.969 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.970 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.71549505199999, 2024-09-05T17:33:11.971 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:33:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:33:11.972 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.973 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:33:11.974 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:33:11.975 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:11.976 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 132.71447729100001, 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:11.977 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.978 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.979 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:33:11.980 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 64.938623676999995, 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.981 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:11.982 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.983 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.984 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:33:11.985 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:33:11.986 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.987 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 55.346192707, 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.988 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.989 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:33:11.990 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:33:11.991 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.992 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:33:11.993 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:11.994 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.008940862999999, 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:33:11.995 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.996 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:33:11.997 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:33:11.998 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:11.999 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.006966652000003, 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:33:12.000 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.001 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:33:12.002 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.003 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:33:12.004 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:12.005 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.006936774000003, 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.006 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.007 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:33:12.008 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.009 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.010 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.004026435, 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.011 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.012 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:33:12.013 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.014 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.015 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.003685771999997, 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.016 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.017 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.018 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.019 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.020 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 52.0014903, 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.021 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:33:12.022 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.023 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:33:12.024 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.025 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.028 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.029 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 51.99680189, 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.030 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.031 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:33:12.032 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.033 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.034 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 51.993808080999997, 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.035 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:33:12.036 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:33:12.037 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.038 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.039 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 51.988872430000001, 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.040 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:33:12.041 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.042 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.043 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.044 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 51.985317029000001, 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.045 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.046 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:33:12.047 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:12.048 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:12.049 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:12.051 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:33:12.051 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:12.049+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:12.152 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:12.149+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:12.182 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:12.182 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:12.183 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:12.183 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:12.197 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:33:12.253 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:12.249+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:12.317 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:12.317 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:12.317 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:12.317 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:12.317 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:12.331 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:33:12.377 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:12.376+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:12.455 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:12.453+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:12.455 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:12.455 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.750437459, 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.456 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:12.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.750390075, 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.461 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:12.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.750345403, 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:33:12.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:12.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:33:12.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.750300061, 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.471 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:33:12.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.750231051, 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.475 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:33:12.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.750182614, 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:33:12.480 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.750136256, 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:33:12.485 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:33:12.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.749473666, 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.490 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:33:12.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.74938232, 2024-09-05T17:33:12.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:33:12.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:33:12.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.498 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.74932084, 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.499 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:33:12.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.503 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.74926394000001, 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:33:12.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:33:12.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:12.508 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.749170699, 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:33:12.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:33:12.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.749111171, 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.513 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:12.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:33:12.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.741955209, 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:12.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:33:12.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.741893742, 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:33:12.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.740025773, 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:12.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.73998526299999, 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.739946797, 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.537 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.73988869, 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:33:12.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:33:12.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.739831389, 2024-09-05T17:33:12.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:12.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.550 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:12.551 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:12.551 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:12.552 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:33:12.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:33:12.594 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:12.593+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:12.657 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:12.656+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:12.728 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:12.728 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:12.728 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:12.728 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:12.743 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:33:12.758 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:12.757+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:12.858 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:12.856+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:12.914 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:12.914 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:12.914 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:12.914 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:12.914 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:12.928 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:33:12.973 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:12.972+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:13.061 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:13.060+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:13.096 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637628473000007, 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:33:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:33:13.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:33:13.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:33:13.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.102 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637580190999998, 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:33:13.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:33:13.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:13.107 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637533830999999, 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:33:13.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:33:13.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637485229999996, 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:33:13.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637429631000003, 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:33:13.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637384386999997, 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.121 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:13.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:33:13.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637339888, 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:33:13.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637295930999997, 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:33:13.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637250593999994, 2024-09-05T17:33:13.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:33:13.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:33:13.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:33:13.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637204144999998, 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:33:13.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:33:13.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637160582999996, 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.149 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637115207999997, 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:33:13.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:33:13.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637066097000002, 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:33:13.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.637027162999999, 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.159 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:33:13.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.636957500999998, 2024-09-05T17:33:13.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:13.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:33:13.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.636904950000002, 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.168 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.171 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.636759393999995, 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:33:13.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.176 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.636707813000001, 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:33:13.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:33:13.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.404685442000002, 2024-09-05T17:33:13.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:33:13.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:33:13.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:33:13.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:33:13.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:116533 3.7 3:e6924f8b:::rbd_data.11402f0626d4.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.822431741999999, 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.069225986000000003, 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116533 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:13.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272329+0000", 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272340+0000", 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.172e-05 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272372+0000", 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1192000000000002e-05 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272387+0000", 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5339999999999999e-05 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272494+0000", 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650300000000001 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272629+0000", 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135845 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.286878+0000", 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014248241 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341353+0000", 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054475896000000003 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341387+0000", 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3043000000000002e-05 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341475+0000", 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8103000000000007e-05 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341552+0000", 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7539000000000004e-05 2024-09-05T17:33:13.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.193 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:13.194 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:33:13.195 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:13.192+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:13.295 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:13.292+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:13.353 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-09-05T17:33:13.353 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:33:13.353 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-05T17:33:13.353 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-05T17:33:13.353 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-05T17:33:13.354 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-05T17:33:13.366 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:13.366 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:13.366 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:13.366 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:13.381 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:33:13.425 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:13.424+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:13.462 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:33:13.491 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:13.491 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-05T17:33:13.491 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:13.497 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:13.496+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:13.550 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:13.550 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:13.550 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:13.551 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:13.551 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:13.565 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:33:13.598 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:13.597+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:13.633 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:13.633 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:13.653 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:13.653 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:13.671 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:13.671 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:13.691 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:13.691 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:13.699 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:13.696+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:13.714 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:13.715 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:13.736 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:13.736 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:13.740 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:13.740 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:13.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:13.741 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:13.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.741 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:33:13.741 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:13.741 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 166.72311996900001, 2024-09-05T17:33:13.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:33:13.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:13.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:33:13.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:33:13.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:33:13.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:13.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:13.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:33:13.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:33:13.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:33:13.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:33:13.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:33:13.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:33:13.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:33:13.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:33:13.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:33:13.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:33:13.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:13.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:33:13.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:33:13.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:33:13.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:33:13.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:33:13.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:33:13.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:13.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:33:13.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:33:13.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:13.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:33:13.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:33:13.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:33:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:33:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:33:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:33:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:33:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:33:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.756 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.756 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:13.756 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.356128605999999, 2024-09-05T17:33:13.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:33:13.756 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.757 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.757 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:33:13.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.758 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:13.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:13.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:33:13.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:33:13.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:33:13.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:33:13.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:33:13.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:33:13.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:33:13.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:33:13.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:33:13.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:33:13.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:33:13.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:33:13.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:33:13.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:33:13.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.766 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.766 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:13.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.356077690000006, 2024-09-05T17:33:13.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:33:13.767 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.767 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.767 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.768 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:33:13.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:13.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:13.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:33:13.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:33:13.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:33:13.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:33:13.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:33:13.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:33:13.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:33:13.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:33:13.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:33:13.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:33:13.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:33:13.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:33:13.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:33:13.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:33:13.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.775 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.775 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.776 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.776 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:13.776 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.356027843999996, 2024-09-05T17:33:13.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:33:13.776 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.776 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.777 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.777 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:33:13.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.778 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:13.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:13.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:33:13.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:33:13.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:33:13.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:33:13.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:33:13.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:33:13.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:33:13.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:33:13.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:33:13.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.355982535999999, 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.788 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.355934520000005, 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:13.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.355861387999994, 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:33:13.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:13.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.355812361999995, 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:13.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:33:13.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.355727345000005, 2024-09-05T17:33:13.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:33:13.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:33:13.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.355671623000006, 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:33:13.808 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:33:13.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.355608764999999, 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:33:13.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:33:13.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.355462192000005, 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:33:13.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:33:13.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.348558960999995, 2024-09-05T17:33:13.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:33:13.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.348537167000003, 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.827 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:33:13.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.831 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.348493704000006, 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:33:13.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.836 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.348457033000003, 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:33:13.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.348416725999996, 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:33:13.841 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:33:13.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:33:13.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.348378019999998, 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:33:13.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.568371773000003, 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:33:13.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:33:13.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:33:13.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:33:13.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.197041196999997, 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:33:13.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:13.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:33:13.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:13.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:13.864 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:13.864 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:13.865 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:13.865 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:13.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:33:13.867 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:13.867 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:13.861+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:13.966 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:13.965+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:14.041 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:14.041 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:14.055 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:33:14.101 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:14.100+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:14.169 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:14.165+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:14.175 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:14.175 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:14.189 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:33:14.270 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:14.269+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:14.356 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:14.357 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:14.370 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:14.368+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:14.371 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:33:14.471 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:14.468+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:14.508 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:14.508 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:14.523 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:33:14.555 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:33:14.571 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:14.569+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:14.670 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:14.671 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:14.672 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:14.669+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:14.694 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:33:14.781 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:14.781+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:14.857 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:14.872 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:33:14.874 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:14.872+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:14.974 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:14.973+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:15.044 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:15.044 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:15.058 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:33:15.102 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:15.101+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:15.176 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:15.172+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:15.227 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:15.228 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:15.242 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:33:15.289 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:15.289+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:15.362 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:15.362 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:15.378 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:33:15.378 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:15.377+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:15.478 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:15.477+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:15.547 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:15.547 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:15.561 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:33:15.597 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:33:15.597 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:15.597+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:15.680 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:15.677+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:15.733 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:15.733 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:15.749 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:33:15.780 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:15.776+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:15.868 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:33:15.913 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:15.913+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:15.922 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:15.922 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:15.938 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:33:15.982 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:15.980+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:16.016 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:16.016 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:16.033 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:16.033 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:16.050 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:16.050 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:16.067 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:16.067 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:16.083 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:16.080+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:16.087 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:16.088 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:16.099 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:16.099 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:16.100 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:16.100 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:16.108 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:16.109 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:16.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:33:16.130 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:16.130 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:16.151 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:16.151 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:16.184 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:16.180+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:16.249 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:16.250 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:16.250 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:16.250 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:16.250 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:16.264 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:33:16.285 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:16.284+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:16.386 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:16.385+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:16.393 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:16.393 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 137.181116489, 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.394 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:16.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:33:16.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 137.180027991, 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:33:16.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:33:16.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:33:16.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 137.16968577700001, 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:33:16.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.408 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 137.16908037799999, 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:33:16.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:16.413 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 137.16802125000001, 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.414 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:33:16.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 137.16571987899999, 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.418 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:16.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:33:16.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 137.16462848899999, 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:33:16.423 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:16.424 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.425 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.426 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:33:16.427 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 137.16361072800001, 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:16.428 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.429 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.430 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:33:16.431 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.432 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.387757113999996, 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:33:16.433 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.434 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:33:16.435 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.436 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.437 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:33:16.438 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.439 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 59.795326144000001, 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.440 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:16.441 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:33:16.442 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.443 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.444 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:16.445 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.446 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.4580743, 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:33:16.447 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.448 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.449 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.450 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.451 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.456100089000003, 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.452 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:33:16.453 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:33:16.454 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.455 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:16.456 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.456070210999997, 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:16.457 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:33:16.458 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:33:16.459 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.460 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.453159872000001, 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.461 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:16.462 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:33:16.463 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:33:16.464 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.465 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.452819208999998, 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:33:16.466 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.467 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.468 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.469 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.470 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.450623737000001, 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.471 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:33:16.472 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.473 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.474 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.475 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.445935327000001, 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.476 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.477 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:33:16.478 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.479 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:33:16.480 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.442941517999998, 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.481 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.482 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.483 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:33:16.484 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.485 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.438005867000001, 2024-09-05T17:33:16.486 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.487 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.488 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.489 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.490 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 56.434450466000001, 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:33:16.491 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.492 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.493 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:33:16.494 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:33:16.495 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:33:16.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.496 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:16.496 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:16.496 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:16.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:33:16.498 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:16.496+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:16.599 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:16.596+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:16.645 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:16.645 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:16.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.645 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4158 3.8 e154/101 3:15ddc004:::rbd_data.11409622ac7f.000000000000000f:c v 154'337, mlcod=153'333)", 2024-09-05T17:33:16.645 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:16.645544+0000", 2024-09-05T17:33:16.645 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00068906800000000004, 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074046099999999998, 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.645544+0000", 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.645544+0000", 2024-09-05T17:33:16.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.645545+0000", 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9299999999999996e-07 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.645554+0000", 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4099999999999997e-06 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:16.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.645581+0000", 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7209999999999999e-05 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.645601+0000", 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9167000000000001e-05 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.645736+0000", 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013496600000000001 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.645789+0000", 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3613999999999999e-05 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-05T17:33:16.649 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:16.662 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:33:16.700 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:16.697+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:16.801 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:16.797+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:16.842 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:16.842 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:16.842 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:16.857 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:33:16.901 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:16.901+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27831923799999, 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:33:16.983 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:16.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:33:16.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:33:16.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:16.988 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.278271854, 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:33:16.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:33:16.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27822718199999, 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:16.993 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:33:16.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:33:16.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27818184, 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:16.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:16.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27811283, 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.003 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:33:17.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:33:17.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27806439299999, 2024-09-05T17:33:17.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:17.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:33:17.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.278018035, 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.012 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:33:17.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:33:17.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27735544500001, 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:33:17.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27726409900001, 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.022 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:33:17.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27720261900001, 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.027 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:33:17.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.277145719, 2024-09-05T17:33:17.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:33:17.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.277052478, 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.036 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:33:17.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:33:17.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.27699294999999, 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:33:17.041 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:33:17.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:17.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.26983698800001, 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:17.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:33:17.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.26977552100001, 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:33:17.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.267907552, 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:33:17.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:33:17.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.060 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.26786704200001, 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.061 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:33:17.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:17.065 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.267828576, 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:17.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:33:17.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.267770469, 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:17.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.074 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.267713168, 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.075 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.080 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:17.081 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:33:17.082 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:17.080+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:17.182 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:17.181+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:17.251 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:17.251 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:17.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:33:17.309 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:17.308+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:17.384 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:17.380+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:17.385 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:17.385 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:17.385 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:17.385 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:17.385 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:17.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:33:17.484 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:17.481+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:17.579 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.579 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.122124710999998, 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:33:17.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:33:17.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:17.584 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.122076429000003, 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:33:17.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.122030069000004, 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.589 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:33:17.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121981468000001, 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:33:17.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121925868999995, 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.597 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:33:17.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121880625000003, 2024-09-05T17:33:17.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.605 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121836126000005, 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:33:17.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121792169000003, 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.610 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:33:17.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.613 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121746831999999, 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.614 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:33:17.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121700383000004, 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.618 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:17.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:33:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121656821000002, 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:33:17.622 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.626 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121611446000003, 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.627 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:33:17.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121562334999993, 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:17.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121523401000005, 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.635 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:33:17.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121453739000003, 2024-09-05T17:33:17.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:17.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121401187999993, 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.644 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:33:17.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:33:17.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121255632, 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:33:17.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.121204051000007, 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:33:17.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:33:17.656 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.889181679999993, 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:33:17.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:17.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:116533 3.7 3:e6924f8b:::rbd_data.11402f0626d4.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.306927979999998, 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.069225986000000003, 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116533 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272329+0000", 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272340+0000", 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.172e-05 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272372+0000", 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1192000000000002e-05 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272387+0000", 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5339999999999999e-05 2024-09-05T17:33:17.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272494+0000", 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650300000000001 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272629+0000", 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135845 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.286878+0000", 2024-09-05T17:33:17.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014248241 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341353+0000", 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054475896000000003 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341387+0000", 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3043000000000002e-05 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:17.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341475+0000", 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8103000000000007e-05 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341552+0000", 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7539000000000004e-05 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:17.668 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:17.669 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-05T17:33:17.670 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:33:17.670 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:17.668+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:17.773 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:17.769+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:17.845 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:17.845 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:17.861 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:33:17.874 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:17.873+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:17.974 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:17.972+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:17.983 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:17.983 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:17.983 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:17.983 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:17.983 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:17.999 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:33:18.076 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:18.073+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:18.168 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 171.15052979500001, 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:18.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:18.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:33:18.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:33:18.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783538432, 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:18.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:33:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783487515999994, 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.181 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:33:18.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783437669999998, 2024-09-05T17:33:18.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:18.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:33:18.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783392362000001, 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:33:18.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783344346000007, 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:18.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783271213999996, 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:33:18.199 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:33:18.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783222187999996, 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:33:18.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:33:18.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:18.208 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783137171000007, 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:33:18.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783081448999994, 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:18.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:33:18.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:33:18.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.783018591000001, 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.219 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:33:18.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:33:18.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:33:18.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:33:18.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:33:18.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:33:18.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:33:18.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.226 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.226 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.226 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:18.226 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.782872018000006, 2024-09-05T17:33:18.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:33:18.227 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.227 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.227 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.228 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:33:18.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.232 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.775968786999996, 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:33:18.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.775946993000005, 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:33:18.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.775903529999994, 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:33:18.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.246 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.775866859000004, 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:33:18.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.775826551999998, 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.251 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:18.255 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.775787846, 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.995781598999997, 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.260 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:33:18.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.624451022999999, 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:18.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:18.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:18.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:33:18.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:33:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:18.272 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:18.272 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:18.272 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:33:18.274 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:33:18.274 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:18.272+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:18.375 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:18.372+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:18.434 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:18.434 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:18.443 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:18.444 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:18.444 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:18.444 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:18.450 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:18.451 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:18.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:33:18.467 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:18.467 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:18.477 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:18.473+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:18.483 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:18.484 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:18.504 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:18.504 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:18.506 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-09-05T17:33:18.506 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:33:18.507 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:33:18.525 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:18.526 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:18.545 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:18.545 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:18.564 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:18.565 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:18.577 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:18.576+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:18.619 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is set 2024-09-05T17:33:18.634 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:18.634 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:18.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:33:18.693 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:18.692+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:18.778 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:18.776+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:18.820 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:18.820 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:18.834 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:33:18.838 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:18.839 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:33:18.858 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-05T17:33:18.618074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":279927722,"num_objects":659,"num_object_clones":251,"num_object_copies":1318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":659,"num_whiteouts":206,"num_read":172034,"num_read_kb":803822,"num_write":23313,"num_write_kb":365489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2215,"num_bytes_recovered":109683083,"num_keys_recovered":262,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18909,"ondisk_log_size":18909,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":413576,"kb_used_data":24720,"kb_used_omap":38,"kb_used_meta":388633,"kb_avail":754561144,"statfs":{"total":773094113280,"available":772670611456,"internally_reserved":0,"allocated":25313280,"data_stored":103575073,"data_compressed":3008677,"data_compressed_allocated":6942720,"data_compressed_original":94042460,"omap_allocated":39856,"internal_metadata":397960272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-164842584,"num_objects":-80,"num_object_clones":-18,"num_object_copies":-160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-80,"num_whiteouts":-17,"num_read":1192,"num_read_kb":1019,"num_write":194,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.026592"},"pg_stats":[{"pgid":"3.1f","version":"152'405","reported_seq":3324,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.761283+0000","last_change":"2024-09-05T17:33:14.605644+0000","last_active":"2024-09-05T17:33:14.761283+0000","last_peered":"2024-09-05T17:33:14.761283+0000","last_clean":"2024-09-05T17:33:14.761283+0000","last_became_active":"2024-09-05T17:33:03.518878+0000","last_became_peered":"2024-09-05T17:33:03.518878+0000","last_unstale":"2024-09-05T17:33:14.761283+0000","last_undegraded":"2024-09-05T17:33:14.761283+0000","last_fullsized":"2024-09-05T17:33:14.761283+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:53:00.000358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043982639999999998,"stat_sum":{"num_bytes":6716393,"num_objects":25,"num_object_clones":9,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":3093,"num_read_kb":16791,"num_write":504,"num_write_kb":14008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":8881682,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.1e","version":"148'306","reported_seq":1986,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.597952+0000","last_change":"2024-09-05T17:33:14.598349+0000","last_active":"2024-09-05T17:33:14.597952+0000","last_peered":"2024-09-05T17:33:14.597952+0000","last_clean":"2024-09-05T17:33:14.597952+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:33:14.597952+0000","last_undegraded":"2024-09-05T17:33:14.597952+0000","last_fullsized":"2024-09-05T17:33:14.597952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:54:59.712658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001293607,"stat_sum":{"num_bytes":3071578,"num_objects":12,"num_object_clones":4,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":5,"num_read":2153,"num_read_kb":10602,"num_write":326,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.1d","version":"149'510","reported_seq":3159,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-05T17:33:13.598940+0000","last_change":"2024-09-05T17:33:13.599430+0000","last_active":"2024-09-05T17:33:13.598940+0000","last_peered":"2024-09-05T17:33:13.598940+0000","last_clean":"2024-09-05T17:33:13.598940+0000","last_became_active":"2024-09-05T17:33:00.876268+0000","last_became_peered":"2024-09-05T17:33:00.876268+0000","last_unstale":"2024-09-05T17:33:13.598940+0000","last_undegraded":"2024-09-05T17:33:13.598940+0000","last_fullsized":"2024-09-05T17:33:13.598940+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:05:25.392507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079693099999999996,"stat_sum":{"num_bytes":20808402,"num_objects":21,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":5,"num_read":3797,"num_read_kb":19752,"num_write":559,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"f","length":"9"}]},{"pgid":"3.1c","version":"151'513","reported_seq":3537,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-05T17:33:13.707883+0000","last_change":"2024-09-05T17:33:13.599402+0000","last_active":"2024-09-05T17:33:13.707883+0000","last_peered":"2024-09-05T17:33:13.707883+0000","last_clean":"2024-09-05T17:33:13.707883+0000","last_became_active":"2024-09-05T17:33:03.519693+0000","last_became_peered":"2024-09-05T17:33:03.519693+0000","last_unstale":"2024-09-05T17:33:13.707883+0000","last_undegraded":"2024-09-05T17:33:13.707883+0000","last_fullsized":"2024-09-05T17:33:13.707883+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:14.932277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079432899999999998,"stat_sum":{"num_bytes":3470722,"num_objects":15,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":3,"num_read":3803,"num_read_kb":20449,"num_write":584,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":4255396,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"f","length":"9"}]},{"pgid":"3.1b","version":"152'423","reported_seq":2308,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.609123+0000","last_change":"2024-09-05T17:33:14.609535+0000","last_active":"2024-09-05T17:33:14.609123+0000","last_peered":"2024-09-05T17:33:14.609123+0000","last_clean":"2024-09-05T17:33:14.609123+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:33:14.609123+0000","last_undegraded":"2024-09-05T17:33:14.609123+0000","last_fullsized":"2024-09-05T17:33:14.609123+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:59:08.407114+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0085108630000000005,"stat_sum":{"num_bytes":4969213,"num_objects":16,"num_object_clones":7,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":2383,"num_read_kb":34002,"num_write":453,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.1a","version":"152'629","reported_seq":5900,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.758569+0000","last_change":"2024-09-05T17:33:14.623634+0000","last_active":"2024-09-05T17:33:14.758569+0000","last_peered":"2024-09-05T17:33:14.758569+0000","last_clean":"2024-09-05T17:33:14.758569+0000","last_became_active":"2024-09-05T17:31:31.708688+0000","last_became_peered":"2024-09-05T17:31:31.708688+0000","last_unstale":"2024-09-05T17:33:14.758569+0000","last_undegraded":"2024-09-05T17:33:14.758569+0000","last_fullsized":"2024-09-05T17:33:14.758569+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:42:16.238635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00123985,"stat_sum":{"num_bytes":3622802,"num_objects":21,"num_object_clones":6,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":7259,"num_read_kb":18391,"num_write":708,"num_write_kb":4664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.19","version":"151'595","reported_seq":8079,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.622889+0000","last_change":"2024-09-05T17:33:14.623197+0000","last_active":"2024-09-05T17:33:14.622889+0000","last_peered":"2024-09-05T17:33:14.622889+0000","last_clean":"2024-09-05T17:33:14.622889+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:33:14.622889+0000","last_undegraded":"2024-09-05T17:33:14.622889+0000","last_fullsized":"2024-09-05T17:33:14.622889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:20:01.619916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083373400000000004,"stat_sum":{"num_bytes":10668989,"num_objects":10,"num_object_clones":3,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":4,"num_read":8624,"num_read_kb":37041,"num_write":691,"num_write_kb":9672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.18","version":"150'444","reported_seq":2761,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.596881+0000","last_change":"2024-09-05T17:33:14.597282+0000","last_active":"2024-09-05T17:33:14.596881+0000","last_peered":"2024-09-05T17:33:14.596881+0000","last_clean":"2024-09-05T17:33:14.596881+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:33:14.596881+0000","last_undegraded":"2024-09-05T17:33:14.596881+0000","last_fullsized":"2024-09-05T17:33:14.596881+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:31:45.261534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072428399999999995,"stat_sum":{"num_bytes":4735582,"num_objects":18,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":2261,"num_read_kb":32589,"num_write":541,"num_write_kb":10681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.17","version":"149'747","reported_seq":2635,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.603930+0000","last_change":"2024-09-05T17:33:14.604776+0000","last_active":"2024-09-05T17:33:14.603930+0000","last_peered":"2024-09-05T17:33:14.603930+0000","last_clean":"2024-09-05T17:33:14.603930+0000","last_became_active":"2024-09-05T17:33:00.882325+0000","last_became_peered":"2024-09-05T17:33:00.882325+0000","last_unstale":"2024-09-05T17:33:14.603930+0000","last_undegraded":"2024-09-05T17:33:14.603930+0000","last_fullsized":"2024-09-05T17:33:14.603930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:32:26.757185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037714990000000002,"stat_sum":{"num_bytes":636931,"num_objects":10,"num_object_clones":2,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":3,"num_read":3569,"num_read_kb":12727,"num_write":1014,"num_write_kb":5563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":2814153,"num_keys_recovered":25,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.16","version":"151'741","reported_seq":1870,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-05T17:33:13.685266+0000","last_change":"2024-09-05T17:33:13.601643+0000","last_active":"2024-09-05T17:33:13.685266+0000","last_peered":"2024-09-05T17:33:13.685266+0000","last_clean":"2024-09-05T17:33:13.685266+0000","last_became_active":"2024-09-05T17:33:00.872821+0000","last_became_peered":"2024-09-05T17:33:00.872821+0000","last_unstale":"2024-09-05T17:33:13.685266+0000","last_undegraded":"2024-09-05T17:33:13.685266+0000","last_fullsized":"2024-09-05T17:33:13.685266+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:37:44.851275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029103739999999999,"stat_sum":{"num_bytes":5612856,"num_objects":29,"num_object_clones":12,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":8,"num_read":4270,"num_read_kb":14267,"num_write":942,"num_write_kb":13320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"f","length":"9"}]},{"pgid":"3.15","version":"150'290","reported_seq":1473,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.610219+0000","last_change":"2024-09-05T17:33:14.611905+0000","last_active":"2024-09-05T17:33:14.610219+0000","last_peered":"2024-09-05T17:33:14.610219+0000","last_clean":"2024-09-05T17:33:14.610219+0000","last_became_active":"2024-09-05T17:30:43.598646+0000","last_became_peered":"2024-09-05T17:30:43.598646+0000","last_unstale":"2024-09-05T17:33:14.610219+0000","last_undegraded":"2024-09-05T17:33:14.610219+0000","last_fullsized":"2024-09-05T17:33:14.610219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:05:42.160814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049880990000000002,"stat_sum":{"num_bytes":4803252,"num_objects":29,"num_object_clones":12,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":11,"num_read":845,"num_read_kb":16276,"num_write":246,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.14","version":"151'481","reported_seq":14493,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.607411+0000","last_change":"2024-09-05T17:33:14.608547+0000","last_active":"2024-09-05T17:33:14.607411+0000","last_peered":"2024-09-05T17:33:14.607411+0000","last_clean":"2024-09-05T17:33:14.607411+0000","last_became_active":"2024-09-05T17:31:31.707629+0000","last_became_peered":"2024-09-05T17:31:31.707629+0000","last_unstale":"2024-09-05T17:33:14.607411+0000","last_undegraded":"2024-09-05T17:33:14.607411+0000","last_fullsized":"2024-09-05T17:33:14.607411+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:48:44.062244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020333959999999998,"stat_sum":{"num_bytes":4689067,"num_objects":18,"num_object_clones":8,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":15148,"num_read_kb":37249,"num_write":445,"num_write_kb":4447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"2.7","version":"0'0","reported_seq":281,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.594702+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:33:14.594702+0000","last_peered":"2024-09-05T17:33:14.594702+0000","last_clean":"2024-09-05T17:33:14.594702+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:33:14.594702+0000","last_undegraded":"2024-09-05T17:33:14.594702+0000","last_fullsized":"2024-09-05T17:33:14.594702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"152'466","reported_seq":5753,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.603861+0000","last_change":"2024-09-05T17:33:14.603861+0000","last_active":"2024-09-05T17:33:14.603861+0000","last_peered":"2024-09-05T17:33:14.603861+0000","last_clean":"2024-09-05T17:33:14.603861+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:33:14.603861+0000","last_undegraded":"2024-09-05T17:33:14.603861+0000","last_fullsized":"2024-09-05T17:33:14.603861+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:44:17.992635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002990927,"stat_sum":{"num_bytes":5191165,"num_objects":23,"num_object_clones":9,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":6263,"num_read_kb":26198,"num_write":415,"num_write_kb":8488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.594301+0000","last_change":"2024-09-05T17:32:05.421784+0000","last_active":"2024-09-05T17:33:14.594301+0000","last_peered":"2024-09-05T17:33:14.594301+0000","last_clean":"2024-09-05T17:33:14.594301+0000","last_became_active":"2024-09-05T17:32:05.420725+0000","last_became_peered":"2024-09-05T17:32:05.420725+0000","last_unstale":"2024-09-05T17:33:14.594301+0000","last_undegraded":"2024-09-05T17:33:14.594301+0000","last_fullsized":"2024-09-05T17:33:14.594301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:29:14.852745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"152'448","reported_seq":1841,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.762994+0000","last_change":"2024-09-05T17:33:14.596544+0000","last_active":"2024-09-05T17:33:14.762994+0000","last_peered":"2024-09-05T17:33:14.762994+0000","last_clean":"2024-09-05T17:33:14.762994+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:33:14.762994+0000","last_undegraded":"2024-09-05T17:33:14.762994+0000","last_fullsized":"2024-09-05T17:33:14.762994+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:02:42.975390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00192724,"stat_sum":{"num_bytes":2771848,"num_objects":10,"num_object_clones":4,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":5,"num_read":1548,"num_read_kb":31708,"num_write":525,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"2.5","version":"0'0","reported_seq":293,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.607439+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:33:14.607439+0000","last_peered":"2024-09-05T17:33:14.607439+0000","last_clean":"2024-09-05T17:33:14.607439+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:33:14.607439+0000","last_undegraded":"2024-09-05T17:33:14.607439+0000","last_fullsized":"2024-09-05T17:33:14.607439+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"152'764","reported_seq":3834,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.628465+0000","last_change":"2024-09-05T17:33:14.628776+0000","last_active":"2024-09-05T17:33:14.628465+0000","last_peered":"2024-09-05T17:33:14.628465+0000","last_clean":"2024-09-05T17:33:14.628465+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:33:14.628465+0000","last_undegraded":"2024-09-05T17:33:14.628465+0000","last_fullsized":"2024-09-05T17:33:14.628465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":764,"log_dups_size":0,"ondisk_log_size":764,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:37:25.233345+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0061391630000000004,"stat_sum":{"num_bytes":3032947,"num_objects":16,"num_object_clones":5,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":5,"num_read":6339,"num_read_kb":21038,"num_write":1010,"num_write_kb":10164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"2.4","version":"0'0","reported_seq":292,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.622928+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:33:14.622928+0000","last_peered":"2024-09-05T17:33:14.622928+0000","last_clean":"2024-09-05T17:33:14.622928+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:33:14.622928+0000","last_undegraded":"2024-09-05T17:33:14.622928+0000","last_fullsized":"2024-09-05T17:33:14.622928+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'522","reported_seq":1934,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-05T17:33:13.600847+0000","last_change":"2024-09-05T17:33:13.601287+0000","last_active":"2024-09-05T17:33:13.600847+0000","last_peered":"2024-09-05T17:33:13.600847+0000","last_clean":"2024-09-05T17:33:13.600847+0000","last_became_active":"2024-09-05T17:33:00.880861+0000","last_became_peered":"2024-09-05T17:33:00.880861+0000","last_unstale":"2024-09-05T17:33:13.600847+0000","last_undegraded":"2024-09-05T17:33:13.600847+0000","last_fullsized":"2024-09-05T17:33:13.600847+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:08:40.254040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024727949999999999,"stat_sum":{"num_bytes":20440527,"num_objects":22,"num_object_clones":8,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":6,"num_read":3065,"num_read_kb":48291,"num_write":557,"num_write_kb":29607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":14386340,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"f","length":"9"}]},{"pgid":"3.3","version":"152'554","reported_seq":7195,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.731555+0000","last_change":"2024-09-05T17:33:14.603043+0000","last_active":"2024-09-05T17:33:14.731555+0000","last_peered":"2024-09-05T17:33:14.731555+0000","last_clean":"2024-09-05T17:33:14.731555+0000","last_became_active":"2024-09-05T17:32:16.016556+0000","last_became_peered":"2024-09-05T17:32:16.016556+0000","last_unstale":"2024-09-05T17:33:14.731555+0000","last_undegraded":"2024-09-05T17:33:14.731555+0000","last_fullsized":"2024-09-05T17:33:14.731555+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:47:07.670834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023769640000000001,"stat_sum":{"num_bytes":4322534,"num_objects":23,"num_object_clones":10,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":5,"num_read":7168,"num_read_kb":46594,"num_write":583,"num_write_kb":19058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"2.2","version":"22'2","reported_seq":125,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.622757+0000","last_change":"2024-09-05T17:33:00.879190+0000","last_active":"2024-09-05T17:33:14.622757+0000","last_peered":"2024-09-05T17:33:14.622757+0000","last_clean":"2024-09-05T17:33:14.622757+0000","last_became_active":"2024-09-05T17:33:00.878548+0000","last_became_peered":"2024-09-05T17:33:00.878548+0000","last_unstale":"2024-09-05T17:33:14.622757+0000","last_undegraded":"2024-09-05T17:33:14.622757+0000","last_fullsized":"2024-09-05T17:33:14.622757+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:55:39.446037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"149'1377","reported_seq":3681,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.623370+0000","last_change":"2024-09-05T17:33:14.624678+0000","last_active":"2024-09-05T17:33:14.623370+0000","last_peered":"2024-09-05T17:33:14.623370+0000","last_clean":"2024-09-05T17:33:14.623370+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:33:14.623370+0000","last_undegraded":"2024-09-05T17:33:14.623370+0000","last_fullsized":"2024-09-05T17:33:14.623370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1377,"log_dups_size":0,"ondisk_log_size":1377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:37:22.879016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021346939999999999,"stat_sum":{"num_bytes":5971662,"num_objects":35,"num_object_clones":15,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":8370,"num_read_kb":10424,"num_write":2205,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"2.1","version":"0'0","reported_seq":280,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.592353+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:33:14.592353+0000","last_peered":"2024-09-05T17:33:14.592353+0000","last_clean":"2024-09-05T17:33:14.592353+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:33:14.592353+0000","last_undegraded":"2024-09-05T17:33:14.592353+0000","last_fullsized":"2024-09-05T17:33:14.592353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"145'580","reported_seq":8920,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.601048+0000","last_change":"2024-09-05T17:33:14.601909+0000","last_active":"2024-09-05T17:33:14.601048+0000","last_peered":"2024-09-05T17:33:14.601048+0000","last_clean":"2024-09-05T17:33:14.601048+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:33:14.601048+0000","last_undegraded":"2024-09-05T17:33:14.601048+0000","last_fullsized":"2024-09-05T17:33:14.601048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:27:26.767261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012933560000000001,"stat_sum":{"num_bytes":21762521,"num_objects":26,"num_object_clones":10,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":8,"num_read":10098,"num_read_kb":44274,"num_write":633,"num_write_kb":11402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"2.0","version":"0'0","reported_seq":299,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.606025+0000","last_change":"2024-09-05T17:32:10.998471+0000","last_active":"2024-09-05T17:33:14.606025+0000","last_peered":"2024-09-05T17:33:14.606025+0000","last_clean":"2024-09-05T17:33:14.606025+0000","last_became_active":"2024-09-05T17:32:10.997586+0000","last_became_peered":"2024-09-05T17:32:10.997586+0000","last_unstale":"2024-09-05T17:33:14.606025+0000","last_undegraded":"2024-09-05T17:33:14.606025+0000","last_fullsized":"2024-09-05T17:33:14.606025+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:35:48.493112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"149'1622","reported_seq":5660,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.597863+0000","last_change":"2024-09-05T17:33:14.598491+0000","last_active":"2024-09-05T17:33:14.597863+0000","last_peered":"2024-09-05T17:33:14.597863+0000","last_clean":"2024-09-05T17:33:14.597863+0000","last_became_active":"2024-09-05T17:33:00.882030+0000","last_became_peered":"2024-09-05T17:33:00.882030+0000","last_unstale":"2024-09-05T17:33:14.597863+0000","last_undegraded":"2024-09-05T17:33:14.597863+0000","last_fullsized":"2024-09-05T17:33:14.597863+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1622,"log_dups_size":0,"ondisk_log_size":1622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:10:40.157518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018761030000000001,"stat_sum":{"num_bytes":23004343,"num_objects":27,"num_object_clones":11,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":11310,"num_read_kb":20306,"num_write":2774,"num_write_kb":11130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":4232019,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"2.3","version":"20'1","reported_seq":145,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-05T17:33:13.598572+0000","last_change":"2024-09-05T17:33:00.874549+0000","last_active":"2024-09-05T17:33:13.598572+0000","last_peered":"2024-09-05T17:33:13.598572+0000","last_clean":"2024-09-05T17:33:13.598572+0000","last_became_active":"2024-09-05T17:33:00.874107+0000","last_became_peered":"2024-09-05T17:33:00.874107+0000","last_unstale":"2024-09-05T17:33:13.598572+0000","last_undegraded":"2024-09-05T17:33:13.598572+0000","last_fullsized":"2024-09-05T17:33:13.598572+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:27:19.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":396,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.606333+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:33:14.606333+0000","last_peered":"2024-09-05T17:33:14.606333+0000","last_clean":"2024-09-05T17:33:14.606333+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:33:14.606333+0000","last_undegraded":"2024-09-05T17:33:14.606333+0000","last_fullsized":"2024-09-05T17:33:14.606333+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"151'331","reported_seq":3168,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.596955+0000","last_change":"2024-09-05T17:33:14.597636+0000","last_active":"2024-09-05T17:33:14.596955+0000","last_peered":"2024-09-05T17:33:14.596955+0000","last_clean":"2024-09-05T17:33:14.596955+0000","last_became_active":"2024-09-05T17:32:20.527382+0000","last_became_peered":"2024-09-05T17:32:20.527382+0000","last_unstale":"2024-09-05T17:33:14.596955+0000","last_undegraded":"2024-09-05T17:33:14.596955+0000","last_fullsized":"2024-09-05T17:33:14.596955+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:52:35.870096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001072415,"stat_sum":{"num_bytes":7640023,"num_objects":28,"num_object_clones":11,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":10,"num_read":2160,"num_read_kb":21975,"num_write":352,"num_write_kb":23331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":10573315,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.9","version":"146'750","reported_seq":5147,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.596013+0000","last_change":"2024-09-05T17:33:14.597373+0000","last_active":"2024-09-05T17:33:14.596013+0000","last_peered":"2024-09-05T17:33:14.596013+0000","last_clean":"2024-09-05T17:33:14.596013+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:33:14.596013+0000","last_undegraded":"2024-09-05T17:33:14.596013+0000","last_fullsized":"2024-09-05T17:33:14.596013+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:47:38.099617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020531,"stat_sum":{"num_bytes":9269370,"num_objects":20,"num_object_clones":8,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":7371,"num_read_kb":22403,"num_write":1002,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.a","version":"152'540","reported_seq":4231,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.595945+0000","last_change":"2024-09-05T17:33:14.595945+0000","last_active":"2024-09-05T17:33:14.595945+0000","last_peered":"2024-09-05T17:33:14.595945+0000","last_clean":"2024-09-05T17:33:14.595945+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:33:14.595945+0000","last_undegraded":"2024-09-05T17:33:14.595945+0000","last_fullsized":"2024-09-05T17:33:14.595945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:39:57.282920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014435279999999999,"stat_sum":{"num_bytes":3899699,"num_objects":21,"num_object_clones":7,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":4072,"num_read_kb":25724,"num_write":626,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.b","version":"152'1045","reported_seq":10981,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.724731+0000","last_change":"2024-09-05T17:33:14.599894+0000","last_active":"2024-09-05T17:33:14.724731+0000","last_peered":"2024-09-05T17:33:14.724731+0000","last_clean":"2024-09-05T17:33:14.724731+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:33:14.724731+0000","last_undegraded":"2024-09-05T17:33:14.724731+0000","last_fullsized":"2024-09-05T17:33:14.724731+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1045,"log_dups_size":0,"ondisk_log_size":1045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:38:22.204454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025222119999999998,"stat_sum":{"num_bytes":25556505,"num_objects":26,"num_object_clones":10,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":6,"num_read":13682,"num_read_kb":37133,"num_write":1454,"num_write_kb":15758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.c","version":"151'327","reported_seq":1215,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-05T17:33:13.604591+0000","last_change":"2024-09-05T17:33:13.604591+0000","last_active":"2024-09-05T17:33:13.604591+0000","last_peered":"2024-09-05T17:33:13.604591+0000","last_clean":"2024-09-05T17:33:13.604591+0000","last_became_active":"2024-09-05T17:33:00.880726+0000","last_became_peered":"2024-09-05T17:33:00.880726+0000","last_unstale":"2024-09-05T17:33:13.604591+0000","last_undegraded":"2024-09-05T17:33:13.604591+0000","last_fullsized":"2024-09-05T17:33:13.604591+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:10:47.828152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057209979999999997,"stat_sum":{"num_bytes":2218667,"num_objects":15,"num_object_clones":7,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":8,"num_read":1859,"num_read_kb":26572,"num_write":297,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2323932,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"f","length":"9"}]},{"pgid":"3.d","version":"148'437","reported_seq":2197,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.612121+0000","last_change":"2024-09-05T17:33:14.612750+0000","last_active":"2024-09-05T17:33:14.612121+0000","last_peered":"2024-09-05T17:33:14.612121+0000","last_clean":"2024-09-05T17:33:14.612121+0000","last_became_active":"2024-09-05T17:33:03.523083+0000","last_became_peered":"2024-09-05T17:33:03.523083+0000","last_unstale":"2024-09-05T17:33:14.612121+0000","last_undegraded":"2024-09-05T17:33:14.612121+0000","last_fullsized":"2024-09-05T17:33:14.612121+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:04:45.890718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00578722,"stat_sum":{"num_bytes":4838489,"num_objects":18,"num_object_clones":7,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":5,"num_read":2520,"num_read_kb":18217,"num_write":444,"num_write_kb":14035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":5727979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.e","version":"151'257","reported_seq":2102,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.612907+0000","last_change":"2024-09-05T17:33:14.613579+0000","last_active":"2024-09-05T17:33:14.612907+0000","last_peered":"2024-09-05T17:33:14.612907+0000","last_clean":"2024-09-05T17:33:14.612907+0000","last_became_active":"2024-09-05T17:30:43.600952+0000","last_became_peered":"2024-09-05T17:30:43.600952+0000","last_unstale":"2024-09-05T17:33:14.612907+0000","last_undegraded":"2024-09-05T17:33:14.612907+0000","last_fullsized":"2024-09-05T17:33:14.612907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:14:30.644856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0060485440000000003,"stat_sum":{"num_bytes":2401733,"num_objects":17,"num_object_clones":6,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":5,"num_read":1479,"num_read_kb":36544,"num_write":261,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.f","version":"152'468","reported_seq":4790,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.613287+0000","last_change":"2024-09-05T17:33:14.613976+0000","last_active":"2024-09-05T17:33:14.613287+0000","last_peered":"2024-09-05T17:33:14.613287+0000","last_clean":"2024-09-05T17:33:14.613287+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:33:14.613287+0000","last_undegraded":"2024-09-05T17:33:14.613287+0000","last_fullsized":"2024-09-05T17:33:14.613287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:54:40.240347+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0072307969999999997,"stat_sum":{"num_bytes":9804535,"num_objects":23,"num_object_clones":9,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":6,"num_read":5055,"num_read_kb":16619,"num_write":530,"num_write_kb":6033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.10","version":"150'574","reported_seq":4698,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.623739+0000","last_change":"2024-09-05T17:33:14.624920+0000","last_active":"2024-09-05T17:33:14.623739+0000","last_peered":"2024-09-05T17:33:14.623739+0000","last_clean":"2024-09-05T17:33:14.623739+0000","last_became_active":"2024-09-05T17:32:51.787759+0000","last_became_peered":"2024-09-05T17:32:51.787759+0000","last_unstale":"2024-09-05T17:33:14.623739+0000","last_undegraded":"2024-09-05T17:33:14.623739+0000","last_fullsized":"2024-09-05T17:33:14.623739+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:51:51.224221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002468338,"stat_sum":{"num_bytes":22713398,"num_objects":19,"num_object_clones":8,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":6,"num_read":5112,"num_read_kb":22195,"num_write":706,"num_write_kb":9423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":4462425,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.11","version":"149'354","reported_seq":1968,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.607238+0000","last_change":"2024-09-05T17:33:14.608583+0000","last_active":"2024-09-05T17:33:14.607238+0000","last_peered":"2024-09-05T17:33:14.607238+0000","last_clean":"2024-09-05T17:33:14.607238+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:33:14.607238+0000","last_undegraded":"2024-09-05T17:33:14.607238+0000","last_fullsized":"2024-09-05T17:33:14.607238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:41:37.724705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021904820000000001,"stat_sum":{"num_bytes":3244252,"num_objects":16,"num_object_clones":5,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":1543,"num_read_kb":23620,"num_write":335,"num_write_kb":9257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.12","version":"152'573","reported_seq":8648,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.604599+0000","last_change":"2024-09-05T17:33:14.605210+0000","last_active":"2024-09-05T17:33:14.604599+0000","last_peered":"2024-09-05T17:33:14.604599+0000","last_clean":"2024-09-05T17:33:14.604599+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:33:14.604599+0000","last_undegraded":"2024-09-05T17:33:14.604599+0000","last_fullsized":"2024-09-05T17:33:14.604599+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:28:11.240232+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0045663580000000004,"stat_sum":{"num_bytes":23580593,"num_objects":31,"num_object_clones":14,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":12,"num_read":9444,"num_read_kb":23607,"num_write":618,"num_write_kb":9519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"e","length":"a"}]},{"pgid":"3.13","version":"151'761","reported_seq":3101,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-05T17:33:14.736148+0000","last_change":"2024-09-05T17:33:14.609966+0000","last_active":"2024-09-05T17:33:14.736148+0000","last_peered":"2024-09-05T17:33:14.736148+0000","last_clean":"2024-09-05T17:33:14.736148+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:33:14.736148+0000","last_undegraded":"2024-09-05T17:33:14.736148+0000","last_fullsized":"2024-09-05T17:33:14.736148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:05:51.609048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033921020000000001,"stat_sum":{"num_bytes":3866737,"num_objects":15,"num_object_clones":5,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":4,"num_read":6305,"num_read_kb":10189,"num_write":870,"num_write_kb":5569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"a"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":279337335,"num_objects":655,"num_object_clones":251,"num_object_copies":1310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":655,"num_whiteouts":206,"num_read":171968,"num_read_kb":803767,"num_write":23210,"num_write_kb":363859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2211,"num_bytes_recovered":108502347,"num_keys_recovered":262,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9666560,"data_stored":85282388,"data_compressed":2461482,"data_compressed_allocated":6041600,"data_compressed_original":82807982,"omap_allocated":10325,"internal_metadata":0},"log_size":18834,"ondisk_log_size":18834,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38540,"kb_used_data":3192,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333300,"statfs":{"total":96636764160,"available":96597299200,"internally_reserved":0,"allocated":3268608,"data_stored":13728969,"data_compressed":298138,"data_compressed_allocated":847872,"data_compressed_original":12427264,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41572,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330268,"statfs":{"total":96636764160,"available":96594194432,"internally_reserved":0,"allocated":2105344,"data_stored":2466235,"data_compressed":77751,"data_compressed_allocated":139264,"data_compressed_original":1507328,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":137,"seq":588410519556,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":3764,"kb_used_omap":28,"kb_used_meta":33059,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":3854336,"data_stored":20760856,"data_compressed":710987,"data_compressed_allocated":1441792,"data_compressed_original":19492014,"omap_allocated":28700,"internal_metadata":33853412},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542180,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48612,"kb_used_data":3532,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323228,"statfs":{"total":96636764160,"available":96586985472,"internally_reserved":0,"allocated":3616768,"data_stored":18527094,"data_compressed":315610,"data_compressed_allocated":1060864,"data_compressed_original":17166336,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":83556,"kb_used_data":3788,"kb_used_omap":1,"kb_used_meta":79742,"kb_avail":94288284,"statfs":{"total":96636764160,"available":96551202816,"internally_reserved":0,"allocated":3878912,"data_stored":18928706,"data_compressed":752973,"data_compressed_allocated":1400832,"data_compressed_original":17628334,"omap_allocated":1593,"internal_metadata":81656263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542182,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47248,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324592,"statfs":{"total":96636764160,"available":96588382208,"internally_reserved":0,"allocated":2224128,"data_stored":2829380,"data_compressed":130242,"data_compressed_allocated":212992,"data_compressed_original":1835008,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55968,"kb_used_data":2572,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315872,"statfs":{"total":96636764160,"available":96579452928,"internally_reserved":0,"allocated":2633728,"data_stored":6505193,"data_compressed":233231,"data_compressed_allocated":479232,"data_compressed_original":5427200,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61204,"kb_used_data":3644,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94310636,"statfs":{"total":96636764160,"available":96574091264,"internally_reserved":0,"allocated":3731456,"data_stored":19828640,"data_compressed":489745,"data_compressed_allocated":1359872,"data_compressed_original":18558976,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1863680,"data_stored":18321788,"data_compressed":483301,"data_compressed_allocated":1318912,"data_compressed_original":17924096,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":765952,"data_stored":5541640,"data_compressed":205069,"data_compressed_allocated":446464,"data_compressed_original":5337088,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":352256,"data_stored":1859548,"data_compressed":102080,"data_compressed_allocated":180224,"data_compressed_original":1744896,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1179648,"data_stored":8146789,"data_compressed":274140,"data_compressed_allocated":643072,"data_compressed_original":7782400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1789952,"data_stored":17653918,"data_compressed":315610,"data_compressed_allocated":1060864,"data_compressed_original":17166336,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2039808,"data_stored":19893991,"data_compressed":710987,"data_compressed_allocated":1441792,"data_compressed_original":19492014,"omap_allocated":10325,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":1599331,"data_compressed":77751,"data_compressed_allocated":139264,"data_compressed_original":1507328,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1384448,"data_stored":12265383,"data_compressed":292544,"data_compressed_allocated":811008,"data_compressed_original":11853824,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:33:18.901 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:18.901+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:18.953 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:18.953 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:18.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:33:19.010 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:19.009+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:19.081 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:19.077+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:19.123 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:19.123 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:19.136 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:33:19.181 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:19.180+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:19.282 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:19.281+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:19.301 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:19.301 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:19.315 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:33:19.402 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:19.401+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:19.484 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:19.484 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:19.484 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:19.481+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:19.498 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:33:19.585 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:19.584+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:19.673 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:19.673 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:19.686 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:19.684+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:19.688 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:33:19.788 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:19.784+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:19.812 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:19.812 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:19.826 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:33:19.888 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:19.884+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:19.950 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:19.951 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:19.965 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:33:20.009 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:20.009+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:20.089 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:20.088+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:20.090 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:20.090 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:20.104 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:33:20.190 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:20.189+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:20.266 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:20.266 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:20.280 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:33:20.322 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:20.321+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:20.392 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:20.388+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:20.447 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:20.448 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:20.462 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:33:20.509 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:20.509+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:20.583 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:20.583 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:20.584 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:33:20.593 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:20.592+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:20.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:33:20.649 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-05T17:33:20.729 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:20.729+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:20.755 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:20.755 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:20.771 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:20.771 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:20.774 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:20.775 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:20.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:33:20.794 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:20.795 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:20.795 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:20.793+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:20.814 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:20.814 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:20.841 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:20.841 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:20.859 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:20.860 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:20.878 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:20.878 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:20.896 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:20.892+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:20.903 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:20.903 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:20.926 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:20.926 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:20.927 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:20.941 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:33:20.996 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:20.993+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:21.097 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:21.096+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:21.103 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:21.104 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:21.104 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:21.104 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:21.104 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:21.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:33:21.198 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:21.197+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:21.295 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:21.295 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:21.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:21.295 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.590521169, 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.296 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:33:21.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.300 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.301 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.590473785, 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:33:21.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.590429113, 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.306 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:21.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:33:21.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.59038377100001, 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:33:21.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:33:21.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.315 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.590314761, 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:33:21.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:33:21.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.590266324, 2024-09-05T17:33:21.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:33:21.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.59021996600001, 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.329 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.58955737599999, 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:33:21.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:33:21.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.58946603000001, 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.334 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:33:21.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.58940455000001, 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.339 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:33:21.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:21.343 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.58934765000001, 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:33:21.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.58925440900001, 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:21.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.589194881, 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:33:21.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:33:21.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.58203891900001, 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.357 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:33:21.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.58197745199999, 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.362 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:33:21.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.580109483, 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:33:21.366 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:33:21.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:33:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:33:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.58006897300001, 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.371 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:33:21.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.580030507, 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.376 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:33:21.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.5799724, 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.381 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:21.385 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.579915099, 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:33:21.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.390 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.390 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.390 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:21.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:33:21.392 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:21.389+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:21.492 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:21.488+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:21.519 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:21.520 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:21.534 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:33:21.621 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:21.620+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:21.653 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is set 2024-09-05T17:33:21.711 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:21.711 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:21.711 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:21.711 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:21.712 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:21.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:33:21.734 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:21.733+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:21.817 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:21.816+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:21.895 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:21.892+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:21.897 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:21.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439700200000004, 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.898 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:33:21.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:33:21.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:21.902 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439651917999996, 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:21.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:21.906 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439605557999997, 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:21.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.910 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439556956999994, 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:33:21.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:33:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:21.915 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439501358000001, 2024-09-05T17:33:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:33:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.916 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:33:21.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:33:21.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:21.920 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439456113999995, 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.924 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439411614999997, 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.925 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:21.929 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439367657999995, 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:33:21.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:33:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439322321000006, 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:33:21.934 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:33:21.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.938 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439275871999996, 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.942 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439232309999994, 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:33:21.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439186934999995, 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:33:21.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:33:21.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439137823999999, 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:33:21.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:33:21.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439098889999997, 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.955 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:21.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:33:21.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.959 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.439029227999995, 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:33:21.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.438976676999999, 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.964 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:33:21.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.438831121000007, 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:33:21.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:21.972 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.438779539999999, 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:33:21.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.206757168999999, 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:33:21.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.982 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:116533 3.7 3:e6924f8b:::rbd_data.11402f0626d4.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.624503468999997, 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.069225986000000003, 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116533 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272329+0000", 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-05T17:33:21.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272340+0000", 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.172e-05 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272372+0000", 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1192000000000002e-05 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272387+0000", 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5339999999999999e-05 2024-09-05T17:33:21.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272494+0000", 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650300000000001 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272629+0000", 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135845 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.286878+0000", 2024-09-05T17:33:21.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014248241 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341353+0000", 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054475896000000003 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341387+0000", 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3043000000000002e-05 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:21.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341475+0000", 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8103000000000007e-05 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341552+0000", 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7539000000000004e-05 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:21.988 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:21.990 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:33:22.033 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:22.032+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:22.097 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:22.097+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:22.158 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:22.159 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:22.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:33:22.199 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:22.197+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:22.299 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:22.299 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:22.299 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:22.299 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:22.297+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:22.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:33:22.400 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:22.396+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:22.437 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:22.437 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:22.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:22.437 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 175.420729612, 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:33:22.438 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:33:22.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:33:22.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:22.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.444 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053738249000006, 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:33:22.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:33:22.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053687332999999, 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.449 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:33:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053637487000003, 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:33:22.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053592179000006, 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.458 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:33:22.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:33:22.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053544162999998, 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.463 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:33:22.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:22.467 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053471031000001, 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053422005000002, 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:33:22.472 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:33:22.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053336987999998, 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.483 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053281265999999, 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:33:22.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053218408000006, 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:22.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.492 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.053071834999997, 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:33:22.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:33:22.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.046168604000002, 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:33:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.046146809999996, 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:33:22.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:33:22.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.046103346999999, 2024-09-05T17:33:22.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.510 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.046066675999995, 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.511 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:33:22.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:33:22.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:22.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.046026369000003, 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:22.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:33:22.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:33:22.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.045987663000005, 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:33:22.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:33:22.524 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.265981416000002, 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:33:22.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:33:22.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.894650839999997, 2024-09-05T17:33:22.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:22.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:22.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:33:22.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:33:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:22.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:22.538 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:22.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:33:22.543 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:22.540+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:22.640 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:22.636+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:22.678 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:22.678 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:22.678 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:22.678 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:22.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:33:22.785 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:22.784+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:22.842 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:22.840+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:22.860 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:22.860 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:22.860 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:22.860 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:22.861 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:22.876 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:33:22.926 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-05T17:33:22.974 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:22.973+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:23.044 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:23.041+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:23.044 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:129438 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e140)", 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.502839570999999, 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.98318761499999996, 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.045 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129438 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539389+0000", 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0429999999999999e-06 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539399+0000", 2024-09-05T17:33:23.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0547000000000001e-05 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539421+0000", 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1710000000000001e-05 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539435+0000", 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4303e-05 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539565+0000", 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012969500000000001 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539581+0000", 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6347000000000001e-05 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522237+0000", 2024-09-05T17:33:23.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.98265522000000005 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522377+0000", 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014015800000000001 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522573+0000", 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019659199999999999 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:129524 3.5 3:a0879031:::rbd_data.11403d751225.0000000000000020:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e141)", 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.413188368, 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056654990000000001, 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129524 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629038+0000", 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8899999999999998e-07 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629042+0000", 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1860000000000002e-06 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629053+0000", 2024-09-05T17:33:23.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1384e-05 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629061+0000", 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1100000000000003e-06 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629194+0000", 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132426 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629418+0000", 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000223785 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629752+0000", 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033392399999999998 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.632437+0000", 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026852059999999999 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634456+0000", 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020188010000000002 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634552+0000", 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6892999999999995e-05 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634702+0000", 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014999499999999999 2024-09-05T17:33:23.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130217 3.16 3:6bfb19a8:::rbd_header.1140fc6eb649:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.525883519000001, 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013482456, 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130217 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516345+0000", 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.32e-06 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516360+0000", 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5330000000000001e-05 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516394+0000", 2024-09-05T17:33:23.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3933999999999997e-05 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516418+0000", 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3583000000000001e-05 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516574+0000", 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015629500000000001 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:23.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516591+0000", 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6725999999999999e-05 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.519517+0000", 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029258800000000001 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.519825+0000", 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030783399999999999 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.520826+0000", 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010011449999999999 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.524513+0000", 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036871730000000002 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529525+0000", 2024-09-05T17:33:23.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050120119999999997 2024-09-05T17:33:23.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529695+0000", 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017012200000000001 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529824+0000", 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129102 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.064 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4088 3.2 e145/137 3:4665a0fd:::rbd_data.1140fc6eb649.0000000000000055:15 v 145'1619, mlcod=144'1615)", 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.501972262000001, 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049534389999999996, 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540254+0000", 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8599999999999997e-07 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540263+0000", 2024-09-05T17:33:23.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4399999999999994e-06 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540290+0000", 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6395999999999999e-05 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540308+0000", 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8593e-05 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540457+0000", 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014878299999999999 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540512+0000", 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5179000000000001e-05 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.545080+0000", 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045677790000000001 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.545207+0000", 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012648299999999999 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.7.0:2990 3.d e145/140 3:b6f6ae42:::rbd_data.1140fc6eb649.0000000000000000:15 v 145'432, mlcod=141'428)", 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.543677+0000", 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.498548207000001, 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048836690000000002, 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.069 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543677+0000", 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543677+0000", 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543679+0000", 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2359999999999999e-06 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543695+0000", 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.575e-05 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543725+0000", 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.025e-05 2024-09-05T17:33:23.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543745+0000", 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9740000000000001e-05 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.544217+0000", 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00047154899999999998 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.544280+0000", 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3007000000000002e-05 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548439+0000", 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041593849999999998 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548561+0000", 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121752 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.073 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130221 3.16 3:6bfb19a8:::rbd_header.1140fc6eb649:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.494026012000001, 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060020940000000004, 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130221 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548204+0000", 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4739999999999999e-06 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548220+0000", 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5705999999999998e-05 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548254+0000", 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4977000000000001e-05 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548286+0000", 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1242999999999999e-05 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548488+0000", 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020197800000000001 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.549218+0000", 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00073061399999999998 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.550828+0000", 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001609856 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.552067+0000", 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001238474 2024-09-05T17:33:23.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554067+0000", 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020004139999999998 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554143+0000", 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5558999999999999e-05 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554201+0000", 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8798999999999997e-05 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130366 3.5 3:a4c0be76:::rbd_object_map.1140229fee9:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.486835478, 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072600620000000003, 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.080 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130366 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555393+0000", 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2799999999999999e-06 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555405+0000", 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1919000000000001e-05 2024-09-05T17:33:23.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555433+0000", 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7773999999999999e-05 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555447+0000", 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4368e-05 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555524+0000", 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6705999999999994e-05 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555532+0000", 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2940000000000006e-06 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558192+0000", 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026597280000000001 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558420+0000", 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000227591 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558901+0000", 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048115300000000001 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.560866+0000", 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019653600000000002 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562540+0000", 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016743159999999999 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562577+0000", 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7001e-05 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562650+0000", 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2571999999999996e-05 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131006 3.16 3:6f6acd23:::rbd_data.11402b8b869e.0000000000000008:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:23.087 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.315276181, 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070549289999999997, 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131006 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726952+0000", 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.853e-06 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726965+0000", 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2737e-05 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727008+0000", 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2886000000000002e-05 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727029+0000", 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1480000000000001e-05 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727201+0000", 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017164200000000001 2024-09-05T17:33:23.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727745+0000", 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00054416600000000001 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728037+0000", 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029177400000000002 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731099+0000", 2024-09-05T17:33:23.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0030619879999999999 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733668+0000", 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002569385 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733822+0000", 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153523 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734004+0000", 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018249499999999999 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131007 3.c 3:32ac2821:::rbd_data.11402b8b869e.0000000000000009:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.315148796000001, 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059404119999999999, 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.096 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131007 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727078+0000", 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4270000000000001e-06 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727086+0000", 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0169999999999996e-06 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727104+0000", 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7776000000000001e-05 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727113+0000", 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5000000000000005e-06 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727236+0000", 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012313600000000001 2024-09-05T17:33:23.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727891+0000", 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065465800000000002 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728184+0000", 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029244699999999999 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731630+0000", 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003446466 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732672+0000", 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010421880000000001 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732869+0000", 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019643199999999999 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733017+0000", 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014836499999999999 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131010 3.1c 3:3d4252e9:::rbd_data.11402b8b869e.000000000000000f:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.315084686000001, 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049975590000000004, 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.102 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131010 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727142+0000", 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7740000000000001e-06 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727148+0000", 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7729999999999996e-06 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727166+0000", 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7603000000000001e-05 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727180+0000", 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4167e-05 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727296+0000", 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115679 2024-09-05T17:33:23.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727729+0000", 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043355599999999998 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728022+0000", 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029243800000000001 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731527+0000", 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035051679999999999 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731849+0000", 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032256299999999999 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731995+0000", 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014588599999999999 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732138+0000", 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014295200000000001 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:131012 3.2 e149/137 3:423a830c:::rbd_data.11402b8b869e.0000000000000011:head v 149'1622, mlcod=145'1619)", 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.313178128000001, 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0052660930000000003, 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729049+0000", 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7829999999999999e-06 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729064+0000", 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5492999999999999e-05 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729091+0000", 2024-09-05T17:33:23.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6826999999999999e-05 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729109+0000", 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8082999999999999e-05 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.730562+0000", 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014521650000000001 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.730633+0000", 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1371999999999994e-05 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734166+0000", 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035330409999999998 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734313+0000", 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000147329 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131016 3.5 3:a6d456f3:::rbd_data.11402b8b869e.0000000000000015:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.733023+0000", 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.309202283999999, 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049341749999999998, 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131016 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733023+0000", 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733023+0000", 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733026+0000", 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6070000000000002e-06 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733038+0000", 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2009e-05 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733066+0000", 2024-09-05T17:33:23.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8177000000000001e-05 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733085+0000", 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9536000000000001e-05 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733765+0000", 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067965199999999999 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734167+0000", 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000402426 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734432+0000", 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026467100000000001 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736123+0000", 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016910930000000001 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737795+0000", 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001671896 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737891+0000", 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5692000000000005e-05 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737957+0000", 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6415999999999996e-05 2024-09-05T17:33:23.118 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131021 3.1d 3:b8e5f2b9:::rbd_data.11402b8b869e.0000000000000028:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.307170777, 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055499939999999999, 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131021 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:23.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735057+0000", 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.48e-06 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735070+0000", 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2649999999999999e-05 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735096+0000", 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6169e-05 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735115+0000", 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9510000000000001e-05 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735264+0000", 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014859199999999999 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735773+0000", 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00050910899999999999 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736061+0000", 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028768400000000002 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.738111+0000", 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020503560000000001 2024-09-05T17:33:23.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740357+0000", 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022460420000000002 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740501+0000", 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014409199999999999 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740605+0000", 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010331 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131023 3.16 3:6b038a76:::rbd_data.11402b8b869e.0000000000000034:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 11.306011261, 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051919840000000002, 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.125 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131023 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736217+0000", 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-06 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736251+0000", 2024-09-05T17:33:23.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4196999999999998e-05 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736280+0000", 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9162999999999998e-05 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736301+0000", 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0605999999999999e-05 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736455+0000", 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015467599999999999 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736893+0000", 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043734900000000002 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737198+0000", 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030568099999999998 2024-09-05T17:33:23.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.738708+0000", 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001510017 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741137+0000", 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024285940000000001 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741291+0000", 2024-09-05T17:33:23.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154382 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741406+0000", 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114669 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.0.0:2446 3.1f e150/140 3:faf48eea:::rbd_data.1140f0d7121a.000000000000000a:10 v 150'398, mlcod=145'394)", 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.509224798, 2024-09-05T17:33:23.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0067976139999999996, 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:23.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0699999999999996e-07 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533011+0000", 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8900000000000002e-06 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533043+0000", 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2087e-05 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533063+0000", 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9822000000000001e-05 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533208+0000", 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014464600000000001 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533272+0000", 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4103000000000006e-05 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.539697+0000", 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064246700000000004 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.539798+0000", 2024-09-05T17:33:23.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101489 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131225 3.16 3:69c6feb6:::rbd_object_map.114076cffc4f:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.4453823710000009, 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069276930000000004, 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131225 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:23.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596845+0000", 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1579999999999999e-06 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596854+0000", 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5520000000000005e-06 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596873+0000", 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9584000000000001e-05 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596882+0000", 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1970000000000002e-06 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596983+0000", 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100389 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596993+0000", 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7399999999999999e-06 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.598936+0000", 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00194378 2024-09-05T17:33:23.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.599183+0000", 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024666100000000002 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.599622+0000", 2024-09-05T17:33:23.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043905000000000002 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.601834+0000", 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022117149999999999 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603493+0000", 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001659305 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603574+0000", 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0655000000000006e-05 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603771+0000", 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019690699999999999 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:131791 3.2 e154/137 3:419d56ee:::rbd_data.11409622ac7f.0000000000000012:head v 154'1630, mlcod=154'1628)", 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.257322179, 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050827069999999997, 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784904+0000", 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1069999999999999e-06 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784917+0000", 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3181e-05 2024-09-05T17:33:23.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784934+0000", 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784944+0000", 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9699999999999994e-06 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.785012+0000", 2024-09-05T17:33:23.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8520000000000001e-05 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.785037+0000", 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4592000000000001e-05 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.789909+0000", 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048723250000000003 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.789986+0000", 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699000000000005e-05 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4178 3.2 e155/137 3:4482663b:::rbd_data.11404462ede9.0000000000000014:b v 155'1632, mlcod=154'1629)", 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.5074613899999996, 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082424190000000008, 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.148 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1100000000000001e-07 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534770+0000", 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3839999999999996e-06 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534784+0000", 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4222e-05 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534794+0000", 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.747e-06 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534890+0000", 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6504999999999998e-05 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534916+0000", 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5290999999999999e-05 2024-09-05T17:33:23.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.542959+0000", 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080430780000000004 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.543006+0000", 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7781000000000002e-05 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4179 3.2 e155/137 3:46161760:::rbd_data.11404462ede9.000000000000000f:b v 155'1634, mlcod=154'1629)", 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.5064582, 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086053929999999994, 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:23.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535768+0000", 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535775+0000", 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2180000000000002e-06 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535790+0000", 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4747e-05 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535799+0000", 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2189999999999993e-06 2024-09-05T17:33:23.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.538573+0000", 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027734000000000001 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.538648+0000", 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4895999999999996e-05 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.544249+0000", 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056014649999999999 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.544373+0000", 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012346500000000001 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:132362 3.16 3:6d63474f:::rbd_object_map.11403aa71fdc:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:23.157 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.48718221099999998, 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063657380000000001, 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 132362 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555047+0000", 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.433e-06 2024-09-05T17:33:23.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555062+0000", 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302999999999999e-05 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555096+0000", 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3717000000000003e-05 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555118+0000", 2024-09-05T17:33:23.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2626e-05 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555302+0000", 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183322 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555541+0000", 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000239881 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:23.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.556037+0000", 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00049596000000000004 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.557808+0000", 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017707790000000001 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561115+0000", 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033072919999999999 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561286+0000", 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017058199999999999 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561409+0000", 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122843 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:23.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:23.164 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:23.164 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:23.165 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:23.165 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:23.166 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:23.166 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:33:23.167 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:23.167 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:23.167 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:23.168 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:23.168 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:23.161+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:23.266 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:23.264+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:23.296 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:23.296 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:23.311 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:33:23.364 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:23.364 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:23.367 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:23.364+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:23.386 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:23.386 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:23.413 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:23.414 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:23.439 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:23.439 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:23.441 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:23.441 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:23.455 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:33:23.468 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:23.464+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:23.568 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:23.565+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:23.573 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:23.573 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:23.588 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:33:23.670 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:23.668+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:23.691 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:33:23.771 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:23.769+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:23.772 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:23.772 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:23.790 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:33:23.860 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7, 0] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-09-05T17:33:23.861 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-05T17:33:23.861 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-05T17:33:23.861 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-09-05T17:33:23.862 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-05T17:33:23.878 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:23.877+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:23.953 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:23.953 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:23.969 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:33:23.972 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:23.968+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:24.073 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:24.069+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:24.090 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:24.090 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:24.105 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:33:24.173 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:24.172+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:24.269 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:24.269 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:24.274 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:24.272+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:24.283 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:33:24.374 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:24.372+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:24.407 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:24.407 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:24.420 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:33:24.475 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:24.472+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:24.535 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:24.535 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:24.549 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:33:24.576 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:24.572+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:24.673 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:33:24.673 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-05T17:33:24.677 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:24.676+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:24.682 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:24.682 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:24.705 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:33:24.778 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:24.776+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:24.822 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:24.822 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:24.838 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:33:24.879 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:24.876+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:24.955 INFO:teuthology.orchestra.run.smithi050.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:24.955 INFO:teuthology.orchestra.run.smithi050.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:24.970 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:33:25.017 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:25.016+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:25.082 INFO:tasks.ceph.osd.2.smithi050.stderr:2024-09-05T17:33:25.081+0000 7f2ccc9f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26316) UID: 0 2024-09-05T17:33:25.103 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:25.104 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:25.118 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:33:25.205 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:25.204+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:25.278 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:25.279 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:25.284 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:25.280+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:25.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:33:25.385 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:25.384+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:25.458 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:25.459 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:25.464 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-05T17:33:25.473 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:33:25.510 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:25.509+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:25.586 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:25.584+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:25.622 INFO:teuthology.orchestra.run.smithi050.stdout:osd.0: {} 2024-09-05T17:33:25.622 INFO:teuthology.orchestra.run.smithi050.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-05T17:33:25.639 INFO:teuthology.orchestra.run.smithi050.stdout:osd.1: {} 2024-09-05T17:33:25.639 INFO:teuthology.orchestra.run.smithi050.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-05T17:33:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:25.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:33:25.655 INFO:teuthology.orchestra.run.smithi050.stdout:osd.2: {} 2024-09-05T17:33:25.656 INFO:teuthology.orchestra.run.smithi050.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-05T17:33:25.687 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:25.685+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:25.788 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:25.784+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:25.819 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-05T17:33:25.820 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-05T17:33:25.835 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:33:25.879 INFO:teuthology.orchestra.run.smithi050.stdout:osd.3: {} 2024-09-05T17:33:25.880 INFO:teuthology.orchestra.run.smithi050.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-05T17:33:25.889 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:25.885+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:25.900 INFO:teuthology.orchestra.run.smithi050.stdout:osd.4: {} 2024-09-05T17:33:25.900 INFO:teuthology.orchestra.run.smithi050.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-05T17:33:25.920 INFO:teuthology.orchestra.run.smithi050.stdout:osd.5: {} 2024-09-05T17:33:25.920 INFO:teuthology.orchestra.run.smithi050.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-05T17:33:25.939 INFO:teuthology.orchestra.run.smithi050.stdout:osd.6: {} 2024-09-05T17:33:25.939 INFO:teuthology.orchestra.run.smithi050.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-05T17:33:25.959 INFO:teuthology.orchestra.run.smithi050.stdout:osd.7: {} 2024-09-05T17:33:25.959 INFO:teuthology.orchestra.run.smithi050.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-05T17:33:25.990 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:25.988+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547633980000001, 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.006 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:33:26.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547585698000006, 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.011 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:33:26.014 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547539338000007, 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:33:26.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:33:26.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547490737000004, 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:33:26.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547435137999997, 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:33:26.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.027 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547389894000005, 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:33:26.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:33:26.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547345394999994, 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.032 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:33:26.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547301438000005, 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.036 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:33:26.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547256101000002, 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.040 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547209652000006, 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:33:26.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547166090000005, 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:33:26.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547120715000005, 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:33:26.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547071603999996, 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:33:26.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:33:26.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:33:26.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.547032669999993, 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.061 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:33:26.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.546963008000006, 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.065 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.546910456999996, 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:33:26.069 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:33:26.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:33:26.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.546764901000003, 2024-09-05T17:33:26.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:26.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.077 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.546713319999995, 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:33:26.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.314690948999996, 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.082 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:33:26.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:33:26.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:33:26.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:116533 3.7 3:e6924f8b:::rbd_data.11402f0626d4.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.732437249, 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.069225986000000003, 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116533 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.088 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272329+0000", 2024-09-05T17:33:26.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272340+0000", 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.172e-05 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272372+0000", 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1192000000000002e-05 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272387+0000", 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5339999999999999e-05 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272494+0000", 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650300000000001 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272629+0000", 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135845 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.286878+0000", 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014248241 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341353+0000", 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054475896000000003 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341387+0000", 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3043000000000002e-05 2024-09-05T17:33:26.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341475+0000", 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8103000000000007e-05 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341552+0000", 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7539000000000004e-05 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.093 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.094 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.094 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:26.095 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:33:26.095 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:26.093+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:26.196 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:26.193+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:26.262 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:26.263 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:26.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:33:26.321 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:26.320+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:26.395 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:26.395 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:26.395 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:26.397 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-05T17:33:26.396+0000 7f4aa9644640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26471) UID: 0 2024-09-05T17:33:26.409 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:33:26.498 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:26.496+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:26.581 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:26.581 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:26.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:26.581 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:26.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.581 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 179.56278309199999, 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.582 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:33:26.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:26.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:33:26.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:33:26.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:33:26.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:33:26.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:33:26.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195791729000007, 2024-09-05T17:33:26.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:26.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:33:26.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:33:26.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195740813, 2024-09-05T17:33:26.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:33:26.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:26.600 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195690967000004, 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:33:26.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195645658999993, 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:33:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195597642999999, 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.610 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:33:26.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:26.614 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195524511000002, 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:33:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195475485000003, 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:26.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:33:26.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195390467999999, 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.625 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:33:26.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195334746, 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.631 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:33:26.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.631 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:26.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:33:26.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195271887999994, 2024-09-05T17:33:26.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:26.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:33:26.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:33:26.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:26.640 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.195125314999999, 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:33:26.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.188222084000003, 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.645 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:26.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:33:26.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.188200289999997, 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.650 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:33:26.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:33:26.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.188156827, 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.655 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:26.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:33:26.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.188120155999997, 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.660 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:33:26.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.188079849000005, 2024-09-05T17:33:26.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:26.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:33:26.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.188041143000007, 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.669 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:26.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.408034896000004, 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:33:26.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.036704319999998, 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:26.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:33:26.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:33:26.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:26.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:26.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:33:26.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:33:26.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.686 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:26.686 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:26.686 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:26.688 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:33:26.688 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-05T17:33:26.684+0000 7fc123e18640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26464) UID: 0 2024-09-05T17:33:26.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:33:26.788 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:26.785+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:26.833 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:26.834 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:26.849 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:33:26.889 INFO:tasks.ceph.osd.3.smithi050.stderr:2024-09-05T17:33:26.889+0000 7efd57f6e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26318) UID: 0 2024-09-05T17:33:26.972 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:26.972 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:26.972 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:26.973 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:26.973 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:26.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:33:27.033 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-05T17:33:27.032+0000 7fe5e3fd5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33387) UID: 0 2024-09-05T17:33:27.092 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:27.089+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:129438 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e140)", 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.571290532999999, 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.98318761499999996, 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129438 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539389+0000", 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0429999999999999e-06 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539399+0000", 2024-09-05T17:33:27.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0547000000000001e-05 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539421+0000", 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1710000000000001e-05 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539435+0000", 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4303e-05 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539565+0000", 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012969500000000001 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539581+0000", 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6347000000000001e-05 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522237+0000", 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.98265522000000005 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522377+0000", 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014015800000000001 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522573+0000", 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019659199999999999 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:129524 3.5 3:a0879031:::rbd_data.11403d751225.0000000000000020:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e141)", 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.48163933, 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056654990000000001, 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129524 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629038+0000", 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8899999999999998e-07 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629042+0000", 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1860000000000002e-06 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629053+0000", 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1384e-05 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629061+0000", 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1100000000000003e-06 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629194+0000", 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132426 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629418+0000", 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000223785 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629752+0000", 2024-09-05T17:33:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033392399999999998 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.632437+0000", 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026852059999999999 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634456+0000", 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020188010000000002 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634552+0000", 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6892999999999995e-05 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634702+0000", 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014999499999999999 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130217 3.16 3:6bfb19a8:::rbd_header.1140fc6eb649:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.594334481000001, 2024-09-05T17:33:27.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013482456, 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130217 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516345+0000", 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.32e-06 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516360+0000", 2024-09-05T17:33:27.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5330000000000001e-05 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516394+0000", 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3933999999999997e-05 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516418+0000", 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3583000000000001e-05 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516574+0000", 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015629500000000001 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516591+0000", 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6725999999999999e-05 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.519517+0000", 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029258800000000001 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.519825+0000", 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030783399999999999 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.520826+0000", 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010011449999999999 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.524513+0000", 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036871730000000002 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529525+0000", 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050120119999999997 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529695+0000", 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017012200000000001 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529824+0000", 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129102 2024-09-05T17:33:27.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4088 3.2 e145/137 3:4665a0fd:::rbd_data.1140fc6eb649.0000000000000055:15 v 145'1619, mlcod=144'1615)", 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.570423223999999, 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049534389999999996, 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540254+0000", 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8599999999999997e-07 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540263+0000", 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4399999999999994e-06 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540290+0000", 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6395999999999999e-05 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540308+0000", 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8593e-05 2024-09-05T17:33:27.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540457+0000", 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014878299999999999 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540512+0000", 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5179000000000001e-05 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.545080+0000", 2024-09-05T17:33:27.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045677790000000001 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.545207+0000", 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012648299999999999 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.7.0:2990 3.d e145/140 3:b6f6ae42:::rbd_data.1140fc6eb649.0000000000000000:15 v 145'432, mlcod=141'428)", 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.543677+0000", 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.566999168999999, 2024-09-05T17:33:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048836690000000002, 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543677+0000", 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543677+0000", 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543679+0000", 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2359999999999999e-06 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543695+0000", 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.575e-05 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543725+0000", 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.025e-05 2024-09-05T17:33:27.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.543745+0000", 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9740000000000001e-05 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.544217+0000", 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00047154899999999998 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.544280+0000", 2024-09-05T17:33:27.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3007000000000002e-05 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548439+0000", 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041593849999999998 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548561+0000", 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121752 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130221 3.16 3:6bfb19a8:::rbd_header.1140fc6eb649:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.562476973999999, 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060020940000000004, 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130221 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.138 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548204+0000", 2024-09-05T17:33:27.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4739999999999999e-06 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548220+0000", 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5705999999999998e-05 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548254+0000", 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4977000000000001e-05 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548286+0000", 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1242999999999999e-05 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548488+0000", 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020197800000000001 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.549218+0000", 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00073061399999999998 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.550828+0000", 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001609856 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.552067+0000", 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001238474 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554067+0000", 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020004139999999998 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554143+0000", 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5558999999999999e-05 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554201+0000", 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8798999999999997e-05 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130366 3.5 3:a4c0be76:::rbd_object_map.1140229fee9:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.55528644, 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072600620000000003, 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130366 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555393+0000", 2024-09-05T17:33:27.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2799999999999999e-06 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555405+0000", 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1919000000000001e-05 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555433+0000", 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7773999999999999e-05 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555447+0000", 2024-09-05T17:33:27.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4368e-05 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555524+0000", 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6705999999999994e-05 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555532+0000", 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2940000000000006e-06 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558192+0000", 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026597280000000001 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558420+0000", 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000227591 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558901+0000", 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048115300000000001 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.560866+0000", 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019653600000000002 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562540+0000", 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016743159999999999 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562577+0000", 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7001e-05 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562650+0000", 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2571999999999996e-05 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131006 3.16 3:6f6acd23:::rbd_data.11402b8b869e.0000000000000008:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.383727143, 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070549289999999997, 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.150 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131006 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726952+0000", 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.853e-06 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726965+0000", 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2737e-05 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727008+0000", 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2886000000000002e-05 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727029+0000", 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1480000000000001e-05 2024-09-05T17:33:27.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727201+0000", 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017164200000000001 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727745+0000", 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00054416600000000001 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728037+0000", 2024-09-05T17:33:27.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029177400000000002 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731099+0000", 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0030619879999999999 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733668+0000", 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002569385 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733822+0000", 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153523 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734004+0000", 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018249499999999999 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131007 3.c 3:32ac2821:::rbd_data.11402b8b869e.0000000000000009:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:27.156 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.383599758000001, 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059404119999999999, 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131007 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727078+0000", 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4270000000000001e-06 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727086+0000", 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0169999999999996e-06 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727104+0000", 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7776000000000001e-05 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727113+0000", 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5000000000000005e-06 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727236+0000", 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012313600000000001 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727891+0000", 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065465800000000002 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728184+0000", 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029244699999999999 2024-09-05T17:33:27.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731630+0000", 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003446466 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732672+0000", 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010421880000000001 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732869+0000", 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019643199999999999 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733017+0000", 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014836499999999999 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131010 3.1c 3:3d4252e9:::rbd_data.11402b8b869e.000000000000000f:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:27.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.383535648000001, 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049975590000000004, 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131010 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727142+0000", 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7740000000000001e-06 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727148+0000", 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7729999999999996e-06 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727166+0000", 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7603000000000001e-05 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727180+0000", 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4167e-05 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727296+0000", 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115679 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727729+0000", 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043355599999999998 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728022+0000", 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029243800000000001 2024-09-05T17:33:27.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731527+0000", 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035051679999999999 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731849+0000", 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032256299999999999 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731995+0000", 2024-09-05T17:33:27.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014588599999999999 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732138+0000", 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014295200000000001 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:131012 3.2 e149/137 3:423a830c:::rbd_data.11402b8b869e.0000000000000011:head v 149'1622, mlcod=145'1619)", 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.381629090000001, 2024-09-05T17:33:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0052660930000000003, 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729049+0000", 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7829999999999999e-06 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729064+0000", 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5492999999999999e-05 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729091+0000", 2024-09-05T17:33:27.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6826999999999999e-05 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729109+0000", 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8082999999999999e-05 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.730562+0000", 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014521650000000001 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.730633+0000", 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1371999999999994e-05 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734166+0000", 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035330409999999998 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734313+0000", 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000147329 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131016 3.5 3:a6d456f3:::rbd_data.11402b8b869e.0000000000000015:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.733023+0000", 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.377653245999999, 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049341749999999998, 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131016 2024-09-05T17:33:27.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733023+0000", 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733023+0000", 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733026+0000", 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6070000000000002e-06 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733038+0000", 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2009e-05 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733066+0000", 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8177000000000001e-05 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733085+0000", 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9536000000000001e-05 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733765+0000", 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00067965199999999999 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734167+0000", 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000402426 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734432+0000", 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026467100000000001 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736123+0000", 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016910930000000001 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737795+0000", 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001671896 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737891+0000", 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5692000000000005e-05 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737957+0000", 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6415999999999996e-05 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131021 3.1d 3:b8e5f2b9:::rbd_data.11402b8b869e.0000000000000028:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.375621739, 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055499939999999999, 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131021 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735057+0000", 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.48e-06 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735070+0000", 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2649999999999999e-05 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735096+0000", 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6169e-05 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735115+0000", 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9510000000000001e-05 2024-09-05T17:33:27.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735264+0000", 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014859199999999999 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735773+0000", 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00050910899999999999 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736061+0000", 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028768400000000002 2024-09-05T17:33:27.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.738111+0000", 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020503560000000001 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740357+0000", 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022460420000000002 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740501+0000", 2024-09-05T17:33:27.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014409199999999999 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740605+0000", 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010331 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131023 3.16 3:6b038a76:::rbd_data.11402b8b869e.0000000000000034:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.374462223, 2024-09-05T17:33:27.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051919840000000002, 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131023 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736217+0000", 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-06 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736251+0000", 2024-09-05T17:33:27.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4196999999999998e-05 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736280+0000", 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9162999999999998e-05 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736301+0000", 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0605999999999999e-05 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736455+0000", 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015467599999999999 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736893+0000", 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043734900000000002 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737198+0000", 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030568099999999998 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.738708+0000", 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001510017 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741137+0000", 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024285940000000001 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741291+0000", 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154382 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741406+0000", 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114669 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.0.0:2446 3.1f e150/140 3:faf48eea:::rbd_data.1140f0d7121a.000000000000000a:10 v 150'398, mlcod=145'394)", 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.57767576, 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0067976139999999996, 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0699999999999996e-07 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533011+0000", 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8900000000000002e-06 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533043+0000", 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2087e-05 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533063+0000", 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9822000000000001e-05 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533208+0000", 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014464600000000001 2024-09-05T17:33:27.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533272+0000", 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4103000000000006e-05 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.539697+0000", 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064246700000000004 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.539798+0000", 2024-09-05T17:33:27.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101489 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131225 3.16 3:69c6feb6:::rbd_object_map.114076cffc4f:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.513833333000001, 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069276930000000004, 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131225 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596845+0000", 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1579999999999999e-06 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596854+0000", 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5520000000000005e-06 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596873+0000", 2024-09-05T17:33:27.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9584000000000001e-05 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596882+0000", 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1970000000000002e-06 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596983+0000", 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100389 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:27.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596993+0000", 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7399999999999999e-06 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.598936+0000", 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00194378 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.599183+0000", 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024666100000000002 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.599622+0000", 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043905000000000002 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.601834+0000", 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022117149999999999 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603493+0000", 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001659305 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603574+0000", 2024-09-05T17:33:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0655000000000006e-05 2024-09-05T17:33:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603771+0000", 2024-09-05T17:33:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019690699999999999 2024-09-05T17:33:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:131791 3.2 e154/137 3:419d56ee:::rbd_data.11409622ac7f.0000000000000012:head v 154'1630, mlcod=154'1628)", 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.325773140999999, 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050827069999999997, 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784904+0000", 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1069999999999999e-06 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784917+0000", 2024-09-05T17:33:27.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3181e-05 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784934+0000", 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784944+0000", 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9699999999999994e-06 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.785012+0000", 2024-09-05T17:33:27.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8520000000000001e-05 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.785037+0000", 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4592000000000001e-05 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.789909+0000", 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048723250000000003 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.789986+0000", 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699000000000005e-05 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4178 3.2 e155/137 3:4482663b:::rbd_data.11404462ede9.0000000000000014:b v 155'1632, mlcod=154'1629)", 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.5759123519999996, 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082424190000000008, 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.209 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:27.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1100000000000001e-07 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534770+0000", 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3839999999999996e-06 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534784+0000", 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4222e-05 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534794+0000", 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.747e-06 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534890+0000", 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6504999999999998e-05 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534916+0000", 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5290999999999999e-05 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.542959+0000", 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080430780000000004 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.543006+0000", 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7781000000000002e-05 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4179 3.2 e155/137 3:46161760:::rbd_data.11404462ede9.000000000000000f:b v 155'1634, mlcod=154'1629)", 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.5749091620000009, 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086053929999999994, 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535768+0000", 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535775+0000", 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2180000000000002e-06 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535790+0000", 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4747e-05 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535799+0000", 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2189999999999993e-06 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.538573+0000", 2024-09-05T17:33:27.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027734000000000001 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.538648+0000", 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4895999999999996e-05 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.544249+0000", 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056014649999999999 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.544373+0000", 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012346500000000001 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:132362 3.16 3:6d63474f:::rbd_object_map.11403aa71fdc:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.5556331730000004, 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063657380000000001, 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 132362 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:27.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555047+0000", 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.433e-06 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555062+0000", 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302999999999999e-05 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:27.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555096+0000", 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3717000000000003e-05 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555118+0000", 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2626e-05 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555302+0000", 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183322 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555541+0000", 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000239881 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.556037+0000", 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00049596000000000004 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.557808+0000", 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017707790000000001 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561115+0000", 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033072919999999999 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561286+0000", 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017058199999999999 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561409+0000", 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122843 2024-09-05T17:33:27.223 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:27.224 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:27.225 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:27.224+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:27.226 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-05T17:33:27.326 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:27.324+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:27.361 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:27.361 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:27.361 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:27.361 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:27.375 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-05T17:33:27.427 INFO:tasks.ceph.osd.0.smithi050.stderr:2024-09-05T17:33:27.425+0000 7fef0d0a2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26312) UID: 0 2024-09-05T17:33:27.500 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:27.501 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:27.501 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:27.515 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-05T17:33:27.525 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:33:27.529 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-05T17:33:27.528+0000 7f4f40b79640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26468) UID: 0 2024-09-05T17:33:27.629 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:27.625+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:27.658 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16612 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6623232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.573512483, 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053325130999999998, 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.659 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16612 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.660 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082791+0000", 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082792+0000", 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.4299999999999998e-07 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082794+0000", 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2680000000000001e-06 2024-09-05T17:33:27.661 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082801+0000", 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7100000000000001e-06 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082806+0000", 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9250000000000003e-06 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.135928+0000", 2024-09-05T17:33:27.662 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053121943999999997 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136010+0000", 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2372000000000003e-05 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136116+0000", 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106469 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.663 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16613 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6639616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.57349055700001, 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053565831000000001, 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.664 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16613 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.665 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082813+0000", 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082814+0000", 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0699999999999998e-07 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082816+0000", 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1330000000000002e-06 2024-09-05T17:33:27.666 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082822+0000", 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4919999999999998e-06 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082827+0000", 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7099999999999998e-06 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.667 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136170+0000", 2024-09-05T17:33:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053342998000000003 2024-09-05T17:33:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.668 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136264+0000", 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3919000000000007e-05 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136379+0000", 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115172 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.669 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16614 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6656000~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.57346910999999, 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053833679000000002, 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16614 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.670 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082835+0000", 2024-09-05T17:33:27.671 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3500000000000002e-07 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082837+0000", 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3420000000000002e-06 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082844+0000", 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9070000000000001e-06 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.672 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082860+0000", 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5353e-05 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136431+0000", 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053570756999999997 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136544+0000", 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000113347 2024-09-05T17:33:27.673 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136668+0000", 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012453799999999999 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16615 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6672384~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:33:27.674 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.57343082, 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054073367999999997, 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16615 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.675 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082873+0000", 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8299999999999998e-07 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.676 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082875+0000", 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9089999999999998e-06 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082880+0000", 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.865e-06 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082883+0000", 2024-09-05T17:33:27.677 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9890000000000001e-06 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136727+0000", 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053843776000000003 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136833+0000", 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00010558200000000001 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.678 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136946+0000", 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011386400000000001 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16616 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6688768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.57341600399999, 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054247575999999999, 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.679 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16616 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.680 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082888+0000", 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6199999999999999e-07 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.681 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082889+0000", 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.203e-06 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082893+0000", 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.484e-06 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082895+0000", 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5629999999999999e-06 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.682 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.136995+0000", 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054099678999999998 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137067+0000", 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1576999999999996e-05 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137135+0000", 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8807999999999996e-05 2024-09-05T17:33:27.683 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16617 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6705152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.573404805, 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054484496, 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.684 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16617 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.685 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082899+0000", 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082901+0000", 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.156e-06 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.686 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082904+0000", 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3230000000000002e-06 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082906+0000", 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4830000000000002e-06 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137180+0000", 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054274071 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.687 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137275+0000", 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4178000000000005e-05 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137384+0000", 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000108896 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.688 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16618 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6721536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.573393966, 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054672654000000001, 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16618 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.689 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082910+0000", 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.65e-07 2024-09-05T17:33:27.690 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082911+0000", 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082914+0000", 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.349e-06 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082917+0000", 2024-09-05T17:33:27.691 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.435e-06 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137425+0000", 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054507991999999998 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137507+0000", 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1846000000000002e-05 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.692 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137583+0000", 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5784000000000005e-05 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16619 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6737920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.57338348900001, 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054794303000000003, 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.693 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16619 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.694 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082920+0000", 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082921+0000", 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6100000000000002e-07 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082922+0000", 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3370000000000001e-06 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.695 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082925+0000", 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.3280000000000002e-06 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082928+0000", 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4219999999999999e-06 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137612+0000", 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054684736999999997 2024-09-05T17:33:27.696 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137660+0000", 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7398000000000003e-05 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137715+0000", 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.482e-05 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.697 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16620 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6754304~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.573372667, 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055006341, 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16620 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.698 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082931+0000", 2024-09-05T17:33:27.699 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5899999999999998e-07 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082932+0000", 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0610000000000001e-06 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082936+0000", 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.337e-06 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.700 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082938+0000", 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3750000000000001e-06 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137755+0000", 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054817055000000003 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137839+0000", 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3487999999999998e-05 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.701 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137938+0000", 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8765999999999996e-05 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16621 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6770688~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.57336226699999, 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055121381999999997, 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.702 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16621 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.703 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082942+0000", 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4400000000000001e-07 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082949+0000", 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5959999999999998e-06 2024-09-05T17:33:27.704 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082953+0000", 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9199999999999997e-06 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082956+0000", 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5720000000000001e-06 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.705 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.137966+0000", 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055010353999999997 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138009+0000", 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2589000000000002e-05 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138063+0000", 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4107000000000002e-05 2024-09-05T17:33:27.706 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16622 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6787072~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.57334391500001, 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055332543999999997, 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.707 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16622 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.082960+0000", 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.708 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083105+0000", 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000145079 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083109+0000", 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6119999999999999e-06 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.709 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083118+0000", 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7059999999999999e-06 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083125+0000", 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138101+0000", 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054975753000000002 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.710 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138191+0000", 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0451000000000005e-05 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138292+0000", 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000101289 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.711 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16623 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 6803456~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.57316029099999, 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.055274002000000003, 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16623 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.712 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.083144+0000", 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090558+0000", 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0074146860000000002 2024-09-05T17:33:27.713 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090564+0000", 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1199999999999999e-06 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090578+0000", 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4051e-05 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.714 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.090606+0000", 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7589999999999998e-05 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138321+0000", 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047715036000000002 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138363+0000", 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1526000000000002e-05 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.715 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.138418+0000", 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4993e-05 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16659 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7393280~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.56446045600001, 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053412268999999998, 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.716 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16659 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.717 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091843+0000", 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091844+0000", 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7000000000000005e-07 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091847+0000", 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5660000000000001e-06 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.718 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091853+0000", 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9600000000000003e-06 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091872+0000", 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8819999999999999e-05 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145151+0000", 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053278288 2024-09-05T17:33:27.719 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145198+0000", 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7278999999999999e-05 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145256+0000", 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7785999999999999e-05 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.720 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16660 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7409664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.564420627, 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053624847000000003, 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.721 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16660 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091883+0000", 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.722 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091884+0000", 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0999999999999998e-07 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091887+0000", 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6910000000000002e-06 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091896+0000", 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.0250000000000008e-06 2024-09-05T17:33:27.723 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091902+0000", 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.2500000000000003e-06 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145295+0000", 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053393593000000003 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.724 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145394+0000", 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8345999999999997e-05 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145508+0000", 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114332 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16661 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7426048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:33:27.725 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.56439315200001, 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053730882000000001, 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16661 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.726 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091911+0000", 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.727 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091914+0000", 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3810000000000002e-06 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091923+0000", 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4409999999999999e-06 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091930+0000", 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0559999999999999e-06 2024-09-05T17:33:27.728 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145538+0000", 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053608003000000001 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145584+0000", 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5926e-05 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145642+0000", 2024-09-05T17:33:27.729 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7540999999999997e-05 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16662 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7442432~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.564354643, 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053960634, 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.730 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16662 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.731 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091949+0000", 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091950+0000", 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5499999999999998e-07 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091952+0000", 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.537e-06 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.732 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091968+0000", 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5373e-05 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091974+0000", 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3779999999999998e-06 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145691+0000", 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053716506999999997 2024-09-05T17:33:27.733 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145790+0000", 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9825000000000001e-05 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145910+0000", 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119459 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.734 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:16663 3.1 3:815ec062:::rbd_data.11403f2d9bbd.0000000000000000:6 [read 7458816~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 147.564311903, 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.054167820999999998, 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 16663 2024-09-05T17:33:27.735 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.091992+0000", 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.736 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098594+0000", 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0066024669999999999 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098602+0000", 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.9489999999999996e-06 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098617+0000", 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4294000000000001e-05 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.737 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.098630+0000", 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2938e-05 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.145949+0000", 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.047319013 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146043+0000", 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4481000000000006e-05 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.738 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:00.146160+0000", 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116679 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:54978 3.3 3:c7fc81f1:::rbd_data.1140fc6eb649.0000000000000028:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e61)", 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 110.163033689, 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0470195019999999, 2024-09-05T17:33:27.739 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 54978 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.740 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493270+0000", 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493274+0000", 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8399999999999997e-06 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493287+0000", 2024-09-05T17:33:27.741 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3475999999999999e-05 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493330+0000", 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.2997999999999997e-05 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493357+0000", 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6682e-05 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.742 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493542+0000", 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018439500000000001 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.493555+0000", 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3222e-05 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502525+0000", 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0089705710000000001 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.743 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:37.502582+0000", 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6591000000000001e-05 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.536966+0000", 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.034384236 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537366+0000", 2024-09-05T17:33:27.744 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039995299999999998 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 4,6", 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.537726+0000", 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000359895 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539505+0000", 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017794830000000001 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.745 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539638+0000", 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013215899999999999 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539873+0000", 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023502899999999999 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539989+0000", 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000116443 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.746 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.540290+0000", 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00030052900000000001 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:124216 3.12 3:48c94c2b:::rbd_data.1140e0d69f44.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 51.482452019999997, 2024-09-05T17:33:27.747 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.066132150000000001, 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 124216 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:33:27.748 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173852+0000", 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173855+0000", 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1370000000000002e-06 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.749 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173869+0000", 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4362000000000001e-05 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173905+0000", 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6022000000000002e-05 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.173922+0000", 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6869999999999999e-05 2024-09-05T17:33:27.750 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.174085+0000", 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016325000000000001 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.174317+0000", 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023151500000000001 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:27.751 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.186040+0000", 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.011722784999999999 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239783+0000", 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.053742749999999999 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239815+0000", 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2212000000000003e-05 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.752 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239906+0000", 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1667000000000002e-05 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:36.239984+0000", 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.7579999999999999e-05 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.753 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:127565 3.10 3:0bb8acdd:::rbd_header.114045ce5fbb:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e126)", 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 38.894375854000003, 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2227427259999999, 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 127565 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.754 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761928+0000", 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761933+0000", 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.6700000000000002e-06 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.755 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.761953+0000", 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0472999999999999e-05 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762007+0000", 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4135000000000003e-05 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762037+0000", 2024-09-05T17:33:27.756 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9992999999999999e-05 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762279+0000", 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024152900000000001 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op must wait for map", 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.762304+0000", 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4922999999999998e-05 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.757 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.767683+0000", 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053790729999999998 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.767696+0000", 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2914e-05 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.983967+0000", 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.216271307 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.758 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.984288+0000", 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032119199999999998 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:49.984671+0000", 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00038251700000000002 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:27.759 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:27.761 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-05T17:33:27.761 INFO:teuthology.orchestra.run.smithi050.stdout:All operations completed A-OK! 2024-09-05T17:33:27.762 INFO:tasks.ceph.osd.1.smithi050.stderr:2024-09-05T17:33:27.757+0000 7f7915748640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26314) UID: 0 2024-09-05T17:33:27.782 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:27.782 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-05T17:33:27.794 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-05T17:33:27.804 INFO:tasks.thrashosds:joining thrashosds 2024-09-05T17:33:27.958 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:27.959 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:27.959 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:27.959 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:27.973 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-05T17:33:28.099 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:28.099 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:28.099 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:28.099 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:28.099 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:28.114 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78321 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2947072~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.397032327999995, 2024-09-05T17:33:28.237 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064730883000000003, 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78321 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.238 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837335+0000", 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837336+0000", 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5099999999999998e-07 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.239 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837340+0000", 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4290000000000001e-06 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837363+0000", 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2841999999999999e-05 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.240 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837370+0000", 2024-09-05T17:33:28.241 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5630000000000003e-06 2024-09-05T17:33:28.241 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.241 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.241 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.241 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.901974+0000", 2024-09-05T17:33:28.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064604178999999998 2024-09-05T17:33:28.242 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.242 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.242 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.242 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902013+0000", 2024-09-05T17:33:28.242 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8945000000000001e-05 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902066+0000", 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3074e-05 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78322 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2973696~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.243 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396986869000003, 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064805539999999995, 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.244 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78322 2024-09-05T17:33:28.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.245 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.245 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.245 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:33:28.245 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.245 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.245 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837381+0000", 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837382+0000", 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4799999999999998e-07 2024-09-05T17:33:28.246 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837385+0000", 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.123e-06 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837394+0000", 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.8109999999999992e-06 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837400+0000", 2024-09-05T17:33:28.247 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5830000000000003e-06 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902096+0000", 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064695538999999996 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902133+0000", 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7790000000000002e-05 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.248 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902186+0000", 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3046e-05 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78323 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3000320~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396958682000005, 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064899240999999996, 2024-09-05T17:33:28.249 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78323 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.250 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837409+0000", 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837410+0000", 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3799999999999996e-07 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837412+0000", 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5620000000000002e-06 2024-09-05T17:33:28.251 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837421+0000", 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3000000000000002e-06 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837428+0000", 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9709999999999998e-06 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.252 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902217+0000", 2024-09-05T17:33:28.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064789264999999999 2024-09-05T17:33:28.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.253 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.253 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.253 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902256+0000", 2024-09-05T17:33:28.253 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8739000000000003e-05 2024-09-05T17:33:28.253 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.254 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.254 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.254 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902308+0000", 2024-09-05T17:33:28.254 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2666e-05 2024-09-05T17:33:28.254 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.254 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.255 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.255 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.255 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.255 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78324 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3026944~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.255 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:33:28.256 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396931070999997, 2024-09-05T17:33:28.256 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064994436000000003, 2024-09-05T17:33:28.256 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.256 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.257 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.257 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.257 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.257 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.258 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78324 2024-09-05T17:33:28.258 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.258 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.258 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.258 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.258 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:33:28.258 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.259 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.259 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:33:28.259 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.259 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.259 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.260 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837437+0000", 2024-09-05T17:33:28.260 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1999999999999999e-07 2024-09-05T17:33:28.260 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.260 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.260 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837440+0000", 2024-09-05T17:33:28.261 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5289999999999998e-06 2024-09-05T17:33:28.261 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.261 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.261 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.261 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837448+0000", 2024-09-05T17:33:28.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2020000000000004e-06 2024-09-05T17:33:28.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.262 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.262 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837455+0000", 2024-09-05T17:33:28.262 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6170000000000003e-06 2024-09-05T17:33:28.262 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.262 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902337+0000", 2024-09-05T17:33:28.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064882621000000001 2024-09-05T17:33:28.263 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.263 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.263 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.263 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902377+0000", 2024-09-05T17:33:28.263 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0033000000000001e-05 2024-09-05T17:33:28.264 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.264 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.264 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.264 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902431+0000", 2024-09-05T17:33:28.264 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3813999999999997e-05 2024-09-05T17:33:28.264 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.264 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.265 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.265 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.265 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.265 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78326 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3053568~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.265 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:33:28.265 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396904355000004, 2024-09-05T17:33:28.266 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065107835000000003, 2024-09-05T17:33:28.266 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.266 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.266 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.266 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.266 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.266 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.267 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78326 2024-09-05T17:33:28.267 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.267 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.267 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.267 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.268 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:33:28.268 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.268 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.268 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.268 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.269 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837463+0000", 2024-09-05T17:33:28.269 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.269 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.269 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.269 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837464+0000", 2024-09-05T17:33:28.270 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9800000000000003e-07 2024-09-05T17:33:28.270 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.270 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.270 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.270 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837467+0000", 2024-09-05T17:33:28.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5339999999999998e-06 2024-09-05T17:33:28.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.271 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.271 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.271 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837477+0000", 2024-09-05T17:33:28.271 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0064999999999999e-05 2024-09-05T17:33:28.271 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837483+0000", 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7710000000000001e-06 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902462+0000", 2024-09-05T17:33:28.272 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064978528999999993 2024-09-05T17:33:28.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.273 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902504+0000", 2024-09-05T17:33:28.273 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1578000000000001e-05 2024-09-05T17:33:28.273 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.273 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.273 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.274 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902571+0000", 2024-09-05T17:33:28.274 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7760000000000002e-05 2024-09-05T17:33:28.274 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.274 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.274 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.274 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.274 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.275 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78327 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3080192~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.275 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:33:28.275 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396875444000003, 2024-09-05T17:33:28.275 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065202856000000003, 2024-09-05T17:33:28.275 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.275 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.276 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.276 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.276 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78327 2024-09-05T17:33:28.276 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.277 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.277 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.277 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.277 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:33:28.277 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.277 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.278 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.278 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.278 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837492+0000", 2024-09-05T17:33:28.278 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.278 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837493+0000", 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0900000000000001e-07 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837496+0000", 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.779e-06 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.279 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837504+0000", 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3429999999999996e-06 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837515+0000", 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0553999999999999e-05 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902602+0000", 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065087229999999996 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.280 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902642+0000", 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0221e-05 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902695+0000", 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.312e-05 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.281 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78328 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3106816~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396844212999994, 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065293114999999999, 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78328 2024-09-05T17:33:28.282 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.283 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837524+0000", 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837527+0000", 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6539999999999999e-06 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837538+0000", 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0974e-05 2024-09-05T17:33:28.284 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837544+0000", 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6019999999999996e-06 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902726+0000", 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065181378999999998 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.285 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902765+0000", 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8717000000000002e-05 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902817+0000", 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2188999999999998e-05 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.286 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.287 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.287 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.287 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78329 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 3133440~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.287 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:33:28.287 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396814191000004, 2024-09-05T17:33:28.287 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065389339000000005, 2024-09-05T17:33:28.287 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.287 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78329 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.288 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.289 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:33:28.289 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.289 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.289 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.289 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837554+0000", 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9999999999999997e-07 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837557+0000", 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6740000000000001e-06 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837565+0000", 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3049999999999993e-06 2024-09-05T17:33:28.290 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837572+0000", 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5599999999999999e-06 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902848+0000", 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065275904999999995 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902889+0000", 2024-09-05T17:33:28.291 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1001000000000003e-05 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902943+0000", 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4293999999999999e-05 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78370 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2097152~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:33:28.292 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396787294999996, 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065484603000000002, 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78370 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.293 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837581+0000", 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.9699999999999996e-07 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.294 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837621+0000", 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0129999999999997e-05 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837633+0000", 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1394e-05 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837663+0000", 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.295 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.902974+0000", 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065310280999999998 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903012+0000", 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8022999999999998e-05 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903065+0000", 2024-09-05T17:33:28.296 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3381999999999998e-05 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78371 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2123776~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396690555000006, 2024-09-05T17:33:28.297 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065515396000000004, 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78371 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:33:28.298 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837677+0000", 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837678+0000", 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.299 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837682+0000", 2024-09-05T17:33:28.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4740000000000001e-06 2024-09-05T17:33:28.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.300 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.300 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837691+0000", 2024-09-05T17:33:28.300 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5429999999999999e-06 2024-09-05T17:33:28.300 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.300 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837698+0000", 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2400000000000001e-06 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903096+0000", 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065397466000000001 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903139+0000", 2024-09-05T17:33:28.301 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3568e-05 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903193+0000", 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3227999999999999e-05 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78372 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2150400~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.39665995, 2024-09-05T17:33:28.302 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065609343000000001, 2024-09-05T17:33:28.303 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.303 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.303 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.303 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.303 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.303 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78372 2024-09-05T17:33:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.304 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837708+0000", 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.305 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837709+0000", 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.3099999999999997e-07 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837711+0000", 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5600000000000001e-06 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.306 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837720+0000", 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.4230000000000005e-06 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837726+0000", 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6819999999999997e-06 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903224+0000", 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065497593000000007 2024-09-05T17:33:28.307 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903263+0000", 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8714999999999998e-05 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903317+0000", 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4639000000000003e-05 2024-09-05T17:33:28.308 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78374 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2177024~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396632621999998, 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065706237000000001, 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.309 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78374 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.310 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837735+0000", 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837736+0000", 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1099999999999995e-07 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837738+0000", 2024-09-05T17:33:28.311 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.683e-06 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837747+0000", 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2539999999999992e-06 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837753+0000", 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6200000000000001e-06 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.312 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903348+0000", 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065594219999999995 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903387+0000", 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9576000000000002e-05 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903441+0000", 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4273e-05 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.313 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78375 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2203648~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396605734999994, 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065800759, 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.314 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78375 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837762+0000", 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.315 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837763+0000", 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7999999999999995e-07 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837765+0000", 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6170000000000001e-06 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.316 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837773+0000", 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2169999999999994e-06 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837780+0000", 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.5939999999999999e-06 2024-09-05T17:33:28.317 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.318 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903471+0000", 2024-09-05T17:33:28.318 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065690929999999995 2024-09-05T17:33:28.318 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.318 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.318 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903511+0000", 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9968000000000001e-05 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903563+0000", 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1853e-05 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.319 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78376 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2230272~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396578423999998, 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065891585000000003, 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78376 2024-09-05T17:33:28.320 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.321 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.321 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.321 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:33:28.321 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.321 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.321 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.837789+0000", 2024-09-05T17:33:28.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.322 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.322 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.322 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.322 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838041+0000", 2024-09-05T17:33:28.322 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025203500000000001 2024-09-05T17:33:28.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.323 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.323 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838049+0000", 2024-09-05T17:33:28.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6660000000000008e-06 2024-09-05T17:33:28.323 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838079+0000", 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9598999999999999e-05 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838101+0000", 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903592+0000", 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065490943999999995 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903631+0000", 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9172999999999999e-05 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903681+0000", 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0222999999999997e-05 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78377 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2256896~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.396241239999995, 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.065681058, 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.326 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78377 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.838127+0000", 2024-09-05T17:33:28.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.328 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.328 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839057+0000", 2024-09-05T17:33:28.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00093036499999999995 2024-09-05T17:33:28.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839067+0000", 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0368e-05 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839096+0000", 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9159e-05 2024-09-05T17:33:28.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839115+0000", 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8230999999999999e-05 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903711+0000", 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064596518000000006 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903753+0000", 2024-09-05T17:33:28.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.1538000000000001e-05 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903808+0000", 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4879000000000001e-05 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78379 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2283520~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:33:28.331 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.395224161000002, 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064788771999999994, 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78379 2024-09-05T17:33:28.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839144+0000", 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839145+0000", 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.189e-06 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839151+0000", 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.4169999999999997e-06 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839195+0000", 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.3739000000000003e-05 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839212+0000", 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6922000000000002e-05 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903839+0000", 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064627087 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903879+0000", 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0191999999999997e-05 2024-09-05T17:33:28.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903932+0000", 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3226000000000002e-05 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78380 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2310144~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.395114652000004, 2024-09-05T17:33:28.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064801348999999994, 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78380 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.337 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839253+0000", 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839254+0000", 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1570000000000001e-06 2024-09-05T17:33:28.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839261+0000", 2024-09-05T17:33:28.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9110000000000004e-06 2024-09-05T17:33:28.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839282+0000", 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0531e-05 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839297+0000", 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5665e-05 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.903963+0000", 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064665150000000005 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904002+0000", 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9385999999999999e-05 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904055+0000", 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2549000000000001e-05 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78381 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2336768~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.395048170999999, 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064855814999999997, 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78381 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839320+0000", 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839321+0000", 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1370000000000001e-06 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839327+0000", 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:33:28.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839345+0000", 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.84e-05 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839360+0000", 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4748e-05 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904083+0000", 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064722717999999999 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904122+0000", 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8803000000000001e-05 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904175+0000", 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3924000000000001e-05 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:78383 3.6 3:6518ac64:::rbd_data.11401e6514d3.0000000000000007:1d [read 2363392~2048] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e77)", 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.394988385000005, 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.064921897000000006, 2024-09-05T17:33:28.347 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 78383 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.839379+0000", 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842700+0000", 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0033207900000000001 2024-09-05T17:33:28.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842711+0000", 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1011e-05 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842740+0000", 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8730000000000001e-05 2024-09-05T17:33:28.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.351 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.351 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.842760+0000", 2024-09-05T17:33:28.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.016e-05 2024-09-05T17:33:28.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904207+0000", 2024-09-05T17:33:28.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.061446752 2024-09-05T17:33:28.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904248+0000", 2024-09-05T17:33:28.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0688000000000001e-05 2024-09-05T17:33:28.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.904301+0000", 2024-09-05T17:33:28.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3766e-05 2024-09-05T17:33:28.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.354 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.354 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.354 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:127565 3.10 3.bb351dd0 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e125)", 2024-09-05T17:33:28.355 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:33:28.355 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 40.345584129000002, 2024-09-05T17:33:28.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.88126017199999995, 2024-09-05T17:33:28.355 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.355 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.355 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:28.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.356 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 127565 2024-09-05T17:33:28.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.357 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:33:28.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888784+0000", 2024-09-05T17:33:28.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888785+0000", 2024-09-05T17:33:28.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6360000000000001e-06 2024-09-05T17:33:28.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.360 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888792+0000", 2024-09-05T17:33:28.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.9280000000000004e-06 2024-09-05T17:33:28.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.360 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888808+0000", 2024-09-05T17:33:28.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5889999999999999e-05 2024-09-05T17:33:28.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888818+0000", 2024-09-05T17:33:28.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0202e-05 2024-09-05T17:33:28.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888877+0000", 2024-09-05T17:33:28.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8641999999999999e-05 2024-09-05T17:33:28.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:28.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:47.888884+0000", 2024-09-05T17:33:28.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2479999999999999e-06 2024-09-05T17:33:28.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.770018+0000", 2024-09-05T17:33:28.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.88113417199999999 2024-09-05T17:33:28.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:48.770044+0000", 2024-09-05T17:33:28.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.5454000000000001e-05 2024-09-05T17:33:28.365 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.365 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.366 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.366 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:28.368 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-05T17:33:28.501 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:28.501 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:28.501 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:28.516 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-05T17:33:28.639 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:28.639 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:28.640 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:28.640 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:28.640 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:28.654 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-05T17:33:28.787 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50560 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'198, mlcod=52'195)", 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.563220128, 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064487579999999997, 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.788 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222224+0000", 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.789 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222226+0000", 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1100000000000001e-06 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222244+0000", 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8609000000000001e-05 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222283+0000", 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8543e-05 2024-09-05T17:33:28.790 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222304+0000", 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1569e-05 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222453+0000", 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000148374 2024-09-05T17:33:28.791 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.222488+0000", 2024-09-05T17:33:28.792 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5364999999999998e-05 2024-09-05T17:33:28.792 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.792 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.792 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.792 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228551+0000", 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060628419999999997 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228672+0000", 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000121346 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.793 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:50561 3.4 e52/24 3:23921e01:::rbd_object_map.1140f0d7121a:head v 52'199, mlcod=52'195)", 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 124.560956198, 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0042751719999999998, 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.794 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.795 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224488+0000", 2024-09-05T17:33:28.795 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.795 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.795 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.795 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224490+0000", 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.046e-06 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224505+0000", 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.5293000000000001e-05 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.796 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224541+0000", 2024-09-05T17:33:28.797 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5923000000000001e-05 2024-09-05T17:33:28.797 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.797 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.797 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.797 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224560+0000", 2024-09-05T17:33:28.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9639e-05 2024-09-05T17:33:28.798 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.798 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.798 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.798 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224687+0000", 2024-09-05T17:33:28.798 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012616 2024-09-05T17:33:28.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.799 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.799 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.799 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.224754+0000", 2024-09-05T17:33:28.799 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7002000000000007e-05 2024-09-05T17:33:28.799 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.800 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.800 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228681+0000", 2024-09-05T17:33:28.800 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039276570000000002 2024-09-05T17:33:28.800 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.800 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.801 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.801 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:24.228763+0000", 2024-09-05T17:33:28.801 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.1452000000000006e-05 2024-09-05T17:33:28.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.801 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.801 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.801 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.802 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.802 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "MOSDPGRecoveryDelete(3.1f e62,61 3:fa901b21:::rbd_data.114070605229.000000000000015e:head,28'8)", 2024-09-05T17:33:28.802 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:28.802 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 110.25193496599999, 2024-09-05T17:33:28.802 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0056826749999999999, 2024-09-05T17:33:28.802 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.803 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.803 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:28.803 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.803 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.803 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.803 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:28.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.804 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.804 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.804 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.804 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533509+0000", 2024-09-05T17:33:28.804 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.805 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.805 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.805 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.805 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533511+0000", 2024-09-05T17:33:28.805 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2029999999999999e-06 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533525+0000", 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3733e-05 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.806 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533559+0000", 2024-09-05T17:33:28.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4199000000000002e-05 2024-09-05T17:33:28.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.807 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.807 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.807 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.533581+0000", 2024-09-05T17:33:28.807 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1945000000000001e-05 2024-09-05T17:33:28.807 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.808 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.808 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534060+0000", 2024-09-05T17:33:28.808 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00047895499999999998 2024-09-05T17:33:28.808 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.808 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.809 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.534087+0000", 2024-09-05T17:33:28.809 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6933000000000001e-05 2024-09-05T17:33:28.809 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.809 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.809 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.810 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:38.539191+0000", 2024-09-05T17:33:28.810 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.005104707 2024-09-05T17:33:28.810 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.810 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.810 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.811 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.811 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.811 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77667 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'751, mlcod=77'749)", 2024-09-05T17:33:28.811 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:28.811 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 92.001098820999999, 2024-09-05T17:33:28.811 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0053666859999999999, 2024-09-05T17:33:28.812 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.812 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.812 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.812 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.812 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.812 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:28.813 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.813 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.813 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.813 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.813 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784345+0000", 2024-09-05T17:33:28.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.814 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.814 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.814 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.814 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784347+0000", 2024-09-05T17:33:28.814 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.61e-06 2024-09-05T17:33:28.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.815 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.815 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.815 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784357+0000", 2024-09-05T17:33:28.815 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0599e-05 2024-09-05T17:33:28.815 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.816 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.816 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.816 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784383+0000", 2024-09-05T17:33:28.816 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6253000000000001e-05 2024-09-05T17:33:28.816 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.817 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.817 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784396+0000", 2024-09-05T17:33:28.817 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2656e-05 2024-09-05T17:33:28.817 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.817 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.818 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784528+0000", 2024-09-05T17:33:28.818 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013218600000000001 2024-09-05T17:33:28.818 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.818 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.818 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784585+0000", 2024-09-05T17:33:28.819 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6858999999999999e-05 2024-09-05T17:33:28.819 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.819 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.819 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.819 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789683+0000", 2024-09-05T17:33:28.820 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050974449999999999 2024-09-05T17:33:28.820 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.820 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.820 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.820 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789712+0000", 2024-09-05T17:33:28.821 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9077999999999998e-05 2024-09-05T17:33:28.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.821 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.821 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.821 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.821 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.822 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77668 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'752, mlcod=77'749)", 2024-09-05T17:33:28.822 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:28.822 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 92.000492972999993, 2024-09-05T17:33:28.822 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0047914990000000003, 2024-09-05T17:33:28.822 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.822 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.823 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.823 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.823 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.823 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.823 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:28.823 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.824 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.824 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784951+0000", 2024-09-05T17:33:28.824 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.824 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.824 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.825 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.825 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784952+0000", 2024-09-05T17:33:28.825 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.2600000000000001e-07 2024-09-05T17:33:28.825 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.825 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784958+0000", 2024-09-05T17:33:28.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1650000000000003e-06 2024-09-05T17:33:28.826 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.826 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.826 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.826 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784972+0000", 2024-09-05T17:33:28.826 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4069e-05 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.784982+0000", 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.7510000000000003e-06 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786042+0000", 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001060585 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.827 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786101+0000", 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8801999999999997e-05 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789716+0000", 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.003614997 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.828 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.789742+0000", 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6203999999999998e-05 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77669 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'753, mlcod=77'749)", 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.999927041999996, 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0046161379999999997, 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.829 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.830 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785517+0000", 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.0400000000000005e-07 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785524+0000", 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6540000000000002e-06 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785562+0000", 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7367999999999999e-05 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.831 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.785571+0000", 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.5519999999999993e-06 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787612+0000", 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0020412210000000002 2024-09-05T17:33:28.832 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.787653+0000", 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.0756000000000001e-05 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790106+0000", 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002453228 2024-09-05T17:33:28.833 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790133+0000", 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6554999999999999e-05 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:77670 3.0 e77/24 3:0599d47a:::rbd_object_map.1140e4bbd9e2:head v 77'754, mlcod=77'749)", 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 91.999272101000003, 2024-09-05T17:33:28.834 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039939440000000001, 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786172+0000", 2024-09-05T17:33:28.835 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786173+0000", 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9600000000000008e-07 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786180+0000", 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1110000000000002e-06 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.836 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786192+0000", 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2007999999999999e-05 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.786204+0000", 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2047e-05 2024-09-05T17:33:28.837 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.838 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788907+0000", 2024-09-05T17:33:28.838 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0027028289999999999 2024-09-05T17:33:28.838 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.838 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.838 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.788927+0000", 2024-09-05T17:33:28.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0265e-05 2024-09-05T17:33:28.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.841 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.841 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.841 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790136+0000", 2024-09-05T17:33:28.841 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0012091929999999999 2024-09-05T17:33:28.841 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:31:56.790166+0000", 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9495000000000001e-05 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(client.4416.0:117572 3.4 e110/24 3:2566fea6:::rbd_data.1140bb1b3dec.000000000000001f:head v 110'665, mlcod=108'663)", 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:28.842 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 57.761902194999998, 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0049701290000000002, 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.843 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023542+0000", 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.023543+0000", 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.46e-06 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024795+0000", 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001251903 2024-09-05T17:33:28.844 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024824+0000", 2024-09-05T17:33:28.845 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9431999999999999e-05 2024-09-05T17:33:28.845 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.845 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.845 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.845 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024837+0000", 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2381000000000001e-05 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024909+0000", 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2520000000000004e-05 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.024933+0000", 2024-09-05T17:33:28.846 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.3357999999999999e-05 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028413+0000", 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034808370000000001 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:31.028512+0000", 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8238000000000004e-05 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.847 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.1.0:3016 3.0 e154/24 3:05b9328d:::rbd_data.11409622ac7f.0000000000000013:c v 154'1381, mlcod=149'1377)", 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:16.629746+0000", 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 12.155697769, 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098471719999999995, 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.848 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.629746+0000", 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.629746+0000", 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.629747+0000", 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2699999999999999e-06 2024-09-05T17:33:28.849 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.629761+0000", 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.412e-05 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.629793+0000", 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2138999999999998e-05 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.629815+0000", 2024-09-05T17:33:28.850 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1656999999999999e-05 2024-09-05T17:33:28.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.851 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.629988+0000", 2024-09-05T17:33:28.851 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017270299999999999 2024-09-05T17:33:28.851 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.851 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.851 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.630034+0000", 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.5741999999999997e-05 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.639468+0000", 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0094342379999999993 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:16.639593+0000", 2024-09-05T17:33:28.852 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000125303 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.1.0:3035 3.4 e155/24 3:25f0dc95:::rbd_data.11404462ede9.0000000000000003:b v 155'769, mlcod=153'766)", 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:17.522813+0000", 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.262630569000001, 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0087139250000000008, 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.853 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.522813+0000", 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.522813+0000", 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.522814+0000", 2024-09-05T17:33:28.854 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2669999999999999e-06 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.522828+0000", 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3563e-05 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.522868+0000", 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9536000000000002e-05 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.855 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.522887+0000", 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9956999999999999e-05 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.523076+0000", 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000188338 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.523133+0000", 2024-09-05T17:33:28.856 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7015999999999998e-05 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.531407+0000", 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0082743739999999993 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.531527+0000", 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000119874 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.857 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.4.0:1843 3.9 e155/24 3:9476d8a6:::rbd_data.11404462ede9.0000000000000005:b v 155'752, mlcod=146'749)", 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:17.523984+0000", 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.261459645, 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0073329320000000003, 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.858 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.523984+0000", 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.523984+0000", 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.523985+0000", 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7700000000000004e-07 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.859 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.523994+0000", 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.037e-06 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.524021+0000", 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7336000000000001e-05 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.524039+0000", 2024-09-05T17:33:28.860 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7926000000000001e-05 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.524196+0000", 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015657400000000001 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.524253+0000", 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7615000000000003e-05 2024-09-05T17:33:28.861 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.531189+0000", 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0069353870000000003 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.531317+0000", 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00012837999999999999 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.862 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.1.0:3037 3.0 e155/24 3:058d46e1:::rbd_data.11404462ede9.0000000000000072:b v 155'1386, mlcod=154'1383)", 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:17.532762+0000", 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 11.252681868, 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039222969999999999, 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.863 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.532762+0000", 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.532762+0000", 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.864 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.532764+0000", 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.317e-06 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.532780+0000", 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6079e-05 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.532819+0000", 2024-09-05T17:33:28.865 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8389000000000001e-05 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.532838+0000", 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9539999999999999e-05 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.533045+0000", 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020665500000000001 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.866 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.533102+0000", 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6901999999999998e-05 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.536551+0000", 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0034491439999999999 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:17.536684+0000", 2024-09-05T17:33:28.867 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013327099999999999 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.4.0:1848 3.9 e159/24 3:9275f381:::rbd_data.1140f3505917.00000000000001d4:9 v 159'758, mlcod=158'755)", 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:21.648458+0000", 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 7.1369860520000001, 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.010336468999999999, 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.868 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.648458+0000", 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.648458+0000", 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.869 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.648459+0000", 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7700000000000003e-07 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.648472+0000", 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3173000000000001e-05 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.648523+0000", 2024-09-05T17:33:28.870 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1186000000000001e-05 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.648547+0000", 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4349e-05 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.648705+0000", 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000157584 2024-09-05T17:33:28.871 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.648761+0000", 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.6611999999999999e-05 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.658651+0000", 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0098894510000000005 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.872 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:21.658794+0000", 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000143237 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:132459 3.15 3:abcfab15:::rbd_data.11403aa71fdc.000000000000000a:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:22.695710+0000", 2024-09-05T17:33:28.873 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.0897338230000004, 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0039390140000000002, 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 132459 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.874 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.695710+0000", 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.695710+0000", 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.875 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.695714+0000", 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.6169999999999998e-06 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.695728+0000", 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4389000000000001e-05 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.695767+0000", 2024-09-05T17:33:28.876 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.8625999999999999e-05 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.695794+0000", 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7633000000000001e-05 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.695966+0000", 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000171533 2024-09-05T17:33:28.877 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.696141+0000", 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000175527 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.696342+0000", 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020086299999999999 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.878 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.698036+0000", 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001694332 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.699371+0000", 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0013347770000000001 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.699528+0000", 2024-09-05T17:33:28.879 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015684 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.699649+0000", 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000120877 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:132481 3.15 3:ac279aa2:::rbd_data.11403aa71fdc.00000000000002f8:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-05T17:33:28.880 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:22.708212+0000", 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.0772316870000003, 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0059889660000000001, 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 132481 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.881 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.708212+0000", 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.708212+0000", 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.708214+0000", 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4660000000000002e-06 2024-09-05T17:33:28.882 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.708225+0000", 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.024e-05 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.708257+0000", 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2249999999999998e-05 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.883 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.708279+0000", 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2062e-05 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.708444+0000", 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016542099999999999 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.708782+0000", 2024-09-05T17:33:28.884 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033802600000000001 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.709104+0000", 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00032190700000000002 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.711593+0000", 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024883969999999998 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.885 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.714041+0000", 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002447837 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.714130+0000", 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9825000000000001e-05 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.714201+0000", 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0535000000000001e-05 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.886 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:132483 3.15 3:abf4ec14:::rbd_data.11403aa71fdc.00000000000002fa:head [delete] snapc 8=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:22.709422+0000", 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 6.0760220220000001, 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0054913540000000004, 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:28.887 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 132483 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.709422+0000", 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.709422+0000", 2024-09-05T17:33:28.888 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.709425+0000", 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.9040000000000001e-06 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.709437+0000", 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2279999999999999e-05 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.889 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.709475+0000", 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.7669000000000001e-05 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.709494+0000", 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.967e-05 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.709866+0000", 2024-09-05T17:33:28.890 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037183499999999999 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.710258+0000", 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00039185499999999998 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.710616+0000", 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00035843700000000002 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:28.891 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.712804+0000", 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0021877659999999998 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.714757+0000", 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019530070000000001 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.714846+0000", 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9122000000000005e-05 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.892 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:22.714913+0000", 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6809000000000004e-05 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.4.0:1862 3.9 e164/24 3:904c826c:::rbd_data.114070605229.000000000000009b:4 v 164'776, mlcod=163'773)", 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:26.690707+0000", 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.0947368929999999, 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.006386465, 2024-09-05T17:33:28.893 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.690707+0000", 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.690707+0000", 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.894 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.690708+0000", 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0130000000000001e-06 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.690720+0000", 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.187e-05 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.690755+0000", 2024-09-05T17:33:28.895 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5645999999999997e-05 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.690778+0000", 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2246e-05 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.692747+0000", 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0019696330000000001 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.896 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.692806+0000", 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8835000000000002e-05 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.696986+0000", 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0041803839999999997 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.697093+0000", 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000106838 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.897 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.1.0:3114 3.4 e164/24 3:25451502:::rbd_data.114070605229.0000000000000015:4 v 164'778, mlcod=156'773)", 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:26.711982+0000", 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.0734618290000002, 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0071943759999999997, 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.898 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.711982+0000", 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.711982+0000", 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.711983+0000", 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0130000000000001e-06 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.899 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712078+0000", 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.4728999999999994e-05 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712104+0000", 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.6386000000000001e-05 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712121+0000", 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6759999999999999e-05 2024-09-05T17:33:28.900 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.713826+0000", 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0017047430000000001 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.713878+0000", 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.2942999999999998e-05 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.719060+0000", 2024-09-05T17:33:28.901 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0051814649999999997 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.719176+0000", 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00011633699999999999 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.1.0:3115 3.0 e164/24 3:00082787:::rbd_data.114070605229.0000000000000048:4 v 164'1398, mlcod=159'1395)", 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:26.712541+0000", 2024-09-05T17:33:28.902 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.0729029990000001, 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0064266940000000002, 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712541+0000", 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.903 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712541+0000", 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712543+0000", 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0360000000000001e-06 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712556+0000", 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.3682999999999999e-05 2024-09-05T17:33:28.904 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712587+0000", 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0796000000000001e-05 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712606+0000", 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.8583000000000001e-05 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.905 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712741+0000", 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013548400000000001 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.712795+0000", 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3455999999999998e-05 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.718852+0000", 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0060571180000000002 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.906 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.718967+0000", 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000115538 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_repop(osd.1.0:3116 3.0 e164/24 3:04f3a5f1:::rbd_data.114070605229.0000000000000077:4 v 164'1400, mlcod=159'1395)", 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:33:26.715042+0000", 2024-09-05T17:33:28.907 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 2.0704016539999999, 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0050277409999999996, 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.715042+0000", 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.908 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.715042+0000", 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.715044+0000", 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.7600000000000001e-06 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.715057+0000", 2024-09-05T17:33:28.909 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.348e-05 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.715085+0000", 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7308999999999999e-05 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.715101+0000", 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.6739999999999999e-05 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:28.910 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.715335+0000", 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000233849 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.715391+0000", 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5906000000000003e-05 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.719956+0000", 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.004564556 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:28.911 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:33:26.720070+0000", 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000114141 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:28.912 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:28.914 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-05T17:33:29.044 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:29.044 INFO:teuthology.orchestra.run.smithi050.stdout: "num_ops": 0 2024-09-05T17:33:29.044 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:29.061 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-05T17:33:29.180 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:29.180 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [], 2024-09-05T17:33:29.180 INFO:teuthology.orchestra.run.smithi050.stdout: "complaint_time": 30, 2024-09-05T17:33:29.180 INFO:teuthology.orchestra.run.smithi050.stdout: "num_blocked_ops": 0 2024-09-05T17:33:29.181 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:29.195 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-05T17:33:29.322 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "size": 20, 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 600, 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "ops": [ 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13398 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5728256~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 150.11177484800001, 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140529986, 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:29.323 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13398 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.324 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210206+0000", 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210775+0000", 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056946099999999995 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210787+0000", 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1722000000000001e-05 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.325 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210826+0000", 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9419999999999999e-05 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.210839+0000", 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2865e-05 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350230+0000", 2024-09-05T17:33:29.326 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939093399999999 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350467+0000", 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023728099999999999 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.350736+0000", 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00026830300000000001 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.327 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13400 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 5744640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 150.11068635000001, 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14047392, 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.328 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13400 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211294+0000", 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.329 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211868+0000", 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057354300000000003 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211879+0000", 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1205e-05 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211898+0000", 2024-09-05T17:33:29.330 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9354000000000001e-05 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.211913+0000", 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4321000000000001e-05 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351283+0000", 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13937039400000001 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.331 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351514+0000", 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023062500000000001 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.351768+0000", 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025447799999999999 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13419 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6055936~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:29.332 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 150.10034413599999, 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140543848, 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13419 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.333 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.221636+0000", 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222174+0000", 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000538161 2024-09-05T17:33:29.334 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222186+0000", 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1948e-05 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222207+0000", 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0658000000000001e-05 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222219+0000", 2024-09-05T17:33:29.335 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2292e-05 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361700+0000", 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139480519 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.361927+0000", 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022761100000000001 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.336 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362180+0000", 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00025265900000000002 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13420 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6088704~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 150.099738737, 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14052527200000001, 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.337 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13420 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.338 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222242+0000", 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222810+0000", 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00056812300000000002 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222829+0000", 2024-09-05T17:33:29.339 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9477e-05 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222850+0000", 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.1097000000000001e-05 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.222862+0000", 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1993e-05 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.340 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362262+0000", 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13939913600000001 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362490+0000", 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022886 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.362767+0000", 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000276586 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.341 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13422 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6105088~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 150.09867960899999, 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14049492, 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.342 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13422 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223301+0000", 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.343 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223873+0000", 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057260999999999998 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223885+0000", 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1931e-05 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223906+0000", 2024-09-05T17:33:29.344 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0387999999999999e-05 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.223917+0000", 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1635e-05 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363312+0000", 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139394453 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.345 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363539+0000", 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022682799999999999 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.363796+0000", 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000257075 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13426 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6170624~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:29.346 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 150.096378238, 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.140475398, 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13426 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:29.347 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.225602+0000", 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226179+0000", 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057636600000000003 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.348 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226190+0000", 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1275e-05 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226210+0000", 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0304000000000001e-05 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226222+0000", 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1521e-05 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.349 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365602+0000", 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.139380633 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.365824+0000", 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022152599999999999 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366078+0000", 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000253773 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.350 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13428 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6203392~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 150.095286848, 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14064748499999999, 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13428 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.351 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.226694+0000", 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227265+0000", 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057122 2024-09-05T17:33:29.352 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227279+0000", 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4408e-05 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227299+0000", 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9901000000000001e-05 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.353 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227314+0000", 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.4731e-05 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.366751+0000", 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13943703599999999 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367027+0000", 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00027588800000000001 2024-09-05T17:33:29.354 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367341+0000", 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00031430100000000001 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:13430 3.b 3:d5ea32a0:::rbd_data.11403f2d9bbd.0000000000000002:6 [read 6236160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 150.09426908699999, 2024-09-05T17:33:29.355 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.14065029500000001, 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "started", 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 13430 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.356 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.227711+0000", 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228285+0000", 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057355299999999998 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228296+0000", 2024-09-05T17:33:29.357 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0759e-05 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228320+0000", 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.4009e-05 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.228331+0000", 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1779e-05 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.367852+0000", 2024-09-05T17:33:29.358 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.13952062900000001 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368091+0000", 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00023863000000000001 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:30:59.368362+0000", 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000270936 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.359 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:102108 3.8 3:15b25090:::rbd_data.1140b9781f.000000000000005f:head [set-alloc-hint object_size 2097152 write_size 2097152,write 1703936~16384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 82.318415473000002, 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.96003904100000004, 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 102108 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.360 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003565+0000", 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003567+0000", 2024-09-05T17:33:29.361 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.2230000000000001e-06 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003596+0000", 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8354e-05 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003616+0000", 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.9979e-05 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003623+0000", 2024-09-05T17:33:29.362 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.6830000000000008e-06 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003698+0000", 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5102e-05 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.003711+0000", 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.2821e-05 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960339+0000", 2024-09-05T17:33:29.363 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.95662779899999995 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960502+0000", 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016287699999999999 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.960675+0000", 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00017332299999999999 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.364 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963527+0000", 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0028516549999999998 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963538+0000", 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1511e-05 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963573+0000", 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4547e-05 2024-09-05T17:33:29.365 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:07.963604+0000", 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1167000000000002e-05 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:104972 3.b 3:d358bbb2:::rbd_data.114045ce5fbb.0000000000000014:head [set-alloc-hint object_size 8388608 write_size 8388608,write 5767168~33304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 72.725984503000006, 2024-09-05T17:33:29.366 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42620287000000001, 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 104972 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:29.367 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595996+0000", 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.595999+0000", 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.2430000000000001e-06 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.368 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596034+0000", 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.4814999999999998e-05 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596084+0000", 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9623000000000002e-05 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596111+0000", 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7222000000000001e-05 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.369 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596268+0000", 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00015678600000000001 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:16.596288+0000", 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.0752999999999999e-05 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019691+0000", 2024-09-05T17:33:29.370 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.42340281499999999 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "started", 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.019937+0000", 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000245496 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.020098+0000", 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00016122099999999999 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "op_commit", 2024-09-05T17:33:29.371 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.021643+0000", 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.001545325 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022078+0000", 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00043521400000000001 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "commit_sent", 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022142+0000", 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.3311000000000004e-05 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.372 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:17.022199+0000", 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7046000000000002e-05 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105222 3.8 3:17ed81a3:::rbd_data.1140ab1a27a4.0000000000000033:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.388732658999999, 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59573235599999996, 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.373 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105222 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.374 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933248+0000", 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1200000000000003e-07 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933251+0000", 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.7360000000000001e-06 2024-09-05T17:33:29.375 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933259+0000", 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.2519999999999999e-06 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933265+0000", 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.1700000000000002e-06 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933637+0000", 2024-09-05T17:33:29.376 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00037171399999999999 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.933649+0000", 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1741e-05 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528732+0000", 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59508317499999996 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.528980+0000", 2024-09-05T17:33:29.377 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00024805600000000003 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105235 3.8 3:1406c4fe:::rbd_data.1140ab1a27a4.0000000000000040:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.386758447999995, 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59490681199999995, 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.378 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105235 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935222+0000", 2024-09-05T17:33:29.379 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935223+0000", 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.7899999999999998e-07 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935226+0000", 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.5140000000000002e-06 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.380 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935235+0000", 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.5820000000000002e-06 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935241+0000", 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.8479999999999997e-06 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935427+0000", 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018605100000000001 2024-09-05T17:33:29.381 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935435+0000", 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.7679999999999997e-06 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.529899+0000", 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59446349700000001 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.382 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530129+0000", 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00022997299999999999 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105240 3.8 3:1770cfd7:::rbd_data.1140ab1a27a4.0000000000000045:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.386728570000002, 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59525093600000001, 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.383 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105240 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.384 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935252+0000", 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.3399999999999999e-07 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935255+0000", 2024-09-05T17:33:29.385 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.0240000000000002e-06 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935263+0000", 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.5209999999999997e-06 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.935268+0000", 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.4260000000000002e-06 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.386 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936688+0000", 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0014194520000000001 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.936699+0000", 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.0684e-05 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530217+0000", 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59351825800000002 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.387 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530503+0000", 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000286037 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105352 3.8 3:149e89ef:::rbd_data.1140ab1a27a4.0000000000000092:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.383818231000006, 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59266555499999996, 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.388 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105352 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938162+0000", 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.389 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938163+0000", 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.7199999999999999e-07 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938165+0000", 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.571e-06 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938172+0000", 2024-09-05T17:33:29.390 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.8199999999999999e-06 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938177+0000", 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.0819999999999998e-06 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938755+0000", 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00057756300000000001 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938765+0000", 2024-09-05T17:33:29.391 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.9559999999999992e-06 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530621+0000", 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59185657300000005 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530828+0000", 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020651799999999999 2024-09-05T17:33:29.392 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105416 3.8 3:167d7297:::rbd_data.1140ab1a27a4.00000000000000b5:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.383477568000004, 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59253488700000001, 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.393 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105416 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:29.394 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938503+0000", 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.89e-07 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938506+0000", 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.43e-06 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.395 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938512+0000", 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.6470000000000001e-06 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.938518+0000", 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.1649999999999997e-06 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.396 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940582+0000", 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.002064803 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940591+0000", 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.9530000000000005e-06 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.530903+0000", 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59031176399999996 2024-09-05T17:33:29.397 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531038+0000", 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00013473599999999999 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105573 3.8 3:16b61c09:::rbd_data.1140ab1a27a4.00000000000000e9:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.381282096000007, 2024-09-05T17:33:29.398 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.59064897400000005, 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105573 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.399 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940698+0000", 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940699+0000", 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.51e-07 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940702+0000", 2024-09-05T17:33:29.400 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 2.8729999999999999e-06 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940709+0000", 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.7789999999999998e-06 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.940714+0000", 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 5.5480000000000001e-06 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.401 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943160+0000", 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.0024457099999999998 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.943171+0000", 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1045e-05 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531138+0000", 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58796676400000003 2024-09-05T17:33:29.402 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531347+0000", 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00020970400000000001 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105713 3.8 3:13fc529e:::rbd_data.1140ab1a27a4.0000000000000134:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.376593686000007, 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58640898200000002, 2024-09-05T17:33:29.403 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105713 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.404 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945387+0000", 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945388+0000", 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.405 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945393+0000", 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9370000000000003e-06 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945404+0000", 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1454000000000001e-05 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.945411+0000", 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.2919999999999998e-06 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.406 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946352+0000", 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00094058 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.946361+0000", 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1409999999999994e-06 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531458+0000", 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58509667099999996 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.407 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531796+0000", 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00033792400000000003 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105798 3.8 3:130c447f:::rbd_data.1140ab1a27a4.0000000000000155:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.373599877000004, 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58371549899999997, 2024-09-05T17:33:29.408 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105798 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.409 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948381+0000", 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 4.9599999999999999e-07 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948384+0000", 2024-09-05T17:33:29.410 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.1049999999999999e-06 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948392+0000", 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3140000000000004e-06 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948399+0000", 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 6.0850000000000002e-06 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.411 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.948995+0000", 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00059597700000000003 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.949004+0000", 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.38e-06 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.531903+0000", 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.58289933000000005 2024-09-05T17:33:29.412 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532096+0000", 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000192812 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:105984 3.8 3:16d82cc5:::rbd_data.1140ab1a27a4.00000000000001ae:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:29.413 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.368664226000007, 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57904612300000002, 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 105984 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.414 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953316+0000", 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953317+0000", 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 8.3900000000000004e-07 2024-09-05T17:33:29.415 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953321+0000", 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.9049999999999999e-06 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953332+0000", 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1058e-05 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953339+0000", 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.1999999999999997e-06 2024-09-05T17:33:29.416 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953410+0000", 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0743999999999999e-05 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.953422+0000", 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 1.1984000000000001e-05 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.417 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532178+0000", 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57875639599999995 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532362+0000", 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00018399700000000001 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: "description": "osd_op(client.4416.0:106008 3.8 3:1160bd3d:::rbd_data.1140ab1a27a4.00000000000001be:head [sparse-read 0~524288] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: "initiated_at": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:29.418 INFO:teuthology.orchestra.run.smithi050.stdout: "age": 69.365108824999993, 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57567867399999995, 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "continuous": false, 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "type_data": { 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "flag_point": "reached pg", 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_info": { 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client": "client.4416", 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "tid": 106008 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "events": [ 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "initiated", 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.419 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "header_read", 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "throttled", 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956872+0000", 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 7.0100000000000004e-07 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "all_read", 2024-09-05T17:33:29.420 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.956876+0000", 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 3.692e-06 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "dispatched", 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957040+0000", 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000163511 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957049+0000", 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.3209999999999994e-06 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.421 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957181+0000", 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.000132142 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "waiting for peered", 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:19.957190+0000", 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 9.1479999999999995e-06 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "reached_pg", 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532401+0000", 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.57521102099999999 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: }, 2024-09-05T17:33:29.422 INFO:teuthology.orchestra.run.smithi050.stdout: { 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout: "event": "done", 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout: "time": "2024-09-05T17:32:20.532550+0000", 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout: "duration": 0.00014913799999999999 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout: } 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout: ] 2024-09-05T17:33:29.423 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:29.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-05T17:33:29.549 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-05T17:33:29.557 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:29.558 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:29.573 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-05T17:33:29.696 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:29.696 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:29.696 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:29.696 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:29.696 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:29.711 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-05T17:33:29.711 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-05T17:33:29.832 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28971 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.12772751899999, 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095507128999999996, 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.833 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28971 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703298+0000", 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703299+0000", 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.398e-06 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703304+0000", 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703319+0000", 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4574e-05 2024-09-05T17:33:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703330+0000", 2024-09-05T17:33:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1314999999999999e-05 2024-09-05T17:33:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798571+0000", 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095241318000000005 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798626+0000", 2024-09-05T17:33:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4496999999999997e-05 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798805+0000", 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000179297 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28972 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 159744~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.12768013499999, 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095719646000000005, 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28972 2024-09-05T17:33:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703345+0000", 2024-09-05T17:33:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703346+0000", 2024-09-05T17:33:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8100000000000001e-07 2024-09-05T17:33:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703351+0000", 2024-09-05T17:33:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4270000000000001e-06 2024-09-05T17:33:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703365+0000", 2024-09-05T17:33:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4276e-05 2024-09-05T17:33:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703376+0000", 2024-09-05T17:33:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0971e-05 2024-09-05T17:33:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798839+0000", 2024-09-05T17:33:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095463129999999993 2024-09-05T17:33:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.798890+0000", 2024-09-05T17:33:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1388999999999999e-05 2024-09-05T17:33:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799065+0000", 2024-09-05T17:33:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017447200000000001 2024-09-05T17:33:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28973 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.12763546299999, 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095939016000000002, 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28973 2024-09-05T17:33:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703390+0000", 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703391+0000", 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0049999999999999e-06 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703396+0000", 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6720000000000003e-06 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703410+0000", 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4100999999999999e-05 2024-09-05T17:33:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703421+0000", 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1005000000000001e-05 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799100+0000", 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095679063999999994 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799168+0000", 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8382999999999999e-05 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799329+0000", 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160786 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28974 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 172032~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.127590121, 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096138650000000006, 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28974 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703435+0000", 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703436+0000", 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9800000000000002e-07 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703461+0000", 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5066999999999999e-05 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703476+0000", 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4911e-05 2024-09-05T17:33:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703488+0000", 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2096000000000001e-05 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799359+0000", 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095870963000000003 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799412+0000", 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2482000000000003e-05 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799574+0000", 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016213299999999999 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28975 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.12752111099999, 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096325879000000003, 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28975 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703504+0000", 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703505+0000", 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0559999999999999e-06 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703510+0000", 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7779999999999998e-06 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703524+0000", 2024-09-05T17:33:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4229e-05 2024-09-05T17:33:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703536+0000", 2024-09-05T17:33:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-05T17:33:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799612+0000", 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096076226000000001 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799671+0000", 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9095999999999998e-05 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799830+0000", 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015889699999999999 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28976 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 184320~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.12747267399999, 2024-09-05T17:33:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096518883, 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28976 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703553+0000", 2024-09-05T17:33:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703554+0000", 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.065e-06 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703559+0000", 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2100000000000001e-06 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703573+0000", 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4367e-05 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703584+0000", 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0750999999999999e-05 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799862+0000", 2024-09-05T17:33:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096277749999999995 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.799913+0000", 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1031e-05 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800072+0000", 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015870899999999999 2024-09-05T17:33:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28977 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.127426316, 2024-09-05T17:33:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096710321000000002, 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28977 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703599+0000", 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703600+0000", 2024-09-05T17:33:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1200000000000002e-07 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703605+0000", 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0069999999999997e-06 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.703639+0000", 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4366000000000003e-05 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704207+0000", 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00056732199999999999 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800103+0000", 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095896223000000003 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800154+0000", 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1381999999999997e-05 2024-09-05T17:33:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800309+0000", 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015520900000000001 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28978 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 196608~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.12676372600001, 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096197225999999997, 2024-09-05T17:33:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28978 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704262+0000", 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704264+0000", 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.84e-06 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704288+0000", 2024-09-05T17:33:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4414999999999999e-05 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704310+0000", 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2430999999999999e-05 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704328+0000", 2024-09-05T17:33:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7439e-05 2024-09-05T17:33:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800340+0000", 2024-09-05T17:33:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096012278000000006 2024-09-05T17:33:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800390+0000", 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0275000000000002e-05 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800459+0000", 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8547999999999995e-05 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28979 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.12667238, 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096347547000000006, 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28979 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704353+0000", 2024-09-05T17:33:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704354+0000", 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3489999999999999e-06 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704361+0000", 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.737e-06 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704380+0000", 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8782000000000001e-05 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704394+0000", 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3675999999999999e-05 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800491+0000", 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096097559999999999 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800540+0000", 2024-09-05T17:33:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8724000000000003e-05 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800701+0000", 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160719 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28980 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 208896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.1266109, 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096525973000000001, 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28980 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704415+0000", 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704416+0000", 2024-09-05T17:33:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.717e-06 2024-09-05T17:33:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704422+0000", 2024-09-05T17:33:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9109999999999998e-06 2024-09-05T17:33:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704441+0000", 2024-09-05T17:33:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8527999999999999e-05 2024-09-05T17:33:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704454+0000", 2024-09-05T17:33:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319000000000001e-05 2024-09-05T17:33:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800730+0000", 2024-09-05T17:33:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096275864000000003 2024-09-05T17:33:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800779+0000", 2024-09-05T17:33:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9359e-05 2024-09-05T17:33:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800941+0000", 2024-09-05T17:33:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161275 2024-09-05T17:33:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28981 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.126554, 2024-09-05T17:33:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096716574, 2024-09-05T17:33:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28981 2024-09-05T17:33:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704471+0000", 2024-09-05T17:33:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704473+0000", 2024-09-05T17:33:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6199999999999999e-06 2024-09-05T17:33:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704478+0000", 2024-09-05T17:33:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-05T17:33:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704495+0000", 2024-09-05T17:33:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6821999999999999e-05 2024-09-05T17:33:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704507+0000", 2024-09-05T17:33:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2616000000000001e-05 2024-09-05T17:33:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.800980+0000", 2024-09-05T17:33:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096472994000000006 2024-09-05T17:33:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801030+0000", 2024-09-05T17:33:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0269000000000003e-05 2024-09-05T17:33:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801188+0000", 2024-09-05T17:33:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157613 2024-09-05T17:33:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28982 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 221184~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.126460759, 2024-09-05T17:33:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096882010000000005, 2024-09-05T17:33:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28982 2024-09-05T17:33:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704565+0000", 2024-09-05T17:33:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704566+0000", 2024-09-05T17:33:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.491e-06 2024-09-05T17:33:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704572+0000", 2024-09-05T17:33:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0510000000000002e-06 2024-09-05T17:33:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704590+0000", 2024-09-05T17:33:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8048000000000001e-05 2024-09-05T17:33:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704604+0000", 2024-09-05T17:33:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3725e-05 2024-09-05T17:33:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801229+0000", 2024-09-05T17:33:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096624646999999994 2024-09-05T17:33:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801288+0000", 2024-09-05T17:33:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9131e-05 2024-09-05T17:33:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801447+0000", 2024-09-05T17:33:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015891700000000001 2024-09-05T17:33:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:28983 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.12640123099999, 2024-09-05T17:33:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.097077887000000002, 2024-09-05T17:33:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 28983 2024-09-05T17:33:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704624+0000", 2024-09-05T17:33:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704625+0000", 2024-09-05T17:33:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.249e-06 2024-09-05T17:33:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704631+0000", 2024-09-05T17:33:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1189999999999996e-06 2024-09-05T17:33:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704647+0000", 2024-09-05T17:33:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6507999999999998e-05 2024-09-05T17:33:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.704670+0000", 2024-09-05T17:33:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3175000000000001e-05 2024-09-05T17:33:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801489+0000", 2024-09-05T17:33:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096818805999999993 2024-09-05T17:33:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801539+0000", 2024-09-05T17:33:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0266999999999998e-05 2024-09-05T17:33:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.801702+0000", 2024-09-05T17:33:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016276299999999999 2024-09-05T17:33:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29099 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.119245269, 2024-09-05T17:33:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095489678999999994, 2024-09-05T17:33:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29099 2024-09-05T17:33:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711780+0000", 2024-09-05T17:33:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711781+0000", 2024-09-05T17:33:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-05T17:33:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711800+0000", 2024-09-05T17:33:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8671000000000001e-05 2024-09-05T17:33:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711814+0000", 2024-09-05T17:33:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4691999999999999e-05 2024-09-05T17:33:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711826+0000", 2024-09-05T17:33:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1639e-05 2024-09-05T17:33:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807048+0000", 2024-09-05T17:33:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095221507999999996 2024-09-05T17:33:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807108+0000", 2024-09-05T17:33:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390000000000003e-05 2024-09-05T17:33:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807270+0000", 2024-09-05T17:33:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161893 2024-09-05T17:33:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29100 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 57344~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.11918380200001, 2024-09-05T17:33:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095716376000000006, 2024-09-05T17:33:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29100 2024-09-05T17:33:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711842+0000", 2024-09-05T17:33:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711843+0000", 2024-09-05T17:33:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.711857+0000", 2024-09-05T17:33:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4679e-05 2024-09-05T17:33:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.712965+0000", 2024-09-05T17:33:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011075429999999999 2024-09-05T17:33:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713177+0000", 2024-09-05T17:33:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000212003 2024-09-05T17:33:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807304+0000", 2024-09-05T17:33:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.094127592999999996 2024-09-05T17:33:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807396+0000", 2024-09-05T17:33:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2100000000000003e-05 2024-09-05T17:33:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.807558+0000", 2024-09-05T17:33:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016154 2024-09-05T17:33:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29107 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.11731583299999, 2024-09-05T17:33:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095641692, 2024-09-05T17:33:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29107 2024-09-05T17:33:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713710+0000", 2024-09-05T17:33:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713711+0000", 2024-09-05T17:33:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2699999999999998e-07 2024-09-05T17:33:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713715+0000", 2024-09-05T17:33:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0330000000000002e-06 2024-09-05T17:33:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713728+0000", 2024-09-05T17:33:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3123e-05 2024-09-05T17:33:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713738+0000", 2024-09-05T17:33:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8279999999999998e-06 2024-09-05T17:33:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809139+0000", 2024-09-05T17:33:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095401714999999998 2024-09-05T17:33:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809191+0000", 2024-09-05T17:33:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1391999999999999e-05 2024-09-05T17:33:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809351+0000", 2024-09-05T17:33:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000160674 2024-09-05T17:33:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29108 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 106496~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.117275323, 2024-09-05T17:33:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095847684000000002, 2024-09-05T17:33:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29108 2024-09-05T17:33:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713750+0000", 2024-09-05T17:33:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713751+0000", 2024-09-05T17:33:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5499999999999997e-07 2024-09-05T17:33:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713755+0000", 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7850000000000002e-06 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713766+0000", 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1664e-05 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713775+0000", 2024-09-05T17:33:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0820000000000005e-06 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809383+0000", 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095607490000000003 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809439+0000", 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5806000000000001e-05 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809598+0000", 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015900199999999999 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29109 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.11723685699999, 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096050339999999998, 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29109 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713789+0000", 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7400000000000002e-07 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713793+0000", 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8800000000000001e-06 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713806+0000", 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2709e-05 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713832+0000", 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6064e-05 2024-09-05T17:33:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809629+0000", 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095797293000000006 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809681+0000", 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1853e-05 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809839+0000", 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015766700000000001 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29110 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 118784~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.11717874999999, 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096248607999999999, 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29110 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713847+0000", 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713848+0000", 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3699999999999999e-07 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713863+0000", 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302e-05 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713876+0000", 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3141e-05 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713887+0000", 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0688e-05 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809870+0000", 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.095983682000000001 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.809932+0000", 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1237999999999999e-05 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810095+0000", 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016372000000000001 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:29111 3.3 3:c32481be:::rbd_data.11403aa71fdc.000000000000000b:8 [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.117121449, 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096450499999999995, 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 29111 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713904+0000", 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713905+0000", 2024-09-05T17:33:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8599999999999996e-07 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713909+0000", 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.279e-06 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713921+0000", 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.201e-05 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.713930+0000", 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0089999999999996e-06 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810124+0000", 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.096193605000000001 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810172+0000", 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8541999999999997e-05 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:05.810354+0000", 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018206900000000001 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:29.980 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:29.981 INFO:teuthology.orchestra.run.smithi050.stdout:mon.a: {} 2024-09-05T17:33:29.981 INFO:teuthology.orchestra.run.smithi050.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-05T17:33:29.982 INFO:teuthology.orchestra.run.smithi050.stdout:mon.b: {} 2024-09-05T17:33:29.982 INFO:teuthology.orchestra.run.smithi050.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-05T17:33:29.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-05T17:33:29.983 INFO:teuthology.orchestra.run.smithi050.stdout:mon.c: {} 2024-09-05T17:33:29.984 INFO:teuthology.orchestra.run.smithi050.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-05T17:33:29.984 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-05T17:33:30.113 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:30.114 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:30.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-05T17:33:30.245 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:30.246 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:30.246 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:30.246 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:30.246 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:30.259 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80342 3.3 3:c43e168d:::rbd_data.11401e6514d3.0000000000000000:1d [read 434176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.919132598000004, 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049914099000000003, 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.376 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80342 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457129+0000", 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457130+0000", 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1800000000000005e-07 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457135+0000", 2024-09-05T17:33:30.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2599999999999999e-06 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457150+0000", 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5545000000000001e-05 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457162+0000", 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1613999999999999e-05 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506857+0000", 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049694985999999997 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.506942+0000", 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4951999999999996e-05 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507044+0000", 2024-09-05T17:33:30.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101924 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80344 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.919084315999996, 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049922706999999997, 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80344 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457178+0000", 2024-09-05T17:33:30.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457179+0000", 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2500000000000004e-07 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457182+0000", 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8480000000000003e-06 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457197+0000", 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4277000000000001e-05 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457207+0000", 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.044e-05 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507087+0000", 2024-09-05T17:33:30.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049879959000000001 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507100+0000", 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3358e-05 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80345 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:30.385 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.919037955999997, 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049921409999999999, 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80345 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457224+0000", 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457225+0000", 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0400000000000005e-07 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457230+0000", 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7899999999999999e-06 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457245+0000", 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5557999999999999e-05 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457256+0000", 2024-09-05T17:33:30.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699e-05 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507137+0000", 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049880985000000003 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507146+0000", 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4740000000000005e-06 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.389 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80347 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918989354999994, 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049917436000000003, 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.390 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80347 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457273+0000", 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457274+0000", 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.232e-06 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457289+0000", 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5085999999999999e-05 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457303+0000", 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3586e-05 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457313+0000", 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0445000000000001e-05 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507183+0000", 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.04986956 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507190+0000", 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5270000000000001e-06 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80349 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.394 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918933756000001, 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049883384000000003, 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80349 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457328+0000", 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457329+0000", 2024-09-05T17:33:30.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.06e-06 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457333+0000", 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1080000000000003e-06 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457347+0000", 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457359+0000", 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.149e-05 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507203+0000", 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049844434999999999 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507212+0000", 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4290000000000001e-06 2024-09-05T17:33:30.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80351 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918888511999995, 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049870210999999998, 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80351 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:30.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457374+0000", 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4e-07 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457379+0000", 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2849999999999996e-06 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457393+0000", 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4238e-05 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457404+0000", 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0614e-05 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507232+0000", 2024-09-05T17:33:30.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049828694999999999 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507244+0000", 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1539000000000001e-05 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80353 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918844012999998, 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049853632000000002, 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80353 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457418+0000", 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457419+0000", 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0599999999999999e-07 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457423+0000", 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1640000000000003e-06 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457437+0000", 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457448+0000", 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0601999999999999e-05 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507262+0000", 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049814486999999998 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507272+0000", 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4900000000000006e-06 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.407 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80356 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918800055999995, 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049847992000000001, 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80356 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457462+0000", 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457463+0000", 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5300000000000003e-07 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457467+0000", 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1330000000000001e-06 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457481+0000", 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4144e-05 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457491+0000", 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0242e-05 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507303+0000", 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049811715999999999 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507310+0000", 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0040000000000002e-06 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80358 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918754719000006, 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049837817999999999, 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80358 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457507+0000", 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457508+0000", 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6499999999999998e-07 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457513+0000", 2024-09-05T17:33:30.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3000000000000003e-06 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457526+0000", 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3696999999999999e-05 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457537+0000", 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0888e-05 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507340+0000", 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049802891000000002 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507345+0000", 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1769999999999997e-06 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80360 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918708269999996, 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049845555, 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80360 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457554+0000", 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457555+0000", 2024-09-05T17:33:30.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2799999999999995e-07 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457559+0000", 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1019999999999999e-06 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457572+0000", 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3695e-05 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457583+0000", 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0434999999999999e-05 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507386+0000", 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049803015999999999 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507399+0000", 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3478999999999999e-05 2024-09-05T17:33:30.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80361 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918664707999994, 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049830166000000002, 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80361 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457597+0000", 2024-09-05T17:33:30.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457599+0000", 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457603+0000", 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.873e-06 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457616+0000", 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3642000000000001e-05 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457628+0000", 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2248e-05 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507418+0000", 2024-09-05T17:33:30.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049789352000000002 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507428+0000", 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7189999999999996e-06 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80364 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:30.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918619332999995, 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049835466000000002, 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80364 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457643+0000", 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457644+0000", 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.02e-07 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457648+0000", 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3320000000000002e-06 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457662+0000", 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4202000000000001e-05 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457673+0000", 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0915e-05 2024-09-05T17:33:30.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507466+0000", 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049792978000000002 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507478+0000", 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2136999999999999e-05 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80366 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918570222, 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049833729, 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.430 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80366 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457692+0000", 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457693+0000", 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1999999999999998e-07 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457697+0000", 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1300000000000003e-06 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457708+0000", 2024-09-05T17:33:30.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-05 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457716+0000", 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6940000000000001e-06 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507516+0000", 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049799913000000001 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507526+0000", 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4020000000000008e-06 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80368 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918531287999997, 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049857127000000001, 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80368 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457731+0000", 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8999999999999996e-07 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457735+0000", 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.49e-06 2024-09-05T17:33:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457764+0000", 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8839e-05 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457784+0000", 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0630000000000001e-05 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507575+0000", 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049790927999999998 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507588+0000", 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.255e-05 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80370 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.438 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918461625999996, 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049839689999999999, 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80370 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457800+0000", 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457801+0000", 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000003e-07 2024-09-05T17:33:30.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457807+0000", 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3349999999999997e-06 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457822+0000", 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5582000000000001e-05 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457833+0000", 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1216999999999999e-05 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507629+0000", 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049795430000000002 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507640+0000", 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1211e-05 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.442 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80371 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918409075, 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049851489999999998, 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80371 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457853+0000", 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457854+0000", 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457869+0000", 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5218000000000001e-05 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457885+0000", 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5812e-05 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457909+0000", 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3986999999999999e-05 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507681+0000", 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049772622000000002 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507704+0000", 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3020999999999999e-05 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80373 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918263519000007, 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049756882000000002, 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.447 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80373 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.457999+0000", 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458000+0000", 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1319999999999999e-06 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458004+0000", 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7620000000000003e-06 2024-09-05T17:33:30.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458021+0000", 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458033+0000", 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1943000000000001e-05 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507746+0000", 2024-09-05T17:33:30.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049713242999999997 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507755+0000", 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6399999999999992e-06 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:80377 3.3 3.b1687c23 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e78)", 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:30.451 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.918211937999999, 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049755262000000001, 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 80377 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458050+0000", 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458051+0000", 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7499999999999998e-07 2024-09-05T17:33:30.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458055+0000", 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3250000000000001e-06 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458077+0000", 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1957e-05 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.458089+0000", 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1147e-05 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507793+0000", 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049704412000000003 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:57.507805+0000", 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2446000000000001e-05 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:97023 3.10 3:0de96011:::rbd_data.1140102563a7.000000000000000b:head [set-alloc-hint object_size 16777216 write_size 16777216,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.686189567, 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.074132402999999999, 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.456 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 97023 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690072+0000", 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690076+0000", 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1200000000000002e-06 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690089+0000", 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3106e-05 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690121+0000", 2024-09-05T17:33:30.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2722000000000003e-05 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690148+0000", 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.652e-05 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690277+0000", 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012884499999999999 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.690417+0000", 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013981599999999999 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.704121+0000", 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013704041 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763869+0000", 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059747841000000003 2024-09-05T17:33:30.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.763920+0000", 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1520999999999997e-05 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764074+0000", 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154022 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:01.764205+0000", 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013084899999999999 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:116533 3.7 3:e6924f8b:::rbd_data.11402f0626d4.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109)", 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.103935866999997, 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.069225986000000003, 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116533 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272326+0000", 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272329+0000", 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5639999999999999e-06 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272340+0000", 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.172e-05 2024-09-05T17:33:30.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272372+0000", 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1192000000000002e-05 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272387+0000", 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5339999999999999e-05 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272494+0000", 2024-09-05T17:33:30.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010650300000000001 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.272629+0000", 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135845 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.286878+0000", 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014248241 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341353+0000", 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054475896000000003 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341387+0000", 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3043000000000002e-05 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341475+0000", 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8103000000000007e-05 2024-09-05T17:33:30.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:30.341552+0000", 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7539000000000004e-05 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.468 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:30.469 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-05T17:33:30.591 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:30.591 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:30.606 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-05T17:33:30.714 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:30.714 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:30.714 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:30.714 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:30.715 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:30.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-05T17:33:30.838 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:30.838 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:30.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4213.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 183.82043890700001, 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.31298938199999998, 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4213", 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.110:0/1829326377", 2024-09-05T17:33:30.839 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016851+0000", 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016854+0000", 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7439999999999999e-06 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016868+0000", 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4173e-05 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016891+0000", 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2515999999999999e-05 2024-09-05T17:33:30.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.016915+0000", 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4176e-05 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017051+0000", 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000135959 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.017079+0000", 2024-09-05T17:33:30.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7994e-05 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.326739+0000", 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.30966005099999999 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327184+0000", 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00044533600000000001 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-05T17:33:30.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.327484+0000", 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030002099999999998 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.328873+0000", 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00138919 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329693+0000", 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00081946999999999999 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329782+0000", 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8795999999999995e-05 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:30:27.329840+0000", 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8956000000000003e-05 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92405 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11857920~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.453447543999999, 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967579600000001, 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92405 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383842+0000", 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383843+0000", 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1699999999999998e-07 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383846+0000", 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.948e-06 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383863+0000", 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7282000000000002e-05 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383881+0000", 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8207e-05 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493163+0000", 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10928207099999999 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493323+0000", 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015927399999999999 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493518+0000", 2024-09-05T17:33:30.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019549699999999999 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92406 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 1032192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.453396627999993, 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109951795, 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92406 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383893+0000", 2024-09-05T17:33:30.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383895+0000", 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.147e-06 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383899+0000", 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1620000000000001e-06 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383916+0000", 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383927+0000", 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493599+0000", 2024-09-05T17:33:30.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10967191900000001 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493702+0000", 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010288700000000001 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493845+0000", 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014319800000000001 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92407 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11884544~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.453346781999997, 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110403694, 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.855 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92407 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383943+0000", 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383944+0000", 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6000000000000002e-07 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383948+0000", 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.704e-06 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383960+0000", 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2677000000000001e-05 2024-09-05T17:33:30.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383973+0000", 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2412000000000001e-05 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.493960+0000", 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109986721 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494132+0000", 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017195099999999999 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494347+0000", 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000215369 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92409 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11911168~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.453301474, 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11082698000000001, 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92409 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383989+0000", 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4000000000000001e-07 2024-09-05T17:33:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.383993+0000", 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7400000000000002e-06 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384008+0000", 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973999999999999e-05 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384021+0000", 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2805e-05 2024-09-05T17:33:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494419+0000", 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11039842800000001 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494534+0000", 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114459 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494816+0000", 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028183400000000001 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92412 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11937792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.453253458000006, 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111367986, 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92412 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384037+0000", 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9199999999999999e-07 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384041+0000", 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7280000000000001e-06 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384069+0000", 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7911000000000001e-05 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384092+0000", 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2711999999999999e-05 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.494932+0000", 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11084046 2024-09-05T17:33:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495165+0000", 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000233241 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495405+0000", 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023904199999999999 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92414 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11964416~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.453180325999995, 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194884300000001, 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92414 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384110+0000", 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384111+0000", 2024-09-05T17:33:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1800000000000004e-07 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384115+0000", 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2289999999999997e-06 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384130+0000", 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4755e-05 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384142+0000", 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2862e-05 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495519+0000", 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.111376472 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.495748+0000", 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022895500000000001 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496059+0000", 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031065200000000002 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92417 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 11991040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.453131299999995, 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11256261400000001, 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92417 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384159+0000", 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384160+0000", 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.78e-07 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384164+0000", 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9820000000000002e-06 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384179+0000", 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5267000000000001e-05 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384216+0000", 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7385000000000002e-05 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496159+0000", 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11194274899999999 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496377+0000", 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021848899999999999 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496721+0000", 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034386399999999999 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92419 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12017664~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.453046283000006, 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112843601, 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92419 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384244+0000", 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384245+0000", 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3200000000000004e-07 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384249+0000", 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1980000000000003e-06 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384269+0000", 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0149e-05 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384281+0000", 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2482e-05 2024-09-05T17:33:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496825+0000", 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112543239 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.496939+0000", 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114406 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497087+0000", 2024-09-05T17:33:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000148295 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92421 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12044288~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.452990561000007, 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11310547899999999, 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92421 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384299+0000", 2024-09-05T17:33:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384300+0000", 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8999999999999995e-07 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384304+0000", 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9879999999999998e-06 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384323+0000", 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8998999999999999e-05 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384334+0000", 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-05 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497151+0000", 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112816191 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497277+0000", 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126857 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497405+0000", 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012755399999999999 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92423 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12070912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.452927703, 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113284655, 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92423 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384362+0000", 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384456+0000", 2024-09-05T17:33:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3695000000000003e-05 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384467+0000", 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0617e-05 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384477+0000", 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0624e-05 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384485+0000", 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5179999999999998e-06 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497452+0000", 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.112966898 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497507+0000", 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4966000000000002e-05 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497647+0000", 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014033700000000001 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92424 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12097536~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.452781130000005, 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.113447768, 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.891 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92424 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.384509+0000", 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390676+0000", 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061672519999999998 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390686+0000", 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7890000000000006e-06 2024-09-05T17:33:30.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390709+0000", 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2853e-05 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.390723+0000", 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4601e-05 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497700+0000", 2024-09-05T17:33:30.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.106976427 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497810+0000", 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110093 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.497957+0000", 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014675300000000001 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92457 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12496896~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.445877898999996, 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109797991, 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92457 2024-09-05T17:33:30.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391412+0000", 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391413+0000", 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0200000000000002e-07 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391415+0000", 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2450000000000001e-06 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391421+0000", 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3219999999999998e-06 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391427+0000", 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6520000000000003e-06 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501086+0000", 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109658853 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501151+0000", 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5531000000000007e-05 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501210+0000", 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8885999999999998e-05 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92460 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12523520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.445856105000004, 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110065302, 2024-09-05T17:33:30.900 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92460 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391434+0000", 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7700000000000005e-07 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391437+0000", 2024-09-05T17:33:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1780000000000002e-06 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391460+0000", 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3830999999999999e-05 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391468+0000", 2024-09-05T17:33:30.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7600000000000002e-06 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501258+0000", 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.109790022 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501368+0000", 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010972300000000001 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501499+0000", 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131311 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92462 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12550144~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.445812642000007, 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110160826, 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.905 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92462 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391477+0000", 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391478+0000", 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3000000000000001e-07 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391480+0000", 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2330000000000001e-06 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391490+0000", 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7569999999999999e-06 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391495+0000", 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4140000000000002e-06 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501533+0000", 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.11003769300000001 2024-09-05T17:33:30.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501582+0000", 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9203000000000003e-05 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501638+0000", 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5995999999999997e-05 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92463 3.14 3:2c3d9249:::rbd_data.114011e2bab6.0000000000000000:1c [read 12576768~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.445775971000003, 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110419906, 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92463 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.910 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391514+0000", 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391515+0000", 2024-09-05T17:33:30.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2e-07 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391517+0000", 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2960000000000001e-06 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391528+0000", 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0709e-05 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391537+0000", 2024-09-05T17:33:30.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2320000000000007e-06 2024-09-05T17:33:30.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501687+0000", 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110149739 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501806+0000", 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000119046 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501934+0000", 2024-09-05T17:33:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012836400000000001 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92464 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 22528~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.445735663999997, 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110516155, 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92464 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391554+0000", 2024-09-05T17:33:30.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391555+0000", 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-07 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391557+0000", 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1349999999999999e-06 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391568+0000", 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-05 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391582+0000", 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4329e-05 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.501972+0000", 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110389733 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502015+0000", 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2738999999999999e-05 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502070+0000", 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5967000000000001e-05 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.920 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:92465 3.14 3:29095938:::rbd_data.11401e6514d3.0000000000000006:1d [read 49152~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e79)", 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.445696957999999, 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110767817, 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 92465 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391593+0000", 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391594+0000", 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.164e-06 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391598+0000", 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0160000000000002e-06 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391611+0000", 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2464e-05 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.391623+0000", 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2721999999999999e-05 2024-09-05T17:33:30.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502116+0000", 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.110492853 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502228+0000", 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111663 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:31:58.502361+0000", 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013293499999999999 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106826 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e103)", 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.665690710999996, 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3799441690000001, 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.925 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106826 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171599+0000", 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171600+0000", 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9700000000000005e-07 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171605+0000", 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6099999999999999e-06 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171616+0000", 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1097999999999999e-05 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171625+0000", 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7010000000000002e-06 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171743+0000", 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011817299999999999 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.171903+0000", 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016003499999999999 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.172216+0000", 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031311799999999998 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.173465+0000", 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001249256 2024-09-05T17:33:30.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551479+0000", 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.378013816 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551486+0000", 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3810000000000001e-06 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551338+0000", 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.99985134600000003 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.551543+0000", 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020573799999999999 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:106827 3.d 3:b332f720:::rbd_header.1140afe73fa1:head [watch reconnect cookie 140030097755680 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104)", 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 68.294360135000005, 2024-09-05T17:33:30.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0116450299999999, 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 106827 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:30.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542930+0000", 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542934+0000", 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6430000000000001e-06 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:30.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542949+0000", 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5123000000000001e-05 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.542997+0000", 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7953e-05 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543023+0000", 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6506999999999999e-05 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543149+0000", 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126153 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.543160+0000", 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0274e-05 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551786+0000", 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086264529999999992 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:22.551807+0000", 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1382999999999998e-05 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552421+0000", 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0006135229999999 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.552825+0000", 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00040433999999999999 2024-09-05T17:33:30.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:32:23.554575+0000", 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001749678 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:30.937 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:30.938 INFO:teuthology.orchestra.run.smithi050.stderr:noscrub is unset 2024-09-05T17:33:30.939 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-05T17:33:30.940 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.0 to 1 (10000) 2024-09-05T17:33:30.940 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-05T17:33:30.941 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-05T17:33:31.060 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:31.060 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:31.060 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-05T17:33:31.060 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:31.073 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-05T17:33:31.184 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-05T17:33:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-05T17:33:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-05T17:33:31.185 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:31.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-05T17:33:31.322 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-05T17:33:31.322 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-05T17:33:31.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-05T17:33:31.322 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-05T17:33:31.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.322 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:129438 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e140)", 2024-09-05T17:33:31.322 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.780734873, 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.98318761499999996, 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129438 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539386+0000", 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539389+0000", 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0429999999999999e-06 2024-09-05T17:33:31.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539399+0000", 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0547000000000001e-05 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539421+0000", 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1710000000000001e-05 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539435+0000", 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4303e-05 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539565+0000", 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012969500000000001 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:02.539581+0000", 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6347000000000001e-05 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522237+0000", 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.98265522000000005 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522377+0000", 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014015800000000001 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.522573+0000", 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019659199999999999 2024-09-05T17:33:31.327 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:129524 3.5 3:a0879031:::rbd_data.11403d751225.0000000000000020:head [delete] snapc 19=[] ondisk+write+known_if_redirected+supports_pool_eio e141)", 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.691083670000001, 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056654990000000001, 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.328 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 129524 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629037+0000", 2024-09-05T17:33:31.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629038+0000", 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8899999999999998e-07 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629042+0000", 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1860000000000002e-06 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629053+0000", 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1384e-05 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629061+0000", 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1100000000000003e-06 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629194+0000", 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000132426 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629418+0000", 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000223785 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.629752+0000", 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033392399999999998 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.632437+0000", 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026852059999999999 2024-09-05T17:33:31.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634456+0000", 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020188010000000002 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634552+0000", 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6892999999999995e-05 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:03.634702+0000", 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014999499999999999 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130217 3.16 3:6bfb19a8:::rbd_header.1140fc6eb649:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.803778821000002, 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013482456, 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.334 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130217 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516342+0000", 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516345+0000", 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.32e-06 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516360+0000", 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5330000000000001e-05 2024-09-05T17:33:31.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516394+0000", 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3933999999999997e-05 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516418+0000", 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3583000000000001e-05 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516574+0000", 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015629500000000001 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.516591+0000", 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6725999999999999e-05 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.519517+0000", 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029258800000000001 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.519825+0000", 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030783399999999999 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.520826+0000", 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010011449999999999 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.524513+0000", 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036871730000000002 2024-09-05T17:33:31.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529525+0000", 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050120119999999997 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529695+0000", 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017012200000000001 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.529824+0000", 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129102 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4088 3.2 e145/137 3:4665a0fd:::rbd_data.1140fc6eb649.0000000000000055:15 v 145'1619, mlcod=144'1615)", 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.779867564, 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049534389999999996, 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.341 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540253+0000", 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540254+0000", 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8599999999999997e-07 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540263+0000", 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4399999999999994e-06 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540290+0000", 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6395999999999999e-05 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540308+0000", 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8593e-05 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540457+0000", 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014878299999999999 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.540512+0000", 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5179000000000001e-05 2024-09-05T17:33:31.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.545080+0000", 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0045677790000000001 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.545207+0000", 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012648299999999999 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130221 3.16 3:6bfb19a8:::rbd_header.1140fc6eb649:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e145)", 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.771921314, 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060020940000000004, 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130221 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548199+0000", 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548204+0000", 2024-09-05T17:33:31.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4739999999999999e-06 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548220+0000", 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5705999999999998e-05 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548254+0000", 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4977000000000001e-05 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548286+0000", 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1242999999999999e-05 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.548488+0000", 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020197800000000001 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.549218+0000", 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00073061399999999998 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.550828+0000", 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001609856 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.552067+0000", 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001238474 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554067+0000", 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020004139999999998 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554143+0000", 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5558999999999999e-05 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:07.554201+0000", 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8798999999999997e-05 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:130366 3.5 3:a4c0be76:::rbd_object_map.1140229fee9:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e146)", 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.764730780000001, 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0072600620000000003, 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 130366 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555390+0000", 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555393+0000", 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2799999999999999e-06 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555405+0000", 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1919000000000001e-05 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555433+0000", 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7773999999999999e-05 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555447+0000", 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4368e-05 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555524+0000", 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6705999999999994e-05 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.555532+0000", 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2940000000000006e-06 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558192+0000", 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0026597280000000001 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558420+0000", 2024-09-05T17:33:31.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000227591 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.558901+0000", 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00048115300000000001 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.560866+0000", 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019653600000000002 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562540+0000", 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016743159999999999 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562577+0000", 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7001e-05 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:08.562650+0000", 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2571999999999996e-05 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.358 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131006 3.16 3:6f6acd23:::rbd_data.11402b8b869e.0000000000000008:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.593171482999999, 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0070549289999999997, 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131006 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726949+0000", 2024-09-05T17:33:31.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726952+0000", 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.853e-06 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.726965+0000", 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2737e-05 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727008+0000", 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2886000000000002e-05 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727029+0000", 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1480000000000001e-05 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727201+0000", 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017164200000000001 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727745+0000", 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00054416600000000001 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728037+0000", 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029177400000000002 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731099+0000", 2024-09-05T17:33:31.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0030619879999999999 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733668+0000", 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.002569385 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733822+0000", 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000153523 2024-09-05T17:33:31.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734004+0000", 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018249499999999999 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131007 3.c 3:32ac2821:::rbd_data.11402b8b869e.0000000000000009:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.593044098, 2024-09-05T17:33:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0059404119999999999, 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131007 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:31.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727077+0000", 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727078+0000", 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4270000000000001e-06 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727086+0000", 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0169999999999996e-06 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727104+0000", 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7776000000000001e-05 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727113+0000", 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5000000000000005e-06 2024-09-05T17:33:31.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727236+0000", 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012313600000000001 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727891+0000", 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00065465800000000002 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:31.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728184+0000", 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029244699999999999 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731630+0000", 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003446466 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732672+0000", 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010421880000000001 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732869+0000", 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019643199999999999 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.733017+0000", 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014836499999999999 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.371 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131010 3.1c 3:3d4252e9:::rbd_data.11402b8b869e.000000000000000f:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.592979988, 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0049975590000000004, 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131010 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727141+0000", 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727142+0000", 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7740000000000001e-06 2024-09-05T17:33:31.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727148+0000", 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7729999999999996e-06 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727166+0000", 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7603000000000001e-05 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727180+0000", 2024-09-05T17:33:31.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4167e-05 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727296+0000", 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115679 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.727729+0000", 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043355599999999998 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.728022+0000", 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029243800000000001 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731527+0000", 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035051679999999999 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731849+0000", 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032256299999999999 2024-09-05T17:33:31.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.731995+0000", 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014588599999999999 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.732138+0000", 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014295200000000001 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:131012 3.2 e149/137 3:423a830c:::rbd_data.11402b8b869e.0000000000000011:head v 149'1622, mlcod=145'1619)", 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.591073430000002, 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0052660930000000003, 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729047+0000", 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729049+0000", 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7829999999999999e-06 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729064+0000", 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5492999999999999e-05 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729091+0000", 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6826999999999999e-05 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.729109+0000", 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8082999999999999e-05 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.730562+0000", 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014521650000000001 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.730633+0000", 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1371999999999994e-05 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734166+0000", 2024-09-05T17:33:31.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035330409999999998 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.734313+0000", 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000147329 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131021 3.1d 3:b8e5f2b9:::rbd_data.11402b8b869e.0000000000000028:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:31.382 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.585066079000001, 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055499939999999999, 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131021 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:31.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735055+0000", 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735057+0000", 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.48e-06 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735070+0000", 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2649999999999999e-05 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735096+0000", 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6169e-05 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735115+0000", 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9510000000000001e-05 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735264+0000", 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014859199999999999 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.735773+0000", 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00050910899999999999 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736061+0000", 2024-09-05T17:33:31.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028768400000000002 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.738111+0000", 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020503560000000001 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740357+0000", 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022460420000000002 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740501+0000", 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014409199999999999 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.740605+0000", 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010331 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.388 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131023 3.16 3:6b038a76:::rbd_data.11402b8b869e.0000000000000034:head [delete] snapc 11=[] ondisk+write+known_if_redirected+supports_pool_eio e149)", 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.583906562999999, 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051919840000000002, 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131023 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736214+0000", 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736217+0000", 2024-09-05T17:33:31.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.65e-06 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736251+0000", 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4196999999999998e-05 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736280+0000", 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9162999999999998e-05 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736301+0000", 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0605999999999999e-05 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736455+0000", 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015467599999999999 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.736893+0000", 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043734900000000002 2024-09-05T17:33:31.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.737198+0000", 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030568099999999998 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.738708+0000", 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001510017 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741137+0000", 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0024285940000000001 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741291+0000", 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000154382 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:11.741406+0000", 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114669 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.0.0:2446 3.1f e150/140 3:faf48eea:::rbd_data.1140f0d7121a.000000000000000a:10 v 150'398, mlcod=145'394)", 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.787120099999999, 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0067976139999999996, 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533001+0000", 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0699999999999996e-07 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533011+0000", 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8900000000000002e-06 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533043+0000", 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2087e-05 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533063+0000", 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9822000000000001e-05 2024-09-05T17:33:31.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533208+0000", 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014464600000000001 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.533272+0000", 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4103000000000006e-05 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.539697+0000", 2024-09-05T17:33:31.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064246700000000004 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:12.539798+0000", 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101489 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:131225 3.16 3:69c6feb6:::rbd_object_map.114076cffc4f:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151)", 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.723277672999998, 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0069276930000000004, 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 131225 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596843+0000", 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596845+0000", 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1579999999999999e-06 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596854+0000", 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5520000000000005e-06 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596873+0000", 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9584000000000001e-05 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596882+0000", 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1970000000000002e-06 2024-09-05T17:33:31.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596983+0000", 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100389 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.596993+0000", 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7399999999999999e-06 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.598936+0000", 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00194378 2024-09-05T17:33:31.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.599183+0000", 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024666100000000002 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.599622+0000", 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00043905000000000002 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.601834+0000", 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022117149999999999 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603493+0000", 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001659305 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603574+0000", 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0655000000000006e-05 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:13.603771+0000", 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019690699999999999 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4416.0:131791 3.2 e154/137 3:419d56ee:::rbd_data.11409622ac7f.0000000000000012:head v 154'1630, mlcod=154'1628)", 2024-09-05T17:33:31.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.535217481, 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0050827069999999997, 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784903+0000", 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784904+0000", 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1069999999999999e-06 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784917+0000", 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3181e-05 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784934+0000", 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6313000000000001e-05 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.784944+0000", 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9699999999999994e-06 2024-09-05T17:33:31.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.785012+0000", 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8520000000000001e-05 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.785037+0000", 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4592000000000001e-05 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.789909+0000", 2024-09-05T17:33:31.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048723250000000003 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:16.789986+0000", 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699000000000005e-05 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4178 3.2 e155/137 3:4482663b:::rbd_data.11404462ede9.0000000000000014:b v 155'1632, mlcod=154'1629)", 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:31.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.785356692000001, 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082424190000000008, 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:31.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534764+0000", 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.1100000000000001e-07 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534770+0000", 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3839999999999996e-06 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534784+0000", 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4222e-05 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534794+0000", 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.747e-06 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534890+0000", 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6504999999999998e-05 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.534916+0000", 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5290999999999999e-05 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.542959+0000", 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0080430780000000004 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.543006+0000", 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7781000000000002e-05 2024-09-05T17:33:31.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(osd.3.0:4179 3.2 e155/137 3:46161760:::rbd_data.11404462ede9.000000000000000f:b v 155'1634, mlcod=154'1629)", 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.784353502, 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0086053929999999994, 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535767+0000", 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535768+0000", 2024-09-05T17:33:31.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8299999999999995e-07 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535775+0000", 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2180000000000002e-06 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535790+0000", 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4747e-05 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.535799+0000", 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2189999999999993e-06 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.538573+0000", 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027734000000000001 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.538648+0000", 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4895999999999996e-05 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.544249+0000", 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056014649999999999 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:17.544373+0000", 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012346500000000001 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:132362 3.16 3:6d63474f:::rbd_object_map.11403aa71fdc:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e160)", 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.7650775129999996, 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063657380000000001, 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 132362 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555043+0000", 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555047+0000", 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.433e-06 2024-09-05T17:33:31.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555062+0000", 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5302999999999999e-05 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555096+0000", 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3717000000000003e-05 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555118+0000", 2024-09-05T17:33:31.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2626e-05 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555302+0000", 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000183322 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.555541+0000", 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000239881 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.556037+0000", 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00049596000000000004 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.557808+0000", 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017707790000000001 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561115+0000", 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033072919999999999 2024-09-05T17:33:31.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561286+0000", 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017058199999999999 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:22.561409+0000", 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000122843 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:133232 3.5 3:a1ae3468:::rbd_header.1140e4c51ead:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e165)", 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:27.525112+0000", 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.79500861, 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010189236000000001, 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 133232 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.427 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.525112+0000", 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.525112+0000", 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.525116+0000", 2024-09-05T17:33:31.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8029999999999998e-06 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.525131+0000", 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5163e-05 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.525177+0000", 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5732999999999997e-05 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.525202+0000", 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.499e-05 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.525354+0000", 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015274900000000001 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.525373+0000", 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.874e-05 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.531589+0000", 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062156019999999998 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.531838+0000", 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024881099999999999 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.532874+0000", 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001036662 2024-09-05T17:33:31.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.534433+0000", 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015584170000000001 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.535004+0000", 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00057115900000000001 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.535174+0000", 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017036199999999999 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.535301+0000", 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127045 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4416.0:133236 3.5 3:a1ae3468:::rbd_header.1140e4c51ead:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e165)", 2024-09-05T17:33:31.433 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-05T17:33:27.541406+0000", 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.7787151200000002, 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087270509999999996, 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4416", 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.50:0/3911918176", 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 133236 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-05T17:33:31.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.541406+0000", 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.541406+0000", 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.541408+0000", 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4760000000000001e-06 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.541419+0000", 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1423999999999999e-05 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.541450+0000", 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0079000000000001e-05 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.541464+0000", 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4790000000000001e-05 2024-09-05T17:33:31.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.541601+0000", 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013648600000000001 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.541742+0000", 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014161800000000001 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-05T17:33:31.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.542152+0000", 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00041004700000000003 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.549612+0000", 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0074597049999999996 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.549850+0000", 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000238275 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.550017+0000", 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016620799999999999 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-05T17:33:27.550133+0000", 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115943 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-05T17:33:31.439 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-05T17:33:31.893 INFO:teuthology.orchestra.run.smithi050.stderr:nodeep-scrub is unset 2024-09-05T17:33:31.900 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-05T17:33:31.925 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-05T17:33:32.520 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.1 to 1 (10000) 2024-09-05T17:33:32.548 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-05T17:33:33.523 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-05T17:33:33.550 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-05T17:33:34.538 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.2 to 1 (10000) 2024-09-05T17:33:34.565 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-05T17:33:35.534 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-05T17:33:35.563 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-05T17:33:36.557 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.3 to 1 (10000) 2024-09-05T17:33:36.581 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-05T17:33:37.553 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-05T17:33:37.582 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-05T17:33:38.564 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.4 to 1 (10000) 2024-09-05T17:33:38.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-05T17:33:39.575 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-05T17:33:39.605 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-05T17:33:40.588 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.6 to 1 (10000) 2024-09-05T17:33:40.616 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-05T17:33:41.605 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-05T17:33:41.632 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-05T17:33:42.614 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.7 to 1 (10000) 2024-09-05T17:33:42.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-05T17:33:43.616 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-05T17:33:43.643 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-05T17:33:44.633 INFO:teuthology.orchestra.run.smithi050.stderr:reweighted osd.5 to 1 (10000) 2024-09-05T17:33:44.659 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-05T17:33:45.641 INFO:teuthology.orchestra.run.smithi050.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-05T17:33:45.666 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-05T17:33:45.666 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-05T17:33:45.666 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-05T17:33:45.666 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-05T17:33:45.666 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-05T17:33:45.667 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T17:33:45.984 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:45.984 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":181,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:33:45.633028+0000","last_up_change":"2024-09-05T17:32:59.859041+0000","last_in_change":"2024-09-05T17:32:09.963211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T17:30:25.818485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-05T17:30:30.943478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-05T17:30:42.082168+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":44,"snap_epoch":165,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6825","nonce":1446480840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6827","nonce":1446480840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6831","nonce":1446480840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6829","nonce":1446480840}]},"public_addr":"172.21.15.50:6825/1446480840","cluster_addr":"172.21.15.50:6827/1446480840","heartbeat_back_addr":"172.21.15.50:6831/1446480840","heartbeat_front_addr":"172.21.15.50:6829/1446480840","state":["exists","up"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6809","nonce":3885625462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6811","nonce":3885625462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6815","nonce":3885625462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6813","nonce":3885625462}]},"public_addr":"172.21.15.50:6809/3885625462","cluster_addr":"172.21.15.50:6811/3885625462","heartbeat_back_addr":"172.21.15.50:6815/3885625462","heartbeat_front_addr":"172.21.15.50:6813/3885625462","state":["exists","up"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6801","nonce":3027840955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6803","nonce":3027840955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6807","nonce":3027840955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6805","nonce":3027840955}]},"public_addr":"172.21.15.50:6801/3027840955","cluster_addr":"172.21.15.50:6803/3027840955","heartbeat_back_addr":"172.21.15.50:6807/3027840955","heartbeat_front_addr":"172.21.15.50:6805/3027840955","state":["exists","up"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6817","nonce":2889879466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6819","nonce":2889879466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6823","nonce":2889879466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6821","nonce":2889879466}]},"public_addr":"172.21.15.50:6817/2889879466","cluster_addr":"172.21.15.50:6819/2889879466","heartbeat_back_addr":"172.21.15.50:6823/2889879466","heartbeat_front_addr":"172.21.15.50:6821/2889879466","state":["exists","up"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6809","nonce":1774319792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6811","nonce":1774319792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6815","nonce":1774319792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6813","nonce":1774319792}]},"public_addr":"172.21.15.110:6809/1774319792","cluster_addr":"172.21.15.110:6811/1774319792","heartbeat_back_addr":"172.21.15.110:6815/1774319792","heartbeat_front_addr":"172.21.15.110:6813/1774319792","state":["exists","up"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":103,"up_from":137,"up_thru":140,"down_at":104,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6817","nonce":1996346700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6819","nonce":1996346700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6823","nonce":1996346700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6821","nonce":1996346700}]},"public_addr":"172.21.15.110:6817/1996346700","cluster_addr":"172.21.15.110:6819/1996346700","heartbeat_back_addr":"172.21.15.110:6823/1996346700","heartbeat_front_addr":"172.21.15.110:6821/1996346700","state":["exists","up"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6825","nonce":792585226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6827","nonce":792585226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6831","nonce":792585226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6829","nonce":792585226}]},"public_addr":"172.21.15.110:6825/792585226","cluster_addr":"172.21.15.110:6827/792585226","heartbeat_back_addr":"172.21.15.110:6831/792585226","heartbeat_front_addr":"172.21.15.110:6829/792585226","state":["exists","up"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6801","nonce":2161010500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6803","nonce":2161010500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6807","nonce":2161010500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6805","nonce":2161010500}]},"public_addr":"172.21.15.110:6801/2161010500","cluster_addr":"172.21.15.110:6803/2161010500","heartbeat_back_addr":"172.21.15.110:6807/2161010500","heartbeat_front_addr":"172.21.15.110:6805/2161010500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:22.246726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.638940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.694544+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.653253+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.467561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.797765+0000","dead_epoch":104},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.649372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.242988+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,7]},{"pgid":"3.10","osds":[1,7]}],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:33:46.005 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-05T17:33:46.005 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T17:33:46.309 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:46.309 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":181,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:33:45.633028+0000","last_up_change":"2024-09-05T17:32:59.859041+0000","last_in_change":"2024-09-05T17:32:09.963211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T17:30:25.818485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-05T17:30:30.943478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-05T17:30:42.082168+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":44,"snap_epoch":165,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6825","nonce":1446480840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6827","nonce":1446480840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6831","nonce":1446480840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6829","nonce":1446480840}]},"public_addr":"172.21.15.50:6825/1446480840","cluster_addr":"172.21.15.50:6827/1446480840","heartbeat_back_addr":"172.21.15.50:6831/1446480840","heartbeat_front_addr":"172.21.15.50:6829/1446480840","state":["exists","up"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6809","nonce":3885625462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6811","nonce":3885625462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6815","nonce":3885625462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6813","nonce":3885625462}]},"public_addr":"172.21.15.50:6809/3885625462","cluster_addr":"172.21.15.50:6811/3885625462","heartbeat_back_addr":"172.21.15.50:6815/3885625462","heartbeat_front_addr":"172.21.15.50:6813/3885625462","state":["exists","up"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6801","nonce":3027840955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6803","nonce":3027840955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6807","nonce":3027840955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6805","nonce":3027840955}]},"public_addr":"172.21.15.50:6801/3027840955","cluster_addr":"172.21.15.50:6803/3027840955","heartbeat_back_addr":"172.21.15.50:6807/3027840955","heartbeat_front_addr":"172.21.15.50:6805/3027840955","state":["exists","up"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6817","nonce":2889879466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6819","nonce":2889879466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6823","nonce":2889879466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6821","nonce":2889879466}]},"public_addr":"172.21.15.50:6817/2889879466","cluster_addr":"172.21.15.50:6819/2889879466","heartbeat_back_addr":"172.21.15.50:6823/2889879466","heartbeat_front_addr":"172.21.15.50:6821/2889879466","state":["exists","up"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6809","nonce":1774319792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6811","nonce":1774319792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6815","nonce":1774319792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6813","nonce":1774319792}]},"public_addr":"172.21.15.110:6809/1774319792","cluster_addr":"172.21.15.110:6811/1774319792","heartbeat_back_addr":"172.21.15.110:6815/1774319792","heartbeat_front_addr":"172.21.15.110:6813/1774319792","state":["exists","up"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":103,"up_from":137,"up_thru":140,"down_at":104,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6817","nonce":1996346700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6819","nonce":1996346700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6823","nonce":1996346700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6821","nonce":1996346700}]},"public_addr":"172.21.15.110:6817/1996346700","cluster_addr":"172.21.15.110:6819/1996346700","heartbeat_back_addr":"172.21.15.110:6823/1996346700","heartbeat_front_addr":"172.21.15.110:6821/1996346700","state":["exists","up"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6825","nonce":792585226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6827","nonce":792585226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6831","nonce":792585226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6829","nonce":792585226}]},"public_addr":"172.21.15.110:6825/792585226","cluster_addr":"172.21.15.110:6827/792585226","heartbeat_back_addr":"172.21.15.110:6831/792585226","heartbeat_front_addr":"172.21.15.110:6829/792585226","state":["exists","up"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6801","nonce":2161010500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6803","nonce":2161010500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6807","nonce":2161010500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6805","nonce":2161010500}]},"public_addr":"172.21.15.110:6801/2161010500","cluster_addr":"172.21.15.110:6803/2161010500","heartbeat_back_addr":"172.21.15.110:6807/2161010500","heartbeat_front_addr":"172.21.15.110:6805/2161010500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:22.246726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.638940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.694544+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.653253+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.467561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.797765+0000","dead_epoch":104},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.649372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.242988+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,7]},{"pgid":"3.10","osds":[1,7]}],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:33:46.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-05T17:33:46.329 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-05T17:33:46.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-05T17:33:46.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-05T17:33:46.330 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-05T17:33:46.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-05T17:33:46.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-05T17:33:46.331 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-05T17:33:46.574 INFO:teuthology.orchestra.run.smithi050.stdout:588410519563 2024-09-05T17:33:46.574 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-05T17:33:46.585 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:46.585 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-05T17:33:46.598 INFO:teuthology.orchestra.run.smithi050.stdout:60129542189 2024-09-05T17:33:46.598 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T17:33:46.599 INFO:teuthology.orchestra.run.smithi050.stdout:60129542189 2024-09-05T17:33:46.600 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T17:33:46.604 INFO:teuthology.orchestra.run.smithi050.stdout:60129542189 2024-09-05T17:33:46.604 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-05T17:33:46.613 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:46.613 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-05T17:33:46.626 INFO:teuthology.orchestra.run.smithi050.stdout:60129542189 2024-09-05T17:33:46.626 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-05T17:33:46.627 INFO:teuthology.orchestra.run.smithi050.stdout:60129542187 2024-09-05T17:33:46.628 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-05T17:33:47.070 INFO:teuthology.orchestra.run.smithi050.stdout:588410519562 2024-09-05T17:33:47.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 588410519563 got 588410519562 for osd.5 2024-09-05T17:33:47.111 INFO:teuthology.orchestra.run.smithi050.stdout:60129542187 2024-09-05T17:33:47.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542188 got 60129542187 for osd.0 2024-09-05T17:33:47.147 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:47.159 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:47.161 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:47.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.7 2024-09-05T17:33:47.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.2 2024-09-05T17:33:47.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.3 2024-09-05T17:33:47.214 INFO:teuthology.orchestra.run.smithi050.stdout:60129542186 2024-09-05T17:33:47.218 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:47.222 INFO:teuthology.orchestra.run.smithi050.stdout:60129542187 2024-09-05T17:33:47.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542187 got 60129542186 for osd.4 2024-09-05T17:33:47.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.6 2024-09-05T17:33:47.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542188 got 60129542187 for osd.1 2024-09-05T17:33:48.098 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-05T17:33:48.131 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-05T17:33:48.167 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T17:33:48.182 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T17:33:48.190 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-05T17:33:48.239 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-05T17:33:48.241 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-05T17:33:48.244 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-05T17:33:48.478 INFO:teuthology.orchestra.run.smithi050.stderr:2024-09-05T17:33:48.476+0000 7f6db5f74640 0 --2- 172.21.15.50:0/398930485 >> v2:172.21.15.50:3300/0 conn(0x7f6db00b1450 0x7f6db0071b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-05T17:33:48.590 INFO:teuthology.orchestra.run.smithi050.stdout:588410519562 2024-09-05T17:33:48.597 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:48.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 588410519563 got 588410519562 for osd.5 2024-09-05T17:33:48.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.7 2024-09-05T17:33:48.652 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:48.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542188 for osd.2 2024-09-05T17:33:48.714 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:48.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542188 got 60129542188 for osd.1 2024-09-05T17:33:48.731 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:48.741 INFO:teuthology.orchestra.run.smithi050.stdout:60129542188 2024-09-05T17:33:48.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542188 got 60129542188 for osd.0 2024-09-05T17:33:48.759 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:48.766 INFO:teuthology.orchestra.run.smithi050.stdout:60129542187 2024-09-05T17:33:48.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542187 got 60129542187 for osd.4 2024-09-05T17:33:48.784 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:48.787 INFO:teuthology.orchestra.run.smithi050.stdout:60129542189 2024-09-05T17:33:48.804 INFO:teuthology.orchestra.run.smithi050.stdout:60129542189 2024-09-05T17:33:48.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542189 for osd.3 2024-09-05T17:33:48.805 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:48.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542189 for osd.6 2024-09-05T17:33:48.821 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:49.623 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-05T17:33:49.629 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-05T17:33:49.684 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-05T17:33:49.950 INFO:teuthology.orchestra.run.smithi050.stdout:588410519563 2024-09-05T17:33:49.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 588410519563 got 588410519563 for osd.5 2024-09-05T17:33:49.969 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:49.984 INFO:teuthology.orchestra.run.smithi050.stdout:60129542189 2024-09-05T17:33:50.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542189 for osd.7 2024-09-05T17:33:50.003 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:50.012 INFO:teuthology.orchestra.run.smithi050.stdout:60129542189 2024-09-05T17:33:50.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542189 got 60129542189 for osd.2 2024-09-05T17:33:50.031 DEBUG:teuthology.parallel:result is None 2024-09-05T17:33:50.031 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-05T17:33:50.032 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:33:50.377 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:50.378 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:33:50.396 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-05T17:33:49.823756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":28,"num_read":174655,"num_read_kb":806072,"num_write":23876,"num_write_kb":365620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2618,"num_bytes_recovered":110632872,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20021,"ondisk_log_size":20021,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":389352,"kb_used_data":17112,"kb_used_omap":38,"kb_used_meta":371993,"kb_avail":754585368,"statfs":{"total":773094113280,"available":772695416832,"internally_reserved":0,"allocated":17522688,"data_stored":9573586,"data_compressed":12002,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":39856,"internal_metadata":380920912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001622"},"pg_stats":[{"pgid":"3.1f","version":"165'448","reported_seq":3525,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637770+0000","last_change":"2024-09-05T17:33:27.528018+0000","last_active":"2024-09-05T17:33:44.637770+0000","last_peered":"2024-09-05T17:33:44.637770+0000","last_clean":"2024-09-05T17:33:44.637770+0000","last_became_active":"2024-09-05T17:33:03.518878+0000","last_became_peered":"2024-09-05T17:33:03.518878+0000","last_unstale":"2024-09-05T17:33:44.637770+0000","last_undegraded":"2024-09-05T17:33:44.637770+0000","last_fullsized":"2024-09-05T17:33:44.637770+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:23:49.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047849989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3196,"num_read_kb":16881,"num_write":523,"num_write_kb":14009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":8881682,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'338","reported_seq":2202,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640496+0000","last_change":"2024-09-05T17:33:27.523243+0000","last_active":"2024-09-05T17:33:45.640496+0000","last_peered":"2024-09-05T17:33:45.640496+0000","last_clean":"2024-09-05T17:33:45.640496+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:33:45.640496+0000","last_undegraded":"2024-09-05T17:33:45.640496+0000","last_fullsized":"2024-09-05T17:33:45.640496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:31:29.837874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014678029999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2321,"num_read_kb":10748,"num_write":345,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"163'555","reported_seq":3395,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642209+0000","last_change":"2024-09-05T17:33:27.533144+0000","last_active":"2024-09-05T17:33:46.642209+0000","last_peered":"2024-09-05T17:33:46.642209+0000","last_clean":"2024-09-05T17:33:46.642209+0000","last_became_active":"2024-09-05T17:33:00.876268+0000","last_became_peered":"2024-09-05T17:33:00.876268+0000","last_unstale":"2024-09-05T17:33:46.642209+0000","last_undegraded":"2024-09-05T17:33:46.642209+0000","last_fullsized":"2024-09-05T17:33:46.642209+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:13:54.593252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030898620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3969,"num_read_kb":19900,"num_write":584,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"165'540","reported_seq":3720,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.653403+0000","last_change":"2024-09-05T17:33:46.653096+0000","last_active":"2024-09-05T17:33:46.653403+0000","last_peered":"2024-09-05T17:33:46.653403+0000","last_clean":"2024-09-05T17:33:46.653403+0000","last_became_active":"2024-09-05T17:33:46.648777+0000","last_became_peered":"2024-09-05T17:33:46.648777+0000","last_unstale":"2024-09-05T17:33:46.653403+0000","last_undegraded":"2024-09-05T17:33:46.653403+0000","last_fullsized":"2024-09-05T17:33:46.653403+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:53.109193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033133500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3871,"num_read_kb":20517,"num_write":615,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":4255396,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"164'442","reported_seq":2437,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637931+0000","last_change":"2024-09-05T17:33:27.527618+0000","last_active":"2024-09-05T17:33:44.637931+0000","last_peered":"2024-09-05T17:33:44.637931+0000","last_clean":"2024-09-05T17:33:44.637931+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:33:44.637931+0000","last_undegraded":"2024-09-05T17:33:44.637931+0000","last_fullsized":"2024-09-05T17:33:44.637931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:01:30.400215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045349270000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2391,"num_read_kb":34006,"num_write":458,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'699","reported_seq":6288,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645000+0000","last_change":"2024-09-05T17:33:40.601569+0000","last_active":"2024-09-05T17:33:45.645000+0000","last_peered":"2024-09-05T17:33:45.645000+0000","last_clean":"2024-09-05T17:33:45.645000+0000","last_became_active":"2024-09-05T17:33:40.597916+0000","last_became_peered":"2024-09-05T17:33:40.597916+0000","last_unstale":"2024-09-05T17:33:45.645000+0000","last_undegraded":"2024-09-05T17:33:45.645000+0000","last_fullsized":"2024-09-05T17:33:45.645000+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:58.940343+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0011638989999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7746,"num_read_kb":18821,"num_write":755,"num_write_kb":4676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'604","reported_seq":8201,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640909+0000","last_change":"2024-09-05T17:33:27.559356+0000","last_active":"2024-09-05T17:33:45.640909+0000","last_peered":"2024-09-05T17:33:45.640909+0000","last_clean":"2024-09-05T17:33:45.640909+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:33:45.640909+0000","last_undegraded":"2024-09-05T17:33:45.640909+0000","last_fullsized":"2024-09-05T17:33:45.640909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:44.836387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014326129999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":8628,"num_read_kb":37043,"num_write":694,"num_write_kb":9672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"165'465","reported_seq":2892,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640172+0000","last_change":"2024-09-05T17:33:27.522871+0000","last_active":"2024-09-05T17:33:45.640172+0000","last_peered":"2024-09-05T17:33:45.640172+0000","last_clean":"2024-09-05T17:33:45.640172+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:33:45.640172+0000","last_undegraded":"2024-09-05T17:33:45.640172+0000","last_fullsized":"2024-09-05T17:33:45.640172+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:33:41.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012170869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2261,"num_read_kb":32589,"num_write":546,"num_write_kb":10681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"164'767","reported_seq":2768,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637680+0000","last_change":"2024-09-05T17:33:27.526380+0000","last_active":"2024-09-05T17:33:44.637680+0000","last_peered":"2024-09-05T17:33:44.637680+0000","last_clean":"2024-09-05T17:33:44.637680+0000","last_became_active":"2024-09-05T17:33:00.882325+0000","last_became_peered":"2024-09-05T17:33:00.882325+0000","last_unstale":"2024-09-05T17:33:44.637680+0000","last_undegraded":"2024-09-05T17:33:44.637680+0000","last_fullsized":"2024-09-05T17:33:44.637680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:31:39.064715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036302930000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3604,"num_read_kb":12753,"num_write":1031,"num_write_kb":5567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":2814153,"num_keys_recovered":25,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"164'785","reported_seq":2033,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642380+0000","last_change":"2024-09-05T17:33:27.536152+0000","last_active":"2024-09-05T17:33:46.642380+0000","last_peered":"2024-09-05T17:33:46.642380+0000","last_clean":"2024-09-05T17:33:46.642380+0000","last_became_active":"2024-09-05T17:33:00.872821+0000","last_became_peered":"2024-09-05T17:33:00.872821+0000","last_unstale":"2024-09-05T17:33:46.642380+0000","last_undegraded":"2024-09-05T17:33:46.642380+0000","last_fullsized":"2024-09-05T17:33:46.642380+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:11:07.066264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104290000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4301,"num_read_kb":14291,"num_write":964,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'320","reported_seq":1610,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.070967+0000","last_change":"2024-09-05T17:33:27.558751+0000","last_active":"2024-09-05T17:33:46.070967+0000","last_peered":"2024-09-05T17:33:46.070967+0000","last_clean":"2024-09-05T17:33:46.070967+0000","last_became_active":"2024-09-05T17:33:22.534475+0000","last_became_peered":"2024-09-05T17:33:22.534475+0000","last_unstale":"2024-09-05T17:33:46.070967+0000","last_undegraded":"2024-09-05T17:33:46.070967+0000","last_fullsized":"2024-09-05T17:33:46.070967+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:38:47.387024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012121090000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":845,"num_read_kb":16276,"num_write":252,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":569030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"164'500","reported_seq":14602,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.646061+0000","last_change":"2024-09-05T17:33:40.605573+0000","last_active":"2024-09-05T17:33:45.646061+0000","last_peered":"2024-09-05T17:33:45.646061+0000","last_clean":"2024-09-05T17:33:45.646061+0000","last_became_active":"2024-09-05T17:33:40.603253+0000","last_became_peered":"2024-09-05T17:33:40.603253+0000","last_unstale":"2024-09-05T17:33:45.646061+0000","last_undegraded":"2024-09-05T17:33:45.646061+0000","last_fullsized":"2024-09-05T17:33:45.646061+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:39:38.233465+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.007672519,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":15151,"num_read_kb":37250,"num_write":448,"num_write_kb":4447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":336,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637843+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:33:44.637843+0000","last_peered":"2024-09-05T17:33:44.637843+0000","last_clean":"2024-09-05T17:33:44.637843+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:33:44.637843+0000","last_undegraded":"2024-09-05T17:33:44.637843+0000","last_fullsized":"2024-09-05T17:33:44.637843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"165'524","reported_seq":6007,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637638+0000","last_change":"2024-09-05T17:33:27.527118+0000","last_active":"2024-09-05T17:33:44.637638+0000","last_peered":"2024-09-05T17:33:44.637638+0000","last_clean":"2024-09-05T17:33:44.637638+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:33:44.637638+0000","last_undegraded":"2024-09-05T17:33:44.637638+0000","last_fullsized":"2024-09-05T17:33:44.637638+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:24:22.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042900200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6499,"num_read_kb":26402,"num_write":438,"num_write_kb":8494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641478+0000","last_change":"2024-09-05T17:33:33.531154+0000","last_active":"2024-09-05T17:33:45.641478+0000","last_peered":"2024-09-05T17:33:45.641478+0000","last_clean":"2024-09-05T17:33:45.641478+0000","last_became_active":"2024-09-05T17:33:33.530723+0000","last_became_peered":"2024-09-05T17:33:33.530723+0000","last_unstale":"2024-09-05T17:33:45.641478+0000","last_undegraded":"2024-09-05T17:33:45.641478+0000","last_fullsized":"2024-09-05T17:33:45.641478+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:09:48.381008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"163'457","reported_seq":1960,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637979+0000","last_change":"2024-09-05T17:33:27.562400+0000","last_active":"2024-09-05T17:33:44.637979+0000","last_peered":"2024-09-05T17:33:44.637979+0000","last_clean":"2024-09-05T17:33:44.637979+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:33:44.637979+0000","last_undegraded":"2024-09-05T17:33:44.637979+0000","last_fullsized":"2024-09-05T17:33:44.637979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:13:25.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002227845,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1548,"num_read_kb":31708,"num_write":526,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":351,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402319+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:33:46.402319+0000","last_peered":"2024-09-05T17:33:46.402319+0000","last_clean":"2024-09-05T17:33:46.402319+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:33:46.402319+0000","last_undegraded":"2024-09-05T17:33:46.402319+0000","last_fullsized":"2024-09-05T17:33:46.402319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'780","reported_seq":3961,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641117+0000","last_change":"2024-09-05T17:33:27.559456+0000","last_active":"2024-09-05T17:33:45.641117+0000","last_peered":"2024-09-05T17:33:45.641117+0000","last_clean":"2024-09-05T17:33:45.641117+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:33:45.641117+0000","last_undegraded":"2024-09-05T17:33:45.641117+0000","last_fullsized":"2024-09-05T17:33:45.641117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:35:34.672356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154923,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6341,"num_read_kb":21039,"num_write":1016,"num_write_kb":10164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641317+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:33:45.641317+0000","last_peered":"2024-09-05T17:33:45.641317+0000","last_clean":"2024-09-05T17:33:45.641317+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:33:45.641317+0000","last_undegraded":"2024-09-05T17:33:45.641317+0000","last_fullsized":"2024-09-05T17:33:45.641317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"165'567","reported_seq":2194,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642508+0000","last_change":"2024-09-05T17:33:27.537861+0000","last_active":"2024-09-05T17:33:46.642508+0000","last_peered":"2024-09-05T17:33:46.642508+0000","last_clean":"2024-09-05T17:33:46.642508+0000","last_became_active":"2024-09-05T17:33:00.880861+0000","last_became_peered":"2024-09-05T17:33:00.880861+0000","last_unstale":"2024-09-05T17:33:46.642508+0000","last_undegraded":"2024-09-05T17:33:46.642508+0000","last_fullsized":"2024-09-05T17:33:46.642508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:06:13.457185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070026660000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3321,"num_read_kb":48513,"num_write":581,"num_write_kb":29613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":14386340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"165'646","reported_seq":7498,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645392+0000","last_change":"2024-09-05T17:33:40.602148+0000","last_active":"2024-09-05T17:33:45.645392+0000","last_peered":"2024-09-05T17:33:45.645392+0000","last_clean":"2024-09-05T17:33:45.645392+0000","last_became_active":"2024-09-05T17:33:40.596831+0000","last_became_peered":"2024-09-05T17:33:40.596831+0000","last_unstale":"2024-09-05T17:33:45.645392+0000","last_undegraded":"2024-09-05T17:33:45.645392+0000","last_fullsized":"2024-09-05T17:33:45.645392+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:30:06.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034718079999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7401,"num_read_kb":46805,"num_write":650,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":118,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.648400+0000","last_change":"2024-09-05T17:33:46.648152+0000","last_active":"2024-09-05T17:33:46.648400+0000","last_peered":"2024-09-05T17:33:46.648400+0000","last_clean":"2024-09-05T17:33:46.648400+0000","last_became_active":"2024-09-05T17:33:46.647362+0000","last_became_peered":"2024-09-05T17:33:46.647362+0000","last_unstale":"2024-09-05T17:33:46.648400+0000","last_undegraded":"2024-09-05T17:33:46.648400+0000","last_fullsized":"2024-09-05T17:33:46.648400+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:37:29.442303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"164'1413","reported_seq":3826,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641040+0000","last_change":"2024-09-05T17:33:27.560376+0000","last_active":"2024-09-05T17:33:45.641040+0000","last_peered":"2024-09-05T17:33:45.641040+0000","last_clean":"2024-09-05T17:33:45.641040+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:33:45.641040+0000","last_undegraded":"2024-09-05T17:33:45.641040+0000","last_fullsized":"2024-09-05T17:33:45.641040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1413,"log_dups_size":0,"ondisk_log_size":1413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:29:58.319332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002241706,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8376,"num_read_kb":10426,"num_write":2211,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":336,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.071049+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:33:46.071049+0000","last_peered":"2024-09-05T17:33:46.071049+0000","last_clean":"2024-09-05T17:33:46.071049+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:33:46.071049+0000","last_undegraded":"2024-09-05T17:33:46.071049+0000","last_fullsized":"2024-09-05T17:33:46.071049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'629","reported_seq":9157,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637514+0000","last_change":"2024-09-05T17:33:27.525383+0000","last_active":"2024-09-05T17:33:44.637514+0000","last_peered":"2024-09-05T17:33:44.637514+0000","last_clean":"2024-09-05T17:33:44.637514+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:33:44.637514+0000","last_undegraded":"2024-09-05T17:33:44.637514+0000","last_fullsized":"2024-09-05T17:33:44.637514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:42.369588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003039473,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":10304,"num_read_kb":44453,"num_write":657,"num_write_kb":11408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":363,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402054+0000","last_change":"2024-09-05T17:33:33.538285+0000","last_active":"2024-09-05T17:33:46.402054+0000","last_peered":"2024-09-05T17:33:46.402054+0000","last_clean":"2024-09-05T17:33:46.402054+0000","last_became_active":"2024-09-05T17:33:33.537690+0000","last_became_peered":"2024-09-05T17:33:33.537690+0000","last_unstale":"2024-09-05T17:33:46.402054+0000","last_undegraded":"2024-09-05T17:33:46.402054+0000","last_fullsized":"2024-09-05T17:33:46.402054+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:52.432612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"164'1672","reported_seq":5828,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.639959+0000","last_change":"2024-09-05T17:33:27.523383+0000","last_active":"2024-09-05T17:33:45.639959+0000","last_peered":"2024-09-05T17:33:45.639959+0000","last_clean":"2024-09-05T17:33:45.639959+0000","last_became_active":"2024-09-05T17:33:00.882030+0000","last_became_peered":"2024-09-05T17:33:00.882030+0000","last_unstale":"2024-09-05T17:33:45.639959+0000","last_undegraded":"2024-09-05T17:33:45.639959+0000","last_fullsized":"2024-09-05T17:33:45.639959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1672,"log_dups_size":0,"ondisk_log_size":1672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:58:05.278028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731130000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":11375,"num_read_kb":20355,"num_write":2804,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":4232019,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":204,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642068+0000","last_change":"2024-09-05T17:33:00.874549+0000","last_active":"2024-09-05T17:33:46.642068+0000","last_peered":"2024-09-05T17:33:46.642068+0000","last_clean":"2024-09-05T17:33:46.642068+0000","last_became_active":"2024-09-05T17:33:00.874107+0000","last_became_peered":"2024-09-05T17:33:00.874107+0000","last_unstale":"2024-09-05T17:33:46.642068+0000","last_undegraded":"2024-09-05T17:33:46.642068+0000","last_fullsized":"2024-09-05T17:33:46.642068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:27:19.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":454,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402240+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:33:46.402240+0000","last_peered":"2024-09-05T17:33:46.402240+0000","last_clean":"2024-09-05T17:33:46.402240+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:33:46.402240+0000","last_undegraded":"2024-09-05T17:33:46.402240+0000","last_fullsized":"2024-09-05T17:33:46.402240+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"165'371","reported_seq":3755,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.639962+0000","last_change":"2024-09-05T17:33:37.564245+0000","last_active":"2024-09-05T17:33:45.639962+0000","last_peered":"2024-09-05T17:33:45.639962+0000","last_clean":"2024-09-05T17:33:45.639962+0000","last_became_active":"2024-09-05T17:33:37.562005+0000","last_became_peered":"2024-09-05T17:33:37.562005+0000","last_unstale":"2024-09-05T17:33:45.639962+0000","last_undegraded":"2024-09-05T17:33:45.639962+0000","last_fullsized":"2024-09-05T17:33:45.639962+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:09:10.250677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020255859999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2194,"num_read_kb":22000,"num_write":372,"num_write_kb":23336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":10672151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"165'781","reported_seq":5293,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645020+0000","last_change":"2024-09-05T17:33:27.528354+0000","last_active":"2024-09-05T17:33:45.645020+0000","last_peered":"2024-09-05T17:33:45.645020+0000","last_clean":"2024-09-05T17:33:45.645020+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:33:45.645020+0000","last_undegraded":"2024-09-05T17:33:45.645020+0000","last_fullsized":"2024-09-05T17:33:45.645020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:21:45.713020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030988410000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":7390,"num_read_kb":22417,"num_write":1016,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'577","reported_seq":4382,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637617+0000","last_change":"2024-09-05T17:33:27.562550+0000","last_active":"2024-09-05T17:33:44.637617+0000","last_peered":"2024-09-05T17:33:44.637617+0000","last_clean":"2024-09-05T17:33:44.637617+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:33:44.637617+0000","last_undegraded":"2024-09-05T17:33:44.637617+0000","last_fullsized":"2024-09-05T17:33:44.637617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:25:22.635469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00250161,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":4100,"num_read_kb":25746,"num_write":648,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'1097","reported_seq":11155,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640804+0000","last_change":"2024-09-05T17:33:27.523997+0000","last_active":"2024-09-05T17:33:45.640804+0000","last_peered":"2024-09-05T17:33:45.640804+0000","last_clean":"2024-09-05T17:33:45.640804+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:33:45.640804+0000","last_undegraded":"2024-09-05T17:33:45.640804+0000","last_fullsized":"2024-09-05T17:33:45.640804+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:12:41.390494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020407899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13753,"num_read_kb":37185,"num_write":1490,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"164'341","reported_seq":1345,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642162+0000","last_change":"2024-09-05T17:33:27.536025+0000","last_active":"2024-09-05T17:33:46.642162+0000","last_peered":"2024-09-05T17:33:46.642162+0000","last_clean":"2024-09-05T17:33:46.642162+0000","last_became_active":"2024-09-05T17:33:00.880726+0000","last_became_peered":"2024-09-05T17:33:00.880726+0000","last_unstale":"2024-09-05T17:33:46.642162+0000","last_undegraded":"2024-09-05T17:33:46.642162+0000","last_fullsized":"2024-09-05T17:33:46.642162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:50:36.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005949078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1859,"num_read_kb":26572,"num_write":297,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2323932,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"164'457","reported_seq":2327,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402198+0000","last_change":"2024-09-05T17:33:27.550025+0000","last_active":"2024-09-05T17:33:46.402198+0000","last_peered":"2024-09-05T17:33:46.402198+0000","last_clean":"2024-09-05T17:33:46.402198+0000","last_became_active":"2024-09-05T17:33:03.523083+0000","last_became_peered":"2024-09-05T17:33:03.523083+0000","last_unstale":"2024-09-05T17:33:46.402198+0000","last_undegraded":"2024-09-05T17:33:46.402198+0000","last_fullsized":"2024-09-05T17:33:46.402198+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:43:53.113722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066025220000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2520,"num_read_kb":18217,"num_write":450,"num_write_kb":14035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":5727979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'275","reported_seq":2431,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402534+0000","last_change":"2024-09-05T17:33:27.547453+0000","last_active":"2024-09-05T17:33:46.402534+0000","last_peered":"2024-09-05T17:33:46.402534+0000","last_clean":"2024-09-05T17:33:46.402534+0000","last_became_active":"2024-09-05T17:33:22.545834+0000","last_became_peered":"2024-09-05T17:33:22.545834+0000","last_unstale":"2024-09-05T17:33:46.402534+0000","last_undegraded":"2024-09-05T17:33:46.402534+0000","last_fullsized":"2024-09-05T17:33:46.402534+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:30:38.658230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045236249999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1479,"num_read_kb":36544,"num_write":267,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":281923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'494","reported_seq":4930,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402510+0000","last_change":"2024-09-05T17:33:27.548358+0000","last_active":"2024-09-05T17:33:46.402510+0000","last_peered":"2024-09-05T17:33:46.402510+0000","last_clean":"2024-09-05T17:33:46.402510+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:33:46.402510+0000","last_undegraded":"2024-09-05T17:33:46.402510+0000","last_fullsized":"2024-09-05T17:33:46.402510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:08:37.483626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054246379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5058,"num_read_kb":16620,"num_write":538,"num_write_kb":6033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"165'606","reported_seq":4843,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641025+0000","last_change":"2024-09-05T17:33:27.559853+0000","last_active":"2024-09-05T17:33:45.641025+0000","last_peered":"2024-09-05T17:33:45.641025+0000","last_clean":"2024-09-05T17:33:45.641025+0000","last_became_active":"2024-09-05T17:32:51.787759+0000","last_became_peered":"2024-09-05T17:32:51.787759+0000","last_unstale":"2024-09-05T17:33:45.641025+0000","last_undegraded":"2024-09-05T17:33:45.641025+0000","last_fullsized":"2024-09-05T17:33:45.641025+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:30:12.742477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897787,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5143,"num_read_kb":22219,"num_write":724,"num_write_kb":9428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":4462425,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"164'371","reported_seq":2100,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402089+0000","last_change":"2024-09-05T17:33:27.545860+0000","last_active":"2024-09-05T17:33:46.402089+0000","last_peered":"2024-09-05T17:33:46.402089+0000","last_clean":"2024-09-05T17:33:46.402089+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:33:46.402089+0000","last_undegraded":"2024-09-05T17:33:46.402089+0000","last_fullsized":"2024-09-05T17:33:46.402089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:41:24.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033971309999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1549,"num_read_kb":23623,"num_write":342,"num_write_kb":9257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"164'606","reported_seq":8785,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637457+0000","last_change":"2024-09-05T17:33:27.526697+0000","last_active":"2024-09-05T17:33:44.637457+0000","last_peered":"2024-09-05T17:33:44.637457+0000","last_clean":"2024-09-05T17:33:44.637457+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:33:44.637457+0000","last_undegraded":"2024-09-05T17:33:44.637457+0000","last_fullsized":"2024-09-05T17:33:44.637457+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:09:50.306527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042963640000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":9444,"num_read_kb":23607,"num_write":623,"num_write_kb":9519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'819","reported_seq":3413,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402190+0000","last_change":"2024-09-05T17:33:27.546665+0000","last_active":"2024-09-05T17:33:46.402190+0000","last_peered":"2024-09-05T17:33:46.402190+0000","last_clean":"2024-09-05T17:33:46.402190+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:33:46.402190+0000","last_undegraded":"2024-09-05T17:33:46.402190+0000","last_fullsized":"2024-09-05T17:33:46.402190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:43:32.759282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040029130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6651,"num_read_kb":10491,"num_write":908,"num_write_kb":5581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":28,"num_read":174589,"num_read_kb":806017,"num_write":23773,"num_write_kb":363990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2614,"num_bytes_recovered":109452136,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},"log_size":19946,"ondisk_log_size":19946,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41680,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330160,"statfs":{"total":96636764160,"available":96594083840,"internally_reserved":0,"allocated":2224128,"data_stored":1635018,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41624,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330216,"statfs":{"total":96636764160,"available":96594141184,"internally_reserved":0,"allocated":2166784,"data_stored":1044650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":137,"seq":588410519564,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35252,"kb_used_data":2144,"kb_used_omap":28,"kb_used_meta":33059,"kb_avail":94336588,"statfs":{"total":96636764160,"available":96600666112,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28700,"internal_metadata":33853412},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2183168,"data_stored":1050598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65264,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306576,"statfs":{"total":96636764160,"available":96569933824,"internally_reserved":0,"allocated":2179072,"data_stored":1050579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51372,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":2179072,"data_stored":1050579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55540,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316300,"statfs":{"total":96636764160,"available":96579891200,"internally_reserved":0,"allocated":2187264,"data_stored":1050617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47240,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324600,"statfs":{"total":96636764160,"available":96588390400,"internally_reserved":0,"allocated":2207744,"data_stored":1635018,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:33:50.399 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:33:50.701 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:50.702 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:33:50.718 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-05T17:33:49.823756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":28,"num_read":174655,"num_read_kb":806072,"num_write":23876,"num_write_kb":365620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2618,"num_bytes_recovered":110632872,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20021,"ondisk_log_size":20021,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":389352,"kb_used_data":17112,"kb_used_omap":38,"kb_used_meta":371993,"kb_avail":754585368,"statfs":{"total":773094113280,"available":772695416832,"internally_reserved":0,"allocated":17522688,"data_stored":9573586,"data_compressed":12002,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":39856,"internal_metadata":380920912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001622"},"pg_stats":[{"pgid":"3.1f","version":"165'448","reported_seq":3525,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637770+0000","last_change":"2024-09-05T17:33:27.528018+0000","last_active":"2024-09-05T17:33:44.637770+0000","last_peered":"2024-09-05T17:33:44.637770+0000","last_clean":"2024-09-05T17:33:44.637770+0000","last_became_active":"2024-09-05T17:33:03.518878+0000","last_became_peered":"2024-09-05T17:33:03.518878+0000","last_unstale":"2024-09-05T17:33:44.637770+0000","last_undegraded":"2024-09-05T17:33:44.637770+0000","last_fullsized":"2024-09-05T17:33:44.637770+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:23:49.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047849989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3196,"num_read_kb":16881,"num_write":523,"num_write_kb":14009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":8881682,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'338","reported_seq":2202,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640496+0000","last_change":"2024-09-05T17:33:27.523243+0000","last_active":"2024-09-05T17:33:45.640496+0000","last_peered":"2024-09-05T17:33:45.640496+0000","last_clean":"2024-09-05T17:33:45.640496+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:33:45.640496+0000","last_undegraded":"2024-09-05T17:33:45.640496+0000","last_fullsized":"2024-09-05T17:33:45.640496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:31:29.837874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014678029999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2321,"num_read_kb":10748,"num_write":345,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"163'555","reported_seq":3395,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642209+0000","last_change":"2024-09-05T17:33:27.533144+0000","last_active":"2024-09-05T17:33:46.642209+0000","last_peered":"2024-09-05T17:33:46.642209+0000","last_clean":"2024-09-05T17:33:46.642209+0000","last_became_active":"2024-09-05T17:33:00.876268+0000","last_became_peered":"2024-09-05T17:33:00.876268+0000","last_unstale":"2024-09-05T17:33:46.642209+0000","last_undegraded":"2024-09-05T17:33:46.642209+0000","last_fullsized":"2024-09-05T17:33:46.642209+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:13:54.593252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030898620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3969,"num_read_kb":19900,"num_write":584,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"165'540","reported_seq":3720,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.653403+0000","last_change":"2024-09-05T17:33:46.653096+0000","last_active":"2024-09-05T17:33:46.653403+0000","last_peered":"2024-09-05T17:33:46.653403+0000","last_clean":"2024-09-05T17:33:46.653403+0000","last_became_active":"2024-09-05T17:33:46.648777+0000","last_became_peered":"2024-09-05T17:33:46.648777+0000","last_unstale":"2024-09-05T17:33:46.653403+0000","last_undegraded":"2024-09-05T17:33:46.653403+0000","last_fullsized":"2024-09-05T17:33:46.653403+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:53.109193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033133500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3871,"num_read_kb":20517,"num_write":615,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":4255396,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"164'442","reported_seq":2437,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637931+0000","last_change":"2024-09-05T17:33:27.527618+0000","last_active":"2024-09-05T17:33:44.637931+0000","last_peered":"2024-09-05T17:33:44.637931+0000","last_clean":"2024-09-05T17:33:44.637931+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:33:44.637931+0000","last_undegraded":"2024-09-05T17:33:44.637931+0000","last_fullsized":"2024-09-05T17:33:44.637931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:01:30.400215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045349270000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2391,"num_read_kb":34006,"num_write":458,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'699","reported_seq":6288,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645000+0000","last_change":"2024-09-05T17:33:40.601569+0000","last_active":"2024-09-05T17:33:45.645000+0000","last_peered":"2024-09-05T17:33:45.645000+0000","last_clean":"2024-09-05T17:33:45.645000+0000","last_became_active":"2024-09-05T17:33:40.597916+0000","last_became_peered":"2024-09-05T17:33:40.597916+0000","last_unstale":"2024-09-05T17:33:45.645000+0000","last_undegraded":"2024-09-05T17:33:45.645000+0000","last_fullsized":"2024-09-05T17:33:45.645000+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:58.940343+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0011638989999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7746,"num_read_kb":18821,"num_write":755,"num_write_kb":4676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'604","reported_seq":8201,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640909+0000","last_change":"2024-09-05T17:33:27.559356+0000","last_active":"2024-09-05T17:33:45.640909+0000","last_peered":"2024-09-05T17:33:45.640909+0000","last_clean":"2024-09-05T17:33:45.640909+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:33:45.640909+0000","last_undegraded":"2024-09-05T17:33:45.640909+0000","last_fullsized":"2024-09-05T17:33:45.640909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:44.836387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014326129999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":8628,"num_read_kb":37043,"num_write":694,"num_write_kb":9672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"165'465","reported_seq":2892,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640172+0000","last_change":"2024-09-05T17:33:27.522871+0000","last_active":"2024-09-05T17:33:45.640172+0000","last_peered":"2024-09-05T17:33:45.640172+0000","last_clean":"2024-09-05T17:33:45.640172+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:33:45.640172+0000","last_undegraded":"2024-09-05T17:33:45.640172+0000","last_fullsized":"2024-09-05T17:33:45.640172+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:33:41.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012170869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2261,"num_read_kb":32589,"num_write":546,"num_write_kb":10681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"164'767","reported_seq":2768,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637680+0000","last_change":"2024-09-05T17:33:27.526380+0000","last_active":"2024-09-05T17:33:44.637680+0000","last_peered":"2024-09-05T17:33:44.637680+0000","last_clean":"2024-09-05T17:33:44.637680+0000","last_became_active":"2024-09-05T17:33:00.882325+0000","last_became_peered":"2024-09-05T17:33:00.882325+0000","last_unstale":"2024-09-05T17:33:44.637680+0000","last_undegraded":"2024-09-05T17:33:44.637680+0000","last_fullsized":"2024-09-05T17:33:44.637680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:31:39.064715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036302930000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3604,"num_read_kb":12753,"num_write":1031,"num_write_kb":5567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":2814153,"num_keys_recovered":25,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"164'785","reported_seq":2033,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642380+0000","last_change":"2024-09-05T17:33:27.536152+0000","last_active":"2024-09-05T17:33:46.642380+0000","last_peered":"2024-09-05T17:33:46.642380+0000","last_clean":"2024-09-05T17:33:46.642380+0000","last_became_active":"2024-09-05T17:33:00.872821+0000","last_became_peered":"2024-09-05T17:33:00.872821+0000","last_unstale":"2024-09-05T17:33:46.642380+0000","last_undegraded":"2024-09-05T17:33:46.642380+0000","last_fullsized":"2024-09-05T17:33:46.642380+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:11:07.066264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104290000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4301,"num_read_kb":14291,"num_write":964,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'320","reported_seq":1610,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.070967+0000","last_change":"2024-09-05T17:33:27.558751+0000","last_active":"2024-09-05T17:33:46.070967+0000","last_peered":"2024-09-05T17:33:46.070967+0000","last_clean":"2024-09-05T17:33:46.070967+0000","last_became_active":"2024-09-05T17:33:22.534475+0000","last_became_peered":"2024-09-05T17:33:22.534475+0000","last_unstale":"2024-09-05T17:33:46.070967+0000","last_undegraded":"2024-09-05T17:33:46.070967+0000","last_fullsized":"2024-09-05T17:33:46.070967+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:38:47.387024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012121090000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":845,"num_read_kb":16276,"num_write":252,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":569030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"164'500","reported_seq":14602,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.646061+0000","last_change":"2024-09-05T17:33:40.605573+0000","last_active":"2024-09-05T17:33:45.646061+0000","last_peered":"2024-09-05T17:33:45.646061+0000","last_clean":"2024-09-05T17:33:45.646061+0000","last_became_active":"2024-09-05T17:33:40.603253+0000","last_became_peered":"2024-09-05T17:33:40.603253+0000","last_unstale":"2024-09-05T17:33:45.646061+0000","last_undegraded":"2024-09-05T17:33:45.646061+0000","last_fullsized":"2024-09-05T17:33:45.646061+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:39:38.233465+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.007672519,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":15151,"num_read_kb":37250,"num_write":448,"num_write_kb":4447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":336,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637843+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:33:44.637843+0000","last_peered":"2024-09-05T17:33:44.637843+0000","last_clean":"2024-09-05T17:33:44.637843+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:33:44.637843+0000","last_undegraded":"2024-09-05T17:33:44.637843+0000","last_fullsized":"2024-09-05T17:33:44.637843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"165'524","reported_seq":6007,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637638+0000","last_change":"2024-09-05T17:33:27.527118+0000","last_active":"2024-09-05T17:33:44.637638+0000","last_peered":"2024-09-05T17:33:44.637638+0000","last_clean":"2024-09-05T17:33:44.637638+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:33:44.637638+0000","last_undegraded":"2024-09-05T17:33:44.637638+0000","last_fullsized":"2024-09-05T17:33:44.637638+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:24:22.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042900200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6499,"num_read_kb":26402,"num_write":438,"num_write_kb":8494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641478+0000","last_change":"2024-09-05T17:33:33.531154+0000","last_active":"2024-09-05T17:33:45.641478+0000","last_peered":"2024-09-05T17:33:45.641478+0000","last_clean":"2024-09-05T17:33:45.641478+0000","last_became_active":"2024-09-05T17:33:33.530723+0000","last_became_peered":"2024-09-05T17:33:33.530723+0000","last_unstale":"2024-09-05T17:33:45.641478+0000","last_undegraded":"2024-09-05T17:33:45.641478+0000","last_fullsized":"2024-09-05T17:33:45.641478+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:09:48.381008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"163'457","reported_seq":1960,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637979+0000","last_change":"2024-09-05T17:33:27.562400+0000","last_active":"2024-09-05T17:33:44.637979+0000","last_peered":"2024-09-05T17:33:44.637979+0000","last_clean":"2024-09-05T17:33:44.637979+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:33:44.637979+0000","last_undegraded":"2024-09-05T17:33:44.637979+0000","last_fullsized":"2024-09-05T17:33:44.637979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:13:25.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002227845,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1548,"num_read_kb":31708,"num_write":526,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":351,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402319+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:33:46.402319+0000","last_peered":"2024-09-05T17:33:46.402319+0000","last_clean":"2024-09-05T17:33:46.402319+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:33:46.402319+0000","last_undegraded":"2024-09-05T17:33:46.402319+0000","last_fullsized":"2024-09-05T17:33:46.402319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'780","reported_seq":3961,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641117+0000","last_change":"2024-09-05T17:33:27.559456+0000","last_active":"2024-09-05T17:33:45.641117+0000","last_peered":"2024-09-05T17:33:45.641117+0000","last_clean":"2024-09-05T17:33:45.641117+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:33:45.641117+0000","last_undegraded":"2024-09-05T17:33:45.641117+0000","last_fullsized":"2024-09-05T17:33:45.641117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:35:34.672356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154923,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6341,"num_read_kb":21039,"num_write":1016,"num_write_kb":10164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641317+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:33:45.641317+0000","last_peered":"2024-09-05T17:33:45.641317+0000","last_clean":"2024-09-05T17:33:45.641317+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:33:45.641317+0000","last_undegraded":"2024-09-05T17:33:45.641317+0000","last_fullsized":"2024-09-05T17:33:45.641317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"165'567","reported_seq":2194,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642508+0000","last_change":"2024-09-05T17:33:27.537861+0000","last_active":"2024-09-05T17:33:46.642508+0000","last_peered":"2024-09-05T17:33:46.642508+0000","last_clean":"2024-09-05T17:33:46.642508+0000","last_became_active":"2024-09-05T17:33:00.880861+0000","last_became_peered":"2024-09-05T17:33:00.880861+0000","last_unstale":"2024-09-05T17:33:46.642508+0000","last_undegraded":"2024-09-05T17:33:46.642508+0000","last_fullsized":"2024-09-05T17:33:46.642508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:06:13.457185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070026660000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3321,"num_read_kb":48513,"num_write":581,"num_write_kb":29613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":14386340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"165'646","reported_seq":7498,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645392+0000","last_change":"2024-09-05T17:33:40.602148+0000","last_active":"2024-09-05T17:33:45.645392+0000","last_peered":"2024-09-05T17:33:45.645392+0000","last_clean":"2024-09-05T17:33:45.645392+0000","last_became_active":"2024-09-05T17:33:40.596831+0000","last_became_peered":"2024-09-05T17:33:40.596831+0000","last_unstale":"2024-09-05T17:33:45.645392+0000","last_undegraded":"2024-09-05T17:33:45.645392+0000","last_fullsized":"2024-09-05T17:33:45.645392+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:30:06.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034718079999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7401,"num_read_kb":46805,"num_write":650,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":118,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.648400+0000","last_change":"2024-09-05T17:33:46.648152+0000","last_active":"2024-09-05T17:33:46.648400+0000","last_peered":"2024-09-05T17:33:46.648400+0000","last_clean":"2024-09-05T17:33:46.648400+0000","last_became_active":"2024-09-05T17:33:46.647362+0000","last_became_peered":"2024-09-05T17:33:46.647362+0000","last_unstale":"2024-09-05T17:33:46.648400+0000","last_undegraded":"2024-09-05T17:33:46.648400+0000","last_fullsized":"2024-09-05T17:33:46.648400+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:37:29.442303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"164'1413","reported_seq":3826,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641040+0000","last_change":"2024-09-05T17:33:27.560376+0000","last_active":"2024-09-05T17:33:45.641040+0000","last_peered":"2024-09-05T17:33:45.641040+0000","last_clean":"2024-09-05T17:33:45.641040+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:33:45.641040+0000","last_undegraded":"2024-09-05T17:33:45.641040+0000","last_fullsized":"2024-09-05T17:33:45.641040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1413,"log_dups_size":0,"ondisk_log_size":1413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:29:58.319332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002241706,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8376,"num_read_kb":10426,"num_write":2211,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":336,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.071049+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:33:46.071049+0000","last_peered":"2024-09-05T17:33:46.071049+0000","last_clean":"2024-09-05T17:33:46.071049+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:33:46.071049+0000","last_undegraded":"2024-09-05T17:33:46.071049+0000","last_fullsized":"2024-09-05T17:33:46.071049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'629","reported_seq":9157,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637514+0000","last_change":"2024-09-05T17:33:27.525383+0000","last_active":"2024-09-05T17:33:44.637514+0000","last_peered":"2024-09-05T17:33:44.637514+0000","last_clean":"2024-09-05T17:33:44.637514+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:33:44.637514+0000","last_undegraded":"2024-09-05T17:33:44.637514+0000","last_fullsized":"2024-09-05T17:33:44.637514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:42.369588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003039473,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":10304,"num_read_kb":44453,"num_write":657,"num_write_kb":11408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":363,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402054+0000","last_change":"2024-09-05T17:33:33.538285+0000","last_active":"2024-09-05T17:33:46.402054+0000","last_peered":"2024-09-05T17:33:46.402054+0000","last_clean":"2024-09-05T17:33:46.402054+0000","last_became_active":"2024-09-05T17:33:33.537690+0000","last_became_peered":"2024-09-05T17:33:33.537690+0000","last_unstale":"2024-09-05T17:33:46.402054+0000","last_undegraded":"2024-09-05T17:33:46.402054+0000","last_fullsized":"2024-09-05T17:33:46.402054+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:52.432612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"164'1672","reported_seq":5828,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.639959+0000","last_change":"2024-09-05T17:33:27.523383+0000","last_active":"2024-09-05T17:33:45.639959+0000","last_peered":"2024-09-05T17:33:45.639959+0000","last_clean":"2024-09-05T17:33:45.639959+0000","last_became_active":"2024-09-05T17:33:00.882030+0000","last_became_peered":"2024-09-05T17:33:00.882030+0000","last_unstale":"2024-09-05T17:33:45.639959+0000","last_undegraded":"2024-09-05T17:33:45.639959+0000","last_fullsized":"2024-09-05T17:33:45.639959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1672,"log_dups_size":0,"ondisk_log_size":1672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:58:05.278028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731130000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":11375,"num_read_kb":20355,"num_write":2804,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":4232019,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":204,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642068+0000","last_change":"2024-09-05T17:33:00.874549+0000","last_active":"2024-09-05T17:33:46.642068+0000","last_peered":"2024-09-05T17:33:46.642068+0000","last_clean":"2024-09-05T17:33:46.642068+0000","last_became_active":"2024-09-05T17:33:00.874107+0000","last_became_peered":"2024-09-05T17:33:00.874107+0000","last_unstale":"2024-09-05T17:33:46.642068+0000","last_undegraded":"2024-09-05T17:33:46.642068+0000","last_fullsized":"2024-09-05T17:33:46.642068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:27:19.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":454,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402240+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:33:46.402240+0000","last_peered":"2024-09-05T17:33:46.402240+0000","last_clean":"2024-09-05T17:33:46.402240+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:33:46.402240+0000","last_undegraded":"2024-09-05T17:33:46.402240+0000","last_fullsized":"2024-09-05T17:33:46.402240+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"165'371","reported_seq":3755,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.639962+0000","last_change":"2024-09-05T17:33:37.564245+0000","last_active":"2024-09-05T17:33:45.639962+0000","last_peered":"2024-09-05T17:33:45.639962+0000","last_clean":"2024-09-05T17:33:45.639962+0000","last_became_active":"2024-09-05T17:33:37.562005+0000","last_became_peered":"2024-09-05T17:33:37.562005+0000","last_unstale":"2024-09-05T17:33:45.639962+0000","last_undegraded":"2024-09-05T17:33:45.639962+0000","last_fullsized":"2024-09-05T17:33:45.639962+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:09:10.250677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020255859999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2194,"num_read_kb":22000,"num_write":372,"num_write_kb":23336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":10672151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"165'781","reported_seq":5293,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645020+0000","last_change":"2024-09-05T17:33:27.528354+0000","last_active":"2024-09-05T17:33:45.645020+0000","last_peered":"2024-09-05T17:33:45.645020+0000","last_clean":"2024-09-05T17:33:45.645020+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:33:45.645020+0000","last_undegraded":"2024-09-05T17:33:45.645020+0000","last_fullsized":"2024-09-05T17:33:45.645020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:21:45.713020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030988410000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":7390,"num_read_kb":22417,"num_write":1016,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'577","reported_seq":4382,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637617+0000","last_change":"2024-09-05T17:33:27.562550+0000","last_active":"2024-09-05T17:33:44.637617+0000","last_peered":"2024-09-05T17:33:44.637617+0000","last_clean":"2024-09-05T17:33:44.637617+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:33:44.637617+0000","last_undegraded":"2024-09-05T17:33:44.637617+0000","last_fullsized":"2024-09-05T17:33:44.637617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:25:22.635469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00250161,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":4100,"num_read_kb":25746,"num_write":648,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'1097","reported_seq":11155,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640804+0000","last_change":"2024-09-05T17:33:27.523997+0000","last_active":"2024-09-05T17:33:45.640804+0000","last_peered":"2024-09-05T17:33:45.640804+0000","last_clean":"2024-09-05T17:33:45.640804+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:33:45.640804+0000","last_undegraded":"2024-09-05T17:33:45.640804+0000","last_fullsized":"2024-09-05T17:33:45.640804+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:12:41.390494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020407899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13753,"num_read_kb":37185,"num_write":1490,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"164'341","reported_seq":1345,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642162+0000","last_change":"2024-09-05T17:33:27.536025+0000","last_active":"2024-09-05T17:33:46.642162+0000","last_peered":"2024-09-05T17:33:46.642162+0000","last_clean":"2024-09-05T17:33:46.642162+0000","last_became_active":"2024-09-05T17:33:00.880726+0000","last_became_peered":"2024-09-05T17:33:00.880726+0000","last_unstale":"2024-09-05T17:33:46.642162+0000","last_undegraded":"2024-09-05T17:33:46.642162+0000","last_fullsized":"2024-09-05T17:33:46.642162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:50:36.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005949078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1859,"num_read_kb":26572,"num_write":297,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2323932,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"164'457","reported_seq":2327,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402198+0000","last_change":"2024-09-05T17:33:27.550025+0000","last_active":"2024-09-05T17:33:46.402198+0000","last_peered":"2024-09-05T17:33:46.402198+0000","last_clean":"2024-09-05T17:33:46.402198+0000","last_became_active":"2024-09-05T17:33:03.523083+0000","last_became_peered":"2024-09-05T17:33:03.523083+0000","last_unstale":"2024-09-05T17:33:46.402198+0000","last_undegraded":"2024-09-05T17:33:46.402198+0000","last_fullsized":"2024-09-05T17:33:46.402198+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:43:53.113722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066025220000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2520,"num_read_kb":18217,"num_write":450,"num_write_kb":14035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":5727979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'275","reported_seq":2431,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402534+0000","last_change":"2024-09-05T17:33:27.547453+0000","last_active":"2024-09-05T17:33:46.402534+0000","last_peered":"2024-09-05T17:33:46.402534+0000","last_clean":"2024-09-05T17:33:46.402534+0000","last_became_active":"2024-09-05T17:33:22.545834+0000","last_became_peered":"2024-09-05T17:33:22.545834+0000","last_unstale":"2024-09-05T17:33:46.402534+0000","last_undegraded":"2024-09-05T17:33:46.402534+0000","last_fullsized":"2024-09-05T17:33:46.402534+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:30:38.658230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045236249999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1479,"num_read_kb":36544,"num_write":267,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":281923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'494","reported_seq":4930,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402510+0000","last_change":"2024-09-05T17:33:27.548358+0000","last_active":"2024-09-05T17:33:46.402510+0000","last_peered":"2024-09-05T17:33:46.402510+0000","last_clean":"2024-09-05T17:33:46.402510+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:33:46.402510+0000","last_undegraded":"2024-09-05T17:33:46.402510+0000","last_fullsized":"2024-09-05T17:33:46.402510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:08:37.483626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054246379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5058,"num_read_kb":16620,"num_write":538,"num_write_kb":6033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"165'606","reported_seq":4843,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641025+0000","last_change":"2024-09-05T17:33:27.559853+0000","last_active":"2024-09-05T17:33:45.641025+0000","last_peered":"2024-09-05T17:33:45.641025+0000","last_clean":"2024-09-05T17:33:45.641025+0000","last_became_active":"2024-09-05T17:32:51.787759+0000","last_became_peered":"2024-09-05T17:32:51.787759+0000","last_unstale":"2024-09-05T17:33:45.641025+0000","last_undegraded":"2024-09-05T17:33:45.641025+0000","last_fullsized":"2024-09-05T17:33:45.641025+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:30:12.742477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897787,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5143,"num_read_kb":22219,"num_write":724,"num_write_kb":9428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":4462425,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"164'371","reported_seq":2100,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402089+0000","last_change":"2024-09-05T17:33:27.545860+0000","last_active":"2024-09-05T17:33:46.402089+0000","last_peered":"2024-09-05T17:33:46.402089+0000","last_clean":"2024-09-05T17:33:46.402089+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:33:46.402089+0000","last_undegraded":"2024-09-05T17:33:46.402089+0000","last_fullsized":"2024-09-05T17:33:46.402089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:41:24.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033971309999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1549,"num_read_kb":23623,"num_write":342,"num_write_kb":9257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"164'606","reported_seq":8785,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637457+0000","last_change":"2024-09-05T17:33:27.526697+0000","last_active":"2024-09-05T17:33:44.637457+0000","last_peered":"2024-09-05T17:33:44.637457+0000","last_clean":"2024-09-05T17:33:44.637457+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:33:44.637457+0000","last_undegraded":"2024-09-05T17:33:44.637457+0000","last_fullsized":"2024-09-05T17:33:44.637457+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:09:50.306527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042963640000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":9444,"num_read_kb":23607,"num_write":623,"num_write_kb":9519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'819","reported_seq":3413,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402190+0000","last_change":"2024-09-05T17:33:27.546665+0000","last_active":"2024-09-05T17:33:46.402190+0000","last_peered":"2024-09-05T17:33:46.402190+0000","last_clean":"2024-09-05T17:33:46.402190+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:33:46.402190+0000","last_undegraded":"2024-09-05T17:33:46.402190+0000","last_fullsized":"2024-09-05T17:33:46.402190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:43:32.759282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040029130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6651,"num_read_kb":10491,"num_write":908,"num_write_kb":5581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":28,"num_read":174589,"num_read_kb":806017,"num_write":23773,"num_write_kb":363990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2614,"num_bytes_recovered":109452136,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},"log_size":19946,"ondisk_log_size":19946,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41680,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330160,"statfs":{"total":96636764160,"available":96594083840,"internally_reserved":0,"allocated":2224128,"data_stored":1635018,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41624,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330216,"statfs":{"total":96636764160,"available":96594141184,"internally_reserved":0,"allocated":2166784,"data_stored":1044650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":137,"seq":588410519564,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35252,"kb_used_data":2144,"kb_used_omap":28,"kb_used_meta":33059,"kb_avail":94336588,"statfs":{"total":96636764160,"available":96600666112,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28700,"internal_metadata":33853412},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2183168,"data_stored":1050598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65264,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306576,"statfs":{"total":96636764160,"available":96569933824,"internally_reserved":0,"allocated":2179072,"data_stored":1050579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51372,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":2179072,"data_stored":1050579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55540,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316300,"statfs":{"total":96636764160,"available":96579891200,"internally_reserved":0,"allocated":2187264,"data_stored":1050617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47240,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324600,"statfs":{"total":96636764160,"available":96588390400,"internally_reserved":0,"allocated":2207744,"data_stored":1635018,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:33:50.720 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-05T17:33:50.721 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-05T17:33:51.052 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-05T17:33:51.067 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-05T17:33:51.067 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:33:51.378 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:51.380 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:33:51.396 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-05T17:33:49.823756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":28,"num_read":174655,"num_read_kb":806072,"num_write":23876,"num_write_kb":365620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2618,"num_bytes_recovered":110632872,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20021,"ondisk_log_size":20021,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":389352,"kb_used_data":17112,"kb_used_omap":38,"kb_used_meta":371993,"kb_avail":754585368,"statfs":{"total":773094113280,"available":772695416832,"internally_reserved":0,"allocated":17522688,"data_stored":9573586,"data_compressed":12002,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":39856,"internal_metadata":380920912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001622"},"pg_stats":[{"pgid":"3.1f","version":"165'448","reported_seq":3525,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637770+0000","last_change":"2024-09-05T17:33:27.528018+0000","last_active":"2024-09-05T17:33:44.637770+0000","last_peered":"2024-09-05T17:33:44.637770+0000","last_clean":"2024-09-05T17:33:44.637770+0000","last_became_active":"2024-09-05T17:33:03.518878+0000","last_became_peered":"2024-09-05T17:33:03.518878+0000","last_unstale":"2024-09-05T17:33:44.637770+0000","last_undegraded":"2024-09-05T17:33:44.637770+0000","last_fullsized":"2024-09-05T17:33:44.637770+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:23:49.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047849989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3196,"num_read_kb":16881,"num_write":523,"num_write_kb":14009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":8881682,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'338","reported_seq":2202,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640496+0000","last_change":"2024-09-05T17:33:27.523243+0000","last_active":"2024-09-05T17:33:45.640496+0000","last_peered":"2024-09-05T17:33:45.640496+0000","last_clean":"2024-09-05T17:33:45.640496+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:33:45.640496+0000","last_undegraded":"2024-09-05T17:33:45.640496+0000","last_fullsized":"2024-09-05T17:33:45.640496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:31:29.837874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014678029999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2321,"num_read_kb":10748,"num_write":345,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"163'555","reported_seq":3395,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642209+0000","last_change":"2024-09-05T17:33:27.533144+0000","last_active":"2024-09-05T17:33:46.642209+0000","last_peered":"2024-09-05T17:33:46.642209+0000","last_clean":"2024-09-05T17:33:46.642209+0000","last_became_active":"2024-09-05T17:33:00.876268+0000","last_became_peered":"2024-09-05T17:33:00.876268+0000","last_unstale":"2024-09-05T17:33:46.642209+0000","last_undegraded":"2024-09-05T17:33:46.642209+0000","last_fullsized":"2024-09-05T17:33:46.642209+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:13:54.593252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030898620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3969,"num_read_kb":19900,"num_write":584,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"165'540","reported_seq":3720,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.653403+0000","last_change":"2024-09-05T17:33:46.653096+0000","last_active":"2024-09-05T17:33:46.653403+0000","last_peered":"2024-09-05T17:33:46.653403+0000","last_clean":"2024-09-05T17:33:46.653403+0000","last_became_active":"2024-09-05T17:33:46.648777+0000","last_became_peered":"2024-09-05T17:33:46.648777+0000","last_unstale":"2024-09-05T17:33:46.653403+0000","last_undegraded":"2024-09-05T17:33:46.653403+0000","last_fullsized":"2024-09-05T17:33:46.653403+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:53.109193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033133500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3871,"num_read_kb":20517,"num_write":615,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":4255396,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"164'442","reported_seq":2437,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637931+0000","last_change":"2024-09-05T17:33:27.527618+0000","last_active":"2024-09-05T17:33:44.637931+0000","last_peered":"2024-09-05T17:33:44.637931+0000","last_clean":"2024-09-05T17:33:44.637931+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:33:44.637931+0000","last_undegraded":"2024-09-05T17:33:44.637931+0000","last_fullsized":"2024-09-05T17:33:44.637931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:01:30.400215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045349270000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2391,"num_read_kb":34006,"num_write":458,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'699","reported_seq":6288,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645000+0000","last_change":"2024-09-05T17:33:40.601569+0000","last_active":"2024-09-05T17:33:45.645000+0000","last_peered":"2024-09-05T17:33:45.645000+0000","last_clean":"2024-09-05T17:33:45.645000+0000","last_became_active":"2024-09-05T17:33:40.597916+0000","last_became_peered":"2024-09-05T17:33:40.597916+0000","last_unstale":"2024-09-05T17:33:45.645000+0000","last_undegraded":"2024-09-05T17:33:45.645000+0000","last_fullsized":"2024-09-05T17:33:45.645000+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:58.940343+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0011638989999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7746,"num_read_kb":18821,"num_write":755,"num_write_kb":4676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'604","reported_seq":8201,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640909+0000","last_change":"2024-09-05T17:33:27.559356+0000","last_active":"2024-09-05T17:33:45.640909+0000","last_peered":"2024-09-05T17:33:45.640909+0000","last_clean":"2024-09-05T17:33:45.640909+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:33:45.640909+0000","last_undegraded":"2024-09-05T17:33:45.640909+0000","last_fullsized":"2024-09-05T17:33:45.640909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:44.836387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014326129999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":8628,"num_read_kb":37043,"num_write":694,"num_write_kb":9672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"165'465","reported_seq":2892,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640172+0000","last_change":"2024-09-05T17:33:27.522871+0000","last_active":"2024-09-05T17:33:45.640172+0000","last_peered":"2024-09-05T17:33:45.640172+0000","last_clean":"2024-09-05T17:33:45.640172+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:33:45.640172+0000","last_undegraded":"2024-09-05T17:33:45.640172+0000","last_fullsized":"2024-09-05T17:33:45.640172+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:33:41.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012170869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2261,"num_read_kb":32589,"num_write":546,"num_write_kb":10681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"164'767","reported_seq":2768,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637680+0000","last_change":"2024-09-05T17:33:27.526380+0000","last_active":"2024-09-05T17:33:44.637680+0000","last_peered":"2024-09-05T17:33:44.637680+0000","last_clean":"2024-09-05T17:33:44.637680+0000","last_became_active":"2024-09-05T17:33:00.882325+0000","last_became_peered":"2024-09-05T17:33:00.882325+0000","last_unstale":"2024-09-05T17:33:44.637680+0000","last_undegraded":"2024-09-05T17:33:44.637680+0000","last_fullsized":"2024-09-05T17:33:44.637680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:31:39.064715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036302930000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3604,"num_read_kb":12753,"num_write":1031,"num_write_kb":5567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":2814153,"num_keys_recovered":25,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"164'785","reported_seq":2033,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642380+0000","last_change":"2024-09-05T17:33:27.536152+0000","last_active":"2024-09-05T17:33:46.642380+0000","last_peered":"2024-09-05T17:33:46.642380+0000","last_clean":"2024-09-05T17:33:46.642380+0000","last_became_active":"2024-09-05T17:33:00.872821+0000","last_became_peered":"2024-09-05T17:33:00.872821+0000","last_unstale":"2024-09-05T17:33:46.642380+0000","last_undegraded":"2024-09-05T17:33:46.642380+0000","last_fullsized":"2024-09-05T17:33:46.642380+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:11:07.066264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104290000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4301,"num_read_kb":14291,"num_write":964,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'320","reported_seq":1610,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.070967+0000","last_change":"2024-09-05T17:33:27.558751+0000","last_active":"2024-09-05T17:33:46.070967+0000","last_peered":"2024-09-05T17:33:46.070967+0000","last_clean":"2024-09-05T17:33:46.070967+0000","last_became_active":"2024-09-05T17:33:22.534475+0000","last_became_peered":"2024-09-05T17:33:22.534475+0000","last_unstale":"2024-09-05T17:33:46.070967+0000","last_undegraded":"2024-09-05T17:33:46.070967+0000","last_fullsized":"2024-09-05T17:33:46.070967+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:38:47.387024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012121090000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":845,"num_read_kb":16276,"num_write":252,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":569030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"164'500","reported_seq":14602,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.646061+0000","last_change":"2024-09-05T17:33:40.605573+0000","last_active":"2024-09-05T17:33:45.646061+0000","last_peered":"2024-09-05T17:33:45.646061+0000","last_clean":"2024-09-05T17:33:45.646061+0000","last_became_active":"2024-09-05T17:33:40.603253+0000","last_became_peered":"2024-09-05T17:33:40.603253+0000","last_unstale":"2024-09-05T17:33:45.646061+0000","last_undegraded":"2024-09-05T17:33:45.646061+0000","last_fullsized":"2024-09-05T17:33:45.646061+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:39:38.233465+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.007672519,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":15151,"num_read_kb":37250,"num_write":448,"num_write_kb":4447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":336,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637843+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:33:44.637843+0000","last_peered":"2024-09-05T17:33:44.637843+0000","last_clean":"2024-09-05T17:33:44.637843+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:33:44.637843+0000","last_undegraded":"2024-09-05T17:33:44.637843+0000","last_fullsized":"2024-09-05T17:33:44.637843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"165'524","reported_seq":6007,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637638+0000","last_change":"2024-09-05T17:33:27.527118+0000","last_active":"2024-09-05T17:33:44.637638+0000","last_peered":"2024-09-05T17:33:44.637638+0000","last_clean":"2024-09-05T17:33:44.637638+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:33:44.637638+0000","last_undegraded":"2024-09-05T17:33:44.637638+0000","last_fullsized":"2024-09-05T17:33:44.637638+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:24:22.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042900200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6499,"num_read_kb":26402,"num_write":438,"num_write_kb":8494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641478+0000","last_change":"2024-09-05T17:33:33.531154+0000","last_active":"2024-09-05T17:33:45.641478+0000","last_peered":"2024-09-05T17:33:45.641478+0000","last_clean":"2024-09-05T17:33:45.641478+0000","last_became_active":"2024-09-05T17:33:33.530723+0000","last_became_peered":"2024-09-05T17:33:33.530723+0000","last_unstale":"2024-09-05T17:33:45.641478+0000","last_undegraded":"2024-09-05T17:33:45.641478+0000","last_fullsized":"2024-09-05T17:33:45.641478+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:09:48.381008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"163'457","reported_seq":1960,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637979+0000","last_change":"2024-09-05T17:33:27.562400+0000","last_active":"2024-09-05T17:33:44.637979+0000","last_peered":"2024-09-05T17:33:44.637979+0000","last_clean":"2024-09-05T17:33:44.637979+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:33:44.637979+0000","last_undegraded":"2024-09-05T17:33:44.637979+0000","last_fullsized":"2024-09-05T17:33:44.637979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:13:25.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002227845,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1548,"num_read_kb":31708,"num_write":526,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":351,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402319+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:33:46.402319+0000","last_peered":"2024-09-05T17:33:46.402319+0000","last_clean":"2024-09-05T17:33:46.402319+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:33:46.402319+0000","last_undegraded":"2024-09-05T17:33:46.402319+0000","last_fullsized":"2024-09-05T17:33:46.402319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'780","reported_seq":3961,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641117+0000","last_change":"2024-09-05T17:33:27.559456+0000","last_active":"2024-09-05T17:33:45.641117+0000","last_peered":"2024-09-05T17:33:45.641117+0000","last_clean":"2024-09-05T17:33:45.641117+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:33:45.641117+0000","last_undegraded":"2024-09-05T17:33:45.641117+0000","last_fullsized":"2024-09-05T17:33:45.641117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:35:34.672356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154923,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6341,"num_read_kb":21039,"num_write":1016,"num_write_kb":10164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641317+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:33:45.641317+0000","last_peered":"2024-09-05T17:33:45.641317+0000","last_clean":"2024-09-05T17:33:45.641317+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:33:45.641317+0000","last_undegraded":"2024-09-05T17:33:45.641317+0000","last_fullsized":"2024-09-05T17:33:45.641317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"165'567","reported_seq":2194,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642508+0000","last_change":"2024-09-05T17:33:27.537861+0000","last_active":"2024-09-05T17:33:46.642508+0000","last_peered":"2024-09-05T17:33:46.642508+0000","last_clean":"2024-09-05T17:33:46.642508+0000","last_became_active":"2024-09-05T17:33:00.880861+0000","last_became_peered":"2024-09-05T17:33:00.880861+0000","last_unstale":"2024-09-05T17:33:46.642508+0000","last_undegraded":"2024-09-05T17:33:46.642508+0000","last_fullsized":"2024-09-05T17:33:46.642508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:06:13.457185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070026660000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3321,"num_read_kb":48513,"num_write":581,"num_write_kb":29613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":14386340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"165'646","reported_seq":7498,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645392+0000","last_change":"2024-09-05T17:33:40.602148+0000","last_active":"2024-09-05T17:33:45.645392+0000","last_peered":"2024-09-05T17:33:45.645392+0000","last_clean":"2024-09-05T17:33:45.645392+0000","last_became_active":"2024-09-05T17:33:40.596831+0000","last_became_peered":"2024-09-05T17:33:40.596831+0000","last_unstale":"2024-09-05T17:33:45.645392+0000","last_undegraded":"2024-09-05T17:33:45.645392+0000","last_fullsized":"2024-09-05T17:33:45.645392+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:30:06.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034718079999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7401,"num_read_kb":46805,"num_write":650,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":118,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.648400+0000","last_change":"2024-09-05T17:33:46.648152+0000","last_active":"2024-09-05T17:33:46.648400+0000","last_peered":"2024-09-05T17:33:46.648400+0000","last_clean":"2024-09-05T17:33:46.648400+0000","last_became_active":"2024-09-05T17:33:46.647362+0000","last_became_peered":"2024-09-05T17:33:46.647362+0000","last_unstale":"2024-09-05T17:33:46.648400+0000","last_undegraded":"2024-09-05T17:33:46.648400+0000","last_fullsized":"2024-09-05T17:33:46.648400+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:37:29.442303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"164'1413","reported_seq":3826,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641040+0000","last_change":"2024-09-05T17:33:27.560376+0000","last_active":"2024-09-05T17:33:45.641040+0000","last_peered":"2024-09-05T17:33:45.641040+0000","last_clean":"2024-09-05T17:33:45.641040+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:33:45.641040+0000","last_undegraded":"2024-09-05T17:33:45.641040+0000","last_fullsized":"2024-09-05T17:33:45.641040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1413,"log_dups_size":0,"ondisk_log_size":1413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:29:58.319332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002241706,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8376,"num_read_kb":10426,"num_write":2211,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":336,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.071049+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:33:46.071049+0000","last_peered":"2024-09-05T17:33:46.071049+0000","last_clean":"2024-09-05T17:33:46.071049+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:33:46.071049+0000","last_undegraded":"2024-09-05T17:33:46.071049+0000","last_fullsized":"2024-09-05T17:33:46.071049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'629","reported_seq":9157,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637514+0000","last_change":"2024-09-05T17:33:27.525383+0000","last_active":"2024-09-05T17:33:44.637514+0000","last_peered":"2024-09-05T17:33:44.637514+0000","last_clean":"2024-09-05T17:33:44.637514+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:33:44.637514+0000","last_undegraded":"2024-09-05T17:33:44.637514+0000","last_fullsized":"2024-09-05T17:33:44.637514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:42.369588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003039473,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":10304,"num_read_kb":44453,"num_write":657,"num_write_kb":11408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":363,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402054+0000","last_change":"2024-09-05T17:33:33.538285+0000","last_active":"2024-09-05T17:33:46.402054+0000","last_peered":"2024-09-05T17:33:46.402054+0000","last_clean":"2024-09-05T17:33:46.402054+0000","last_became_active":"2024-09-05T17:33:33.537690+0000","last_became_peered":"2024-09-05T17:33:33.537690+0000","last_unstale":"2024-09-05T17:33:46.402054+0000","last_undegraded":"2024-09-05T17:33:46.402054+0000","last_fullsized":"2024-09-05T17:33:46.402054+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:52.432612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"164'1672","reported_seq":5828,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.639959+0000","last_change":"2024-09-05T17:33:27.523383+0000","last_active":"2024-09-05T17:33:45.639959+0000","last_peered":"2024-09-05T17:33:45.639959+0000","last_clean":"2024-09-05T17:33:45.639959+0000","last_became_active":"2024-09-05T17:33:00.882030+0000","last_became_peered":"2024-09-05T17:33:00.882030+0000","last_unstale":"2024-09-05T17:33:45.639959+0000","last_undegraded":"2024-09-05T17:33:45.639959+0000","last_fullsized":"2024-09-05T17:33:45.639959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1672,"log_dups_size":0,"ondisk_log_size":1672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:58:05.278028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731130000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":11375,"num_read_kb":20355,"num_write":2804,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":4232019,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":204,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642068+0000","last_change":"2024-09-05T17:33:00.874549+0000","last_active":"2024-09-05T17:33:46.642068+0000","last_peered":"2024-09-05T17:33:46.642068+0000","last_clean":"2024-09-05T17:33:46.642068+0000","last_became_active":"2024-09-05T17:33:00.874107+0000","last_became_peered":"2024-09-05T17:33:00.874107+0000","last_unstale":"2024-09-05T17:33:46.642068+0000","last_undegraded":"2024-09-05T17:33:46.642068+0000","last_fullsized":"2024-09-05T17:33:46.642068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:27:19.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":454,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402240+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:33:46.402240+0000","last_peered":"2024-09-05T17:33:46.402240+0000","last_clean":"2024-09-05T17:33:46.402240+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:33:46.402240+0000","last_undegraded":"2024-09-05T17:33:46.402240+0000","last_fullsized":"2024-09-05T17:33:46.402240+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"165'371","reported_seq":3755,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.639962+0000","last_change":"2024-09-05T17:33:37.564245+0000","last_active":"2024-09-05T17:33:45.639962+0000","last_peered":"2024-09-05T17:33:45.639962+0000","last_clean":"2024-09-05T17:33:45.639962+0000","last_became_active":"2024-09-05T17:33:37.562005+0000","last_became_peered":"2024-09-05T17:33:37.562005+0000","last_unstale":"2024-09-05T17:33:45.639962+0000","last_undegraded":"2024-09-05T17:33:45.639962+0000","last_fullsized":"2024-09-05T17:33:45.639962+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:09:10.250677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020255859999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2194,"num_read_kb":22000,"num_write":372,"num_write_kb":23336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":10672151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"165'781","reported_seq":5293,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645020+0000","last_change":"2024-09-05T17:33:27.528354+0000","last_active":"2024-09-05T17:33:45.645020+0000","last_peered":"2024-09-05T17:33:45.645020+0000","last_clean":"2024-09-05T17:33:45.645020+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:33:45.645020+0000","last_undegraded":"2024-09-05T17:33:45.645020+0000","last_fullsized":"2024-09-05T17:33:45.645020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:21:45.713020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030988410000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":7390,"num_read_kb":22417,"num_write":1016,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'577","reported_seq":4382,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637617+0000","last_change":"2024-09-05T17:33:27.562550+0000","last_active":"2024-09-05T17:33:44.637617+0000","last_peered":"2024-09-05T17:33:44.637617+0000","last_clean":"2024-09-05T17:33:44.637617+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:33:44.637617+0000","last_undegraded":"2024-09-05T17:33:44.637617+0000","last_fullsized":"2024-09-05T17:33:44.637617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:25:22.635469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00250161,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":4100,"num_read_kb":25746,"num_write":648,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'1097","reported_seq":11155,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640804+0000","last_change":"2024-09-05T17:33:27.523997+0000","last_active":"2024-09-05T17:33:45.640804+0000","last_peered":"2024-09-05T17:33:45.640804+0000","last_clean":"2024-09-05T17:33:45.640804+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:33:45.640804+0000","last_undegraded":"2024-09-05T17:33:45.640804+0000","last_fullsized":"2024-09-05T17:33:45.640804+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:12:41.390494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020407899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13753,"num_read_kb":37185,"num_write":1490,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"164'341","reported_seq":1345,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642162+0000","last_change":"2024-09-05T17:33:27.536025+0000","last_active":"2024-09-05T17:33:46.642162+0000","last_peered":"2024-09-05T17:33:46.642162+0000","last_clean":"2024-09-05T17:33:46.642162+0000","last_became_active":"2024-09-05T17:33:00.880726+0000","last_became_peered":"2024-09-05T17:33:00.880726+0000","last_unstale":"2024-09-05T17:33:46.642162+0000","last_undegraded":"2024-09-05T17:33:46.642162+0000","last_fullsized":"2024-09-05T17:33:46.642162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:50:36.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005949078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1859,"num_read_kb":26572,"num_write":297,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2323932,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"164'457","reported_seq":2327,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402198+0000","last_change":"2024-09-05T17:33:27.550025+0000","last_active":"2024-09-05T17:33:46.402198+0000","last_peered":"2024-09-05T17:33:46.402198+0000","last_clean":"2024-09-05T17:33:46.402198+0000","last_became_active":"2024-09-05T17:33:03.523083+0000","last_became_peered":"2024-09-05T17:33:03.523083+0000","last_unstale":"2024-09-05T17:33:46.402198+0000","last_undegraded":"2024-09-05T17:33:46.402198+0000","last_fullsized":"2024-09-05T17:33:46.402198+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:43:53.113722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066025220000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2520,"num_read_kb":18217,"num_write":450,"num_write_kb":14035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":5727979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'275","reported_seq":2431,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402534+0000","last_change":"2024-09-05T17:33:27.547453+0000","last_active":"2024-09-05T17:33:46.402534+0000","last_peered":"2024-09-05T17:33:46.402534+0000","last_clean":"2024-09-05T17:33:46.402534+0000","last_became_active":"2024-09-05T17:33:22.545834+0000","last_became_peered":"2024-09-05T17:33:22.545834+0000","last_unstale":"2024-09-05T17:33:46.402534+0000","last_undegraded":"2024-09-05T17:33:46.402534+0000","last_fullsized":"2024-09-05T17:33:46.402534+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:30:38.658230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045236249999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1479,"num_read_kb":36544,"num_write":267,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":281923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'494","reported_seq":4930,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402510+0000","last_change":"2024-09-05T17:33:27.548358+0000","last_active":"2024-09-05T17:33:46.402510+0000","last_peered":"2024-09-05T17:33:46.402510+0000","last_clean":"2024-09-05T17:33:46.402510+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:33:46.402510+0000","last_undegraded":"2024-09-05T17:33:46.402510+0000","last_fullsized":"2024-09-05T17:33:46.402510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:08:37.483626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054246379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5058,"num_read_kb":16620,"num_write":538,"num_write_kb":6033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"165'606","reported_seq":4843,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641025+0000","last_change":"2024-09-05T17:33:27.559853+0000","last_active":"2024-09-05T17:33:45.641025+0000","last_peered":"2024-09-05T17:33:45.641025+0000","last_clean":"2024-09-05T17:33:45.641025+0000","last_became_active":"2024-09-05T17:32:51.787759+0000","last_became_peered":"2024-09-05T17:32:51.787759+0000","last_unstale":"2024-09-05T17:33:45.641025+0000","last_undegraded":"2024-09-05T17:33:45.641025+0000","last_fullsized":"2024-09-05T17:33:45.641025+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:30:12.742477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897787,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5143,"num_read_kb":22219,"num_write":724,"num_write_kb":9428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":4462425,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"164'371","reported_seq":2100,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402089+0000","last_change":"2024-09-05T17:33:27.545860+0000","last_active":"2024-09-05T17:33:46.402089+0000","last_peered":"2024-09-05T17:33:46.402089+0000","last_clean":"2024-09-05T17:33:46.402089+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:33:46.402089+0000","last_undegraded":"2024-09-05T17:33:46.402089+0000","last_fullsized":"2024-09-05T17:33:46.402089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:41:24.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033971309999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1549,"num_read_kb":23623,"num_write":342,"num_write_kb":9257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"164'606","reported_seq":8785,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637457+0000","last_change":"2024-09-05T17:33:27.526697+0000","last_active":"2024-09-05T17:33:44.637457+0000","last_peered":"2024-09-05T17:33:44.637457+0000","last_clean":"2024-09-05T17:33:44.637457+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:33:44.637457+0000","last_undegraded":"2024-09-05T17:33:44.637457+0000","last_fullsized":"2024-09-05T17:33:44.637457+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:09:50.306527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042963640000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":9444,"num_read_kb":23607,"num_write":623,"num_write_kb":9519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'819","reported_seq":3413,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402190+0000","last_change":"2024-09-05T17:33:27.546665+0000","last_active":"2024-09-05T17:33:46.402190+0000","last_peered":"2024-09-05T17:33:46.402190+0000","last_clean":"2024-09-05T17:33:46.402190+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:33:46.402190+0000","last_undegraded":"2024-09-05T17:33:46.402190+0000","last_fullsized":"2024-09-05T17:33:46.402190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:43:32.759282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040029130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6651,"num_read_kb":10491,"num_write":908,"num_write_kb":5581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":28,"num_read":174589,"num_read_kb":806017,"num_write":23773,"num_write_kb":363990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2614,"num_bytes_recovered":109452136,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},"log_size":19946,"ondisk_log_size":19946,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41680,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330160,"statfs":{"total":96636764160,"available":96594083840,"internally_reserved":0,"allocated":2224128,"data_stored":1635018,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41624,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330216,"statfs":{"total":96636764160,"available":96594141184,"internally_reserved":0,"allocated":2166784,"data_stored":1044650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":137,"seq":588410519564,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35252,"kb_used_data":2144,"kb_used_omap":28,"kb_used_meta":33059,"kb_avail":94336588,"statfs":{"total":96636764160,"available":96600666112,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28700,"internal_metadata":33853412},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2183168,"data_stored":1050598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65264,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306576,"statfs":{"total":96636764160,"available":96569933824,"internally_reserved":0,"allocated":2179072,"data_stored":1050579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51372,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":2179072,"data_stored":1050579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55540,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316300,"statfs":{"total":96636764160,"available":96579891200,"internally_reserved":0,"allocated":2187264,"data_stored":1050617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47240,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324600,"statfs":{"total":96636764160,"available":96588390400,"internally_reserved":0,"allocated":2207744,"data_stored":1635018,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:33:51.398 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:33:51.705 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:51.705 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:33:51.722 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-05T17:33:49.823756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":28,"num_read":174655,"num_read_kb":806072,"num_write":23876,"num_write_kb":365620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2618,"num_bytes_recovered":110632872,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20021,"ondisk_log_size":20021,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":389352,"kb_used_data":17112,"kb_used_omap":38,"kb_used_meta":371993,"kb_avail":754585368,"statfs":{"total":773094113280,"available":772695416832,"internally_reserved":0,"allocated":17522688,"data_stored":9573586,"data_compressed":12002,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":39856,"internal_metadata":380920912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001622"},"pg_stats":[{"pgid":"3.1f","version":"165'448","reported_seq":3525,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637770+0000","last_change":"2024-09-05T17:33:27.528018+0000","last_active":"2024-09-05T17:33:44.637770+0000","last_peered":"2024-09-05T17:33:44.637770+0000","last_clean":"2024-09-05T17:33:44.637770+0000","last_became_active":"2024-09-05T17:33:03.518878+0000","last_became_peered":"2024-09-05T17:33:03.518878+0000","last_unstale":"2024-09-05T17:33:44.637770+0000","last_undegraded":"2024-09-05T17:33:44.637770+0000","last_fullsized":"2024-09-05T17:33:44.637770+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:23:49.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047849989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3196,"num_read_kb":16881,"num_write":523,"num_write_kb":14009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":8881682,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'338","reported_seq":2202,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640496+0000","last_change":"2024-09-05T17:33:27.523243+0000","last_active":"2024-09-05T17:33:45.640496+0000","last_peered":"2024-09-05T17:33:45.640496+0000","last_clean":"2024-09-05T17:33:45.640496+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:33:45.640496+0000","last_undegraded":"2024-09-05T17:33:45.640496+0000","last_fullsized":"2024-09-05T17:33:45.640496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:31:29.837874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014678029999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2321,"num_read_kb":10748,"num_write":345,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"163'555","reported_seq":3395,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642209+0000","last_change":"2024-09-05T17:33:27.533144+0000","last_active":"2024-09-05T17:33:46.642209+0000","last_peered":"2024-09-05T17:33:46.642209+0000","last_clean":"2024-09-05T17:33:46.642209+0000","last_became_active":"2024-09-05T17:33:00.876268+0000","last_became_peered":"2024-09-05T17:33:00.876268+0000","last_unstale":"2024-09-05T17:33:46.642209+0000","last_undegraded":"2024-09-05T17:33:46.642209+0000","last_fullsized":"2024-09-05T17:33:46.642209+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:13:54.593252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030898620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3969,"num_read_kb":19900,"num_write":584,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"165'540","reported_seq":3720,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.653403+0000","last_change":"2024-09-05T17:33:46.653096+0000","last_active":"2024-09-05T17:33:46.653403+0000","last_peered":"2024-09-05T17:33:46.653403+0000","last_clean":"2024-09-05T17:33:46.653403+0000","last_became_active":"2024-09-05T17:33:46.648777+0000","last_became_peered":"2024-09-05T17:33:46.648777+0000","last_unstale":"2024-09-05T17:33:46.653403+0000","last_undegraded":"2024-09-05T17:33:46.653403+0000","last_fullsized":"2024-09-05T17:33:46.653403+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:53.109193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033133500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3871,"num_read_kb":20517,"num_write":615,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":4255396,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"164'442","reported_seq":2437,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637931+0000","last_change":"2024-09-05T17:33:27.527618+0000","last_active":"2024-09-05T17:33:44.637931+0000","last_peered":"2024-09-05T17:33:44.637931+0000","last_clean":"2024-09-05T17:33:44.637931+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:33:44.637931+0000","last_undegraded":"2024-09-05T17:33:44.637931+0000","last_fullsized":"2024-09-05T17:33:44.637931+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:01:30.400215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045349270000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2391,"num_read_kb":34006,"num_write":458,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'699","reported_seq":6288,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645000+0000","last_change":"2024-09-05T17:33:40.601569+0000","last_active":"2024-09-05T17:33:45.645000+0000","last_peered":"2024-09-05T17:33:45.645000+0000","last_clean":"2024-09-05T17:33:45.645000+0000","last_became_active":"2024-09-05T17:33:40.597916+0000","last_became_peered":"2024-09-05T17:33:40.597916+0000","last_unstale":"2024-09-05T17:33:45.645000+0000","last_undegraded":"2024-09-05T17:33:45.645000+0000","last_fullsized":"2024-09-05T17:33:45.645000+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:58.940343+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0011638989999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7746,"num_read_kb":18821,"num_write":755,"num_write_kb":4676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'604","reported_seq":8201,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640909+0000","last_change":"2024-09-05T17:33:27.559356+0000","last_active":"2024-09-05T17:33:45.640909+0000","last_peered":"2024-09-05T17:33:45.640909+0000","last_clean":"2024-09-05T17:33:45.640909+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:33:45.640909+0000","last_undegraded":"2024-09-05T17:33:45.640909+0000","last_fullsized":"2024-09-05T17:33:45.640909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:44.836387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014326129999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":8628,"num_read_kb":37043,"num_write":694,"num_write_kb":9672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"165'465","reported_seq":2892,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640172+0000","last_change":"2024-09-05T17:33:27.522871+0000","last_active":"2024-09-05T17:33:45.640172+0000","last_peered":"2024-09-05T17:33:45.640172+0000","last_clean":"2024-09-05T17:33:45.640172+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:33:45.640172+0000","last_undegraded":"2024-09-05T17:33:45.640172+0000","last_fullsized":"2024-09-05T17:33:45.640172+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:33:41.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012170869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2261,"num_read_kb":32589,"num_write":546,"num_write_kb":10681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"164'767","reported_seq":2768,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637680+0000","last_change":"2024-09-05T17:33:27.526380+0000","last_active":"2024-09-05T17:33:44.637680+0000","last_peered":"2024-09-05T17:33:44.637680+0000","last_clean":"2024-09-05T17:33:44.637680+0000","last_became_active":"2024-09-05T17:33:00.882325+0000","last_became_peered":"2024-09-05T17:33:00.882325+0000","last_unstale":"2024-09-05T17:33:44.637680+0000","last_undegraded":"2024-09-05T17:33:44.637680+0000","last_fullsized":"2024-09-05T17:33:44.637680+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:31:39.064715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036302930000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3604,"num_read_kb":12753,"num_write":1031,"num_write_kb":5567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":2814153,"num_keys_recovered":25,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"164'785","reported_seq":2033,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642380+0000","last_change":"2024-09-05T17:33:27.536152+0000","last_active":"2024-09-05T17:33:46.642380+0000","last_peered":"2024-09-05T17:33:46.642380+0000","last_clean":"2024-09-05T17:33:46.642380+0000","last_became_active":"2024-09-05T17:33:00.872821+0000","last_became_peered":"2024-09-05T17:33:00.872821+0000","last_unstale":"2024-09-05T17:33:46.642380+0000","last_undegraded":"2024-09-05T17:33:46.642380+0000","last_fullsized":"2024-09-05T17:33:46.642380+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:11:07.066264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104290000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4301,"num_read_kb":14291,"num_write":964,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'320","reported_seq":1610,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.070967+0000","last_change":"2024-09-05T17:33:27.558751+0000","last_active":"2024-09-05T17:33:46.070967+0000","last_peered":"2024-09-05T17:33:46.070967+0000","last_clean":"2024-09-05T17:33:46.070967+0000","last_became_active":"2024-09-05T17:33:22.534475+0000","last_became_peered":"2024-09-05T17:33:22.534475+0000","last_unstale":"2024-09-05T17:33:46.070967+0000","last_undegraded":"2024-09-05T17:33:46.070967+0000","last_fullsized":"2024-09-05T17:33:46.070967+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:38:47.387024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012121090000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":845,"num_read_kb":16276,"num_write":252,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":569030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"164'500","reported_seq":14602,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.646061+0000","last_change":"2024-09-05T17:33:40.605573+0000","last_active":"2024-09-05T17:33:45.646061+0000","last_peered":"2024-09-05T17:33:45.646061+0000","last_clean":"2024-09-05T17:33:45.646061+0000","last_became_active":"2024-09-05T17:33:40.603253+0000","last_became_peered":"2024-09-05T17:33:40.603253+0000","last_unstale":"2024-09-05T17:33:45.646061+0000","last_undegraded":"2024-09-05T17:33:45.646061+0000","last_fullsized":"2024-09-05T17:33:45.646061+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:39:38.233465+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.007672519,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":15151,"num_read_kb":37250,"num_write":448,"num_write_kb":4447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":336,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637843+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:33:44.637843+0000","last_peered":"2024-09-05T17:33:44.637843+0000","last_clean":"2024-09-05T17:33:44.637843+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:33:44.637843+0000","last_undegraded":"2024-09-05T17:33:44.637843+0000","last_fullsized":"2024-09-05T17:33:44.637843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"165'524","reported_seq":6007,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637638+0000","last_change":"2024-09-05T17:33:27.527118+0000","last_active":"2024-09-05T17:33:44.637638+0000","last_peered":"2024-09-05T17:33:44.637638+0000","last_clean":"2024-09-05T17:33:44.637638+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:33:44.637638+0000","last_undegraded":"2024-09-05T17:33:44.637638+0000","last_fullsized":"2024-09-05T17:33:44.637638+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:24:22.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042900200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6499,"num_read_kb":26402,"num_write":438,"num_write_kb":8494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641478+0000","last_change":"2024-09-05T17:33:33.531154+0000","last_active":"2024-09-05T17:33:45.641478+0000","last_peered":"2024-09-05T17:33:45.641478+0000","last_clean":"2024-09-05T17:33:45.641478+0000","last_became_active":"2024-09-05T17:33:33.530723+0000","last_became_peered":"2024-09-05T17:33:33.530723+0000","last_unstale":"2024-09-05T17:33:45.641478+0000","last_undegraded":"2024-09-05T17:33:45.641478+0000","last_fullsized":"2024-09-05T17:33:45.641478+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:09:48.381008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"163'457","reported_seq":1960,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637979+0000","last_change":"2024-09-05T17:33:27.562400+0000","last_active":"2024-09-05T17:33:44.637979+0000","last_peered":"2024-09-05T17:33:44.637979+0000","last_clean":"2024-09-05T17:33:44.637979+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:33:44.637979+0000","last_undegraded":"2024-09-05T17:33:44.637979+0000","last_fullsized":"2024-09-05T17:33:44.637979+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:13:25.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002227845,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1548,"num_read_kb":31708,"num_write":526,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":351,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402319+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:33:46.402319+0000","last_peered":"2024-09-05T17:33:46.402319+0000","last_clean":"2024-09-05T17:33:46.402319+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:33:46.402319+0000","last_undegraded":"2024-09-05T17:33:46.402319+0000","last_fullsized":"2024-09-05T17:33:46.402319+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'780","reported_seq":3961,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641117+0000","last_change":"2024-09-05T17:33:27.559456+0000","last_active":"2024-09-05T17:33:45.641117+0000","last_peered":"2024-09-05T17:33:45.641117+0000","last_clean":"2024-09-05T17:33:45.641117+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:33:45.641117+0000","last_undegraded":"2024-09-05T17:33:45.641117+0000","last_fullsized":"2024-09-05T17:33:45.641117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:35:34.672356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154923,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6341,"num_read_kb":21039,"num_write":1016,"num_write_kb":10164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":348,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641317+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:33:45.641317+0000","last_peered":"2024-09-05T17:33:45.641317+0000","last_clean":"2024-09-05T17:33:45.641317+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:33:45.641317+0000","last_undegraded":"2024-09-05T17:33:45.641317+0000","last_fullsized":"2024-09-05T17:33:45.641317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"165'567","reported_seq":2194,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642508+0000","last_change":"2024-09-05T17:33:27.537861+0000","last_active":"2024-09-05T17:33:46.642508+0000","last_peered":"2024-09-05T17:33:46.642508+0000","last_clean":"2024-09-05T17:33:46.642508+0000","last_became_active":"2024-09-05T17:33:00.880861+0000","last_became_peered":"2024-09-05T17:33:00.880861+0000","last_unstale":"2024-09-05T17:33:46.642508+0000","last_undegraded":"2024-09-05T17:33:46.642508+0000","last_fullsized":"2024-09-05T17:33:46.642508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:06:13.457185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070026660000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3321,"num_read_kb":48513,"num_write":581,"num_write_kb":29613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":14386340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"165'646","reported_seq":7498,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645392+0000","last_change":"2024-09-05T17:33:40.602148+0000","last_active":"2024-09-05T17:33:45.645392+0000","last_peered":"2024-09-05T17:33:45.645392+0000","last_clean":"2024-09-05T17:33:45.645392+0000","last_became_active":"2024-09-05T17:33:40.596831+0000","last_became_peered":"2024-09-05T17:33:40.596831+0000","last_unstale":"2024-09-05T17:33:45.645392+0000","last_undegraded":"2024-09-05T17:33:45.645392+0000","last_fullsized":"2024-09-05T17:33:45.645392+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:30:06.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034718079999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7401,"num_read_kb":46805,"num_write":650,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":118,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.648400+0000","last_change":"2024-09-05T17:33:46.648152+0000","last_active":"2024-09-05T17:33:46.648400+0000","last_peered":"2024-09-05T17:33:46.648400+0000","last_clean":"2024-09-05T17:33:46.648400+0000","last_became_active":"2024-09-05T17:33:46.647362+0000","last_became_peered":"2024-09-05T17:33:46.647362+0000","last_unstale":"2024-09-05T17:33:46.648400+0000","last_undegraded":"2024-09-05T17:33:46.648400+0000","last_fullsized":"2024-09-05T17:33:46.648400+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:37:29.442303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"164'1413","reported_seq":3826,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641040+0000","last_change":"2024-09-05T17:33:27.560376+0000","last_active":"2024-09-05T17:33:45.641040+0000","last_peered":"2024-09-05T17:33:45.641040+0000","last_clean":"2024-09-05T17:33:45.641040+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:33:45.641040+0000","last_undegraded":"2024-09-05T17:33:45.641040+0000","last_fullsized":"2024-09-05T17:33:45.641040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1413,"log_dups_size":0,"ondisk_log_size":1413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:29:58.319332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002241706,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8376,"num_read_kb":10426,"num_write":2211,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":336,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.071049+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:33:46.071049+0000","last_peered":"2024-09-05T17:33:46.071049+0000","last_clean":"2024-09-05T17:33:46.071049+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:33:46.071049+0000","last_undegraded":"2024-09-05T17:33:46.071049+0000","last_fullsized":"2024-09-05T17:33:46.071049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'629","reported_seq":9157,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637514+0000","last_change":"2024-09-05T17:33:27.525383+0000","last_active":"2024-09-05T17:33:44.637514+0000","last_peered":"2024-09-05T17:33:44.637514+0000","last_clean":"2024-09-05T17:33:44.637514+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:33:44.637514+0000","last_undegraded":"2024-09-05T17:33:44.637514+0000","last_fullsized":"2024-09-05T17:33:44.637514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:42.369588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003039473,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":10304,"num_read_kb":44453,"num_write":657,"num_write_kb":11408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":363,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402054+0000","last_change":"2024-09-05T17:33:33.538285+0000","last_active":"2024-09-05T17:33:46.402054+0000","last_peered":"2024-09-05T17:33:46.402054+0000","last_clean":"2024-09-05T17:33:46.402054+0000","last_became_active":"2024-09-05T17:33:33.537690+0000","last_became_peered":"2024-09-05T17:33:33.537690+0000","last_unstale":"2024-09-05T17:33:46.402054+0000","last_undegraded":"2024-09-05T17:33:46.402054+0000","last_fullsized":"2024-09-05T17:33:46.402054+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:52.432612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"164'1672","reported_seq":5828,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.639959+0000","last_change":"2024-09-05T17:33:27.523383+0000","last_active":"2024-09-05T17:33:45.639959+0000","last_peered":"2024-09-05T17:33:45.639959+0000","last_clean":"2024-09-05T17:33:45.639959+0000","last_became_active":"2024-09-05T17:33:00.882030+0000","last_became_peered":"2024-09-05T17:33:00.882030+0000","last_unstale":"2024-09-05T17:33:45.639959+0000","last_undegraded":"2024-09-05T17:33:45.639959+0000","last_fullsized":"2024-09-05T17:33:45.639959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1672,"log_dups_size":0,"ondisk_log_size":1672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:58:05.278028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731130000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":11375,"num_read_kb":20355,"num_write":2804,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":4232019,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":204,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642068+0000","last_change":"2024-09-05T17:33:00.874549+0000","last_active":"2024-09-05T17:33:46.642068+0000","last_peered":"2024-09-05T17:33:46.642068+0000","last_clean":"2024-09-05T17:33:46.642068+0000","last_became_active":"2024-09-05T17:33:00.874107+0000","last_became_peered":"2024-09-05T17:33:00.874107+0000","last_unstale":"2024-09-05T17:33:46.642068+0000","last_undegraded":"2024-09-05T17:33:46.642068+0000","last_fullsized":"2024-09-05T17:33:46.642068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:27:19.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":454,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402240+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:33:46.402240+0000","last_peered":"2024-09-05T17:33:46.402240+0000","last_clean":"2024-09-05T17:33:46.402240+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:33:46.402240+0000","last_undegraded":"2024-09-05T17:33:46.402240+0000","last_fullsized":"2024-09-05T17:33:46.402240+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"165'371","reported_seq":3755,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.639962+0000","last_change":"2024-09-05T17:33:37.564245+0000","last_active":"2024-09-05T17:33:45.639962+0000","last_peered":"2024-09-05T17:33:45.639962+0000","last_clean":"2024-09-05T17:33:45.639962+0000","last_became_active":"2024-09-05T17:33:37.562005+0000","last_became_peered":"2024-09-05T17:33:37.562005+0000","last_unstale":"2024-09-05T17:33:45.639962+0000","last_undegraded":"2024-09-05T17:33:45.639962+0000","last_fullsized":"2024-09-05T17:33:45.639962+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:09:10.250677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020255859999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2194,"num_read_kb":22000,"num_write":372,"num_write_kb":23336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":10672151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"165'781","reported_seq":5293,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.645020+0000","last_change":"2024-09-05T17:33:27.528354+0000","last_active":"2024-09-05T17:33:45.645020+0000","last_peered":"2024-09-05T17:33:45.645020+0000","last_clean":"2024-09-05T17:33:45.645020+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:33:45.645020+0000","last_undegraded":"2024-09-05T17:33:45.645020+0000","last_fullsized":"2024-09-05T17:33:45.645020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:21:45.713020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030988410000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":7390,"num_read_kb":22417,"num_write":1016,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'577","reported_seq":4382,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637617+0000","last_change":"2024-09-05T17:33:27.562550+0000","last_active":"2024-09-05T17:33:44.637617+0000","last_peered":"2024-09-05T17:33:44.637617+0000","last_clean":"2024-09-05T17:33:44.637617+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:33:44.637617+0000","last_undegraded":"2024-09-05T17:33:44.637617+0000","last_fullsized":"2024-09-05T17:33:44.637617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:25:22.635469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00250161,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":4100,"num_read_kb":25746,"num_write":648,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'1097","reported_seq":11155,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.640804+0000","last_change":"2024-09-05T17:33:27.523997+0000","last_active":"2024-09-05T17:33:45.640804+0000","last_peered":"2024-09-05T17:33:45.640804+0000","last_clean":"2024-09-05T17:33:45.640804+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:33:45.640804+0000","last_undegraded":"2024-09-05T17:33:45.640804+0000","last_fullsized":"2024-09-05T17:33:45.640804+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:12:41.390494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020407899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13753,"num_read_kb":37185,"num_write":1490,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"164'341","reported_seq":1345,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642162+0000","last_change":"2024-09-05T17:33:27.536025+0000","last_active":"2024-09-05T17:33:46.642162+0000","last_peered":"2024-09-05T17:33:46.642162+0000","last_clean":"2024-09-05T17:33:46.642162+0000","last_became_active":"2024-09-05T17:33:00.880726+0000","last_became_peered":"2024-09-05T17:33:00.880726+0000","last_unstale":"2024-09-05T17:33:46.642162+0000","last_undegraded":"2024-09-05T17:33:46.642162+0000","last_fullsized":"2024-09-05T17:33:46.642162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:50:36.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005949078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1859,"num_read_kb":26572,"num_write":297,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2323932,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"164'457","reported_seq":2327,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402198+0000","last_change":"2024-09-05T17:33:27.550025+0000","last_active":"2024-09-05T17:33:46.402198+0000","last_peered":"2024-09-05T17:33:46.402198+0000","last_clean":"2024-09-05T17:33:46.402198+0000","last_became_active":"2024-09-05T17:33:03.523083+0000","last_became_peered":"2024-09-05T17:33:03.523083+0000","last_unstale":"2024-09-05T17:33:46.402198+0000","last_undegraded":"2024-09-05T17:33:46.402198+0000","last_fullsized":"2024-09-05T17:33:46.402198+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:43:53.113722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066025220000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2520,"num_read_kb":18217,"num_write":450,"num_write_kb":14035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":5727979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'275","reported_seq":2431,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402534+0000","last_change":"2024-09-05T17:33:27.547453+0000","last_active":"2024-09-05T17:33:46.402534+0000","last_peered":"2024-09-05T17:33:46.402534+0000","last_clean":"2024-09-05T17:33:46.402534+0000","last_became_active":"2024-09-05T17:33:22.545834+0000","last_became_peered":"2024-09-05T17:33:22.545834+0000","last_unstale":"2024-09-05T17:33:46.402534+0000","last_undegraded":"2024-09-05T17:33:46.402534+0000","last_fullsized":"2024-09-05T17:33:46.402534+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:30:38.658230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045236249999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1479,"num_read_kb":36544,"num_write":267,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":281923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'494","reported_seq":4930,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402510+0000","last_change":"2024-09-05T17:33:27.548358+0000","last_active":"2024-09-05T17:33:46.402510+0000","last_peered":"2024-09-05T17:33:46.402510+0000","last_clean":"2024-09-05T17:33:46.402510+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:33:46.402510+0000","last_undegraded":"2024-09-05T17:33:46.402510+0000","last_fullsized":"2024-09-05T17:33:46.402510+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:08:37.483626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054246379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5058,"num_read_kb":16620,"num_write":538,"num_write_kb":6033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"165'606","reported_seq":4843,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:45.641025+0000","last_change":"2024-09-05T17:33:27.559853+0000","last_active":"2024-09-05T17:33:45.641025+0000","last_peered":"2024-09-05T17:33:45.641025+0000","last_clean":"2024-09-05T17:33:45.641025+0000","last_became_active":"2024-09-05T17:32:51.787759+0000","last_became_peered":"2024-09-05T17:32:51.787759+0000","last_unstale":"2024-09-05T17:33:45.641025+0000","last_undegraded":"2024-09-05T17:33:45.641025+0000","last_fullsized":"2024-09-05T17:33:45.641025+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:30:12.742477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897787,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5143,"num_read_kb":22219,"num_write":724,"num_write_kb":9428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":4462425,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"164'371","reported_seq":2100,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402089+0000","last_change":"2024-09-05T17:33:27.545860+0000","last_active":"2024-09-05T17:33:46.402089+0000","last_peered":"2024-09-05T17:33:46.402089+0000","last_clean":"2024-09-05T17:33:46.402089+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:33:46.402089+0000","last_undegraded":"2024-09-05T17:33:46.402089+0000","last_fullsized":"2024-09-05T17:33:46.402089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:41:24.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033971309999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1549,"num_read_kb":23623,"num_write":342,"num_write_kb":9257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"164'606","reported_seq":8785,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-05T17:33:44.637457+0000","last_change":"2024-09-05T17:33:27.526697+0000","last_active":"2024-09-05T17:33:44.637457+0000","last_peered":"2024-09-05T17:33:44.637457+0000","last_clean":"2024-09-05T17:33:44.637457+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:33:44.637457+0000","last_undegraded":"2024-09-05T17:33:44.637457+0000","last_fullsized":"2024-09-05T17:33:44.637457+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:09:50.306527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042963640000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":9444,"num_read_kb":23607,"num_write":623,"num_write_kb":9519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'819","reported_seq":3413,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.402190+0000","last_change":"2024-09-05T17:33:27.546665+0000","last_active":"2024-09-05T17:33:46.402190+0000","last_peered":"2024-09-05T17:33:46.402190+0000","last_clean":"2024-09-05T17:33:46.402190+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:33:46.402190+0000","last_undegraded":"2024-09-05T17:33:46.402190+0000","last_fullsized":"2024-09-05T17:33:46.402190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:43:32.759282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040029130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6651,"num_read_kb":10491,"num_write":908,"num_write_kb":5581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":28,"num_read":174589,"num_read_kb":806017,"num_write":23773,"num_write_kb":363990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2614,"num_bytes_recovered":109452136,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},"log_size":19946,"ondisk_log_size":19946,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41680,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330160,"statfs":{"total":96636764160,"available":96594083840,"internally_reserved":0,"allocated":2224128,"data_stored":1635018,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41624,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330216,"statfs":{"total":96636764160,"available":96594141184,"internally_reserved":0,"allocated":2166784,"data_stored":1044650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":137,"seq":588410519564,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35252,"kb_used_data":2144,"kb_used_omap":28,"kb_used_meta":33059,"kb_avail":94336588,"statfs":{"total":96636764160,"available":96600666112,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28700,"internal_metadata":33853412},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542187,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2132,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2183168,"data_stored":1050598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65264,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306576,"statfs":{"total":96636764160,"available":96569933824,"internally_reserved":0,"allocated":2179072,"data_stored":1050579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51372,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":2179072,"data_stored":1050579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55540,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316300,"statfs":{"total":96636764160,"available":96579891200,"internally_reserved":0,"allocated":2187264,"data_stored":1050617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47240,"kb_used_data":2156,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324600,"statfs":{"total":96636764160,"available":96588390400,"internally_reserved":0,"allocated":2207744,"data_stored":1635018,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:33:51.724 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-05T17:33:51.724 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:33:52.030 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:52.031 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:33:52.048 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-05T17:33:51.824308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":28,"num_read":174655,"num_read_kb":806072,"num_write":23876,"num_write_kb":365620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2618,"num_bytes_recovered":110632872,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20021,"ondisk_log_size":20021,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":389440,"kb_used_data":17232,"kb_used_omap":38,"kb_used_meta":371993,"kb_avail":754585280,"statfs":{"total":773094113280,"available":772695326720,"internally_reserved":0,"allocated":17645568,"data_stored":9632876,"data_compressed":12002,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":39856,"internal_metadata":380920912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.188907"},"pg_stats":[{"pgid":"3.1f","version":"165'448","reported_seq":3528,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.039644+0000","last_change":"2024-09-05T17:33:27.528018+0000","last_active":"2024-09-05T17:33:47.039644+0000","last_peered":"2024-09-05T17:33:47.039644+0000","last_clean":"2024-09-05T17:33:47.039644+0000","last_became_active":"2024-09-05T17:33:03.518878+0000","last_became_peered":"2024-09-05T17:33:03.518878+0000","last_unstale":"2024-09-05T17:33:47.039644+0000","last_undegraded":"2024-09-05T17:33:47.039644+0000","last_fullsized":"2024-09-05T17:33:47.039644+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:23:49.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047849989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3196,"num_read_kb":16881,"num_write":523,"num_write_kb":14009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":8881682,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'338","reported_seq":2204,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.640693+0000","last_change":"2024-09-05T17:33:27.523243+0000","last_active":"2024-09-05T17:33:46.640693+0000","last_peered":"2024-09-05T17:33:46.640693+0000","last_clean":"2024-09-05T17:33:46.640693+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:33:46.640693+0000","last_undegraded":"2024-09-05T17:33:46.640693+0000","last_fullsized":"2024-09-05T17:33:46.640693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:31:29.837874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014678029999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2321,"num_read_kb":10748,"num_write":345,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"163'555","reported_seq":3395,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642209+0000","last_change":"2024-09-05T17:33:27.533144+0000","last_active":"2024-09-05T17:33:46.642209+0000","last_peered":"2024-09-05T17:33:46.642209+0000","last_clean":"2024-09-05T17:33:46.642209+0000","last_became_active":"2024-09-05T17:33:00.876268+0000","last_became_peered":"2024-09-05T17:33:00.876268+0000","last_unstale":"2024-09-05T17:33:46.642209+0000","last_undegraded":"2024-09-05T17:33:46.642209+0000","last_fullsized":"2024-09-05T17:33:46.642209+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:13:54.593252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030898620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3969,"num_read_kb":19900,"num_write":584,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"165'540","reported_seq":3720,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.653403+0000","last_change":"2024-09-05T17:33:46.653096+0000","last_active":"2024-09-05T17:33:46.653403+0000","last_peered":"2024-09-05T17:33:46.653403+0000","last_clean":"2024-09-05T17:33:46.653403+0000","last_became_active":"2024-09-05T17:33:46.648777+0000","last_became_peered":"2024-09-05T17:33:46.648777+0000","last_unstale":"2024-09-05T17:33:46.653403+0000","last_undegraded":"2024-09-05T17:33:46.653403+0000","last_fullsized":"2024-09-05T17:33:46.653403+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:53.109193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033133500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3871,"num_read_kb":20517,"num_write":615,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":4255396,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"164'442","reported_seq":2440,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.039421+0000","last_change":"2024-09-05T17:33:27.527618+0000","last_active":"2024-09-05T17:33:47.039421+0000","last_peered":"2024-09-05T17:33:47.039421+0000","last_clean":"2024-09-05T17:33:47.039421+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:33:47.039421+0000","last_undegraded":"2024-09-05T17:33:47.039421+0000","last_fullsized":"2024-09-05T17:33:47.039421+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:01:30.400215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045349270000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2391,"num_read_kb":34006,"num_write":458,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'699","reported_seq":6290,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.646461+0000","last_change":"2024-09-05T17:33:40.601569+0000","last_active":"2024-09-05T17:33:46.646461+0000","last_peered":"2024-09-05T17:33:46.646461+0000","last_clean":"2024-09-05T17:33:46.646461+0000","last_became_active":"2024-09-05T17:33:40.597916+0000","last_became_peered":"2024-09-05T17:33:40.597916+0000","last_unstale":"2024-09-05T17:33:46.646461+0000","last_undegraded":"2024-09-05T17:33:46.646461+0000","last_fullsized":"2024-09-05T17:33:46.646461+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:58.940343+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0011638989999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7746,"num_read_kb":18821,"num_write":755,"num_write_kb":4676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'604","reported_seq":8203,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645151+0000","last_change":"2024-09-05T17:33:27.559356+0000","last_active":"2024-09-05T17:33:46.645151+0000","last_peered":"2024-09-05T17:33:46.645151+0000","last_clean":"2024-09-05T17:33:46.645151+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:33:46.645151+0000","last_undegraded":"2024-09-05T17:33:46.645151+0000","last_fullsized":"2024-09-05T17:33:46.645151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:44.836387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014326129999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":8628,"num_read_kb":37043,"num_write":694,"num_write_kb":9672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"165'465","reported_seq":2894,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.639829+0000","last_change":"2024-09-05T17:33:27.522871+0000","last_active":"2024-09-05T17:33:46.639829+0000","last_peered":"2024-09-05T17:33:46.639829+0000","last_clean":"2024-09-05T17:33:46.639829+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:33:46.639829+0000","last_undegraded":"2024-09-05T17:33:46.639829+0000","last_fullsized":"2024-09-05T17:33:46.639829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:33:41.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012170869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2261,"num_read_kb":32589,"num_write":546,"num_write_kb":10681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"164'767","reported_seq":2771,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.039505+0000","last_change":"2024-09-05T17:33:27.526380+0000","last_active":"2024-09-05T17:33:47.039505+0000","last_peered":"2024-09-05T17:33:47.039505+0000","last_clean":"2024-09-05T17:33:47.039505+0000","last_became_active":"2024-09-05T17:33:00.882325+0000","last_became_peered":"2024-09-05T17:33:00.882325+0000","last_unstale":"2024-09-05T17:33:47.039505+0000","last_undegraded":"2024-09-05T17:33:47.039505+0000","last_fullsized":"2024-09-05T17:33:47.039505+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:31:39.064715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036302930000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3604,"num_read_kb":12753,"num_write":1031,"num_write_kb":5567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":2814153,"num_keys_recovered":25,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"164'785","reported_seq":2033,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642380+0000","last_change":"2024-09-05T17:33:27.536152+0000","last_active":"2024-09-05T17:33:46.642380+0000","last_peered":"2024-09-05T17:33:46.642380+0000","last_clean":"2024-09-05T17:33:46.642380+0000","last_became_active":"2024-09-05T17:33:00.872821+0000","last_became_peered":"2024-09-05T17:33:00.872821+0000","last_unstale":"2024-09-05T17:33:46.642380+0000","last_undegraded":"2024-09-05T17:33:46.642380+0000","last_fullsized":"2024-09-05T17:33:46.642380+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:11:07.066264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104290000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4301,"num_read_kb":14291,"num_write":964,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'320","reported_seq":1612,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.641240+0000","last_change":"2024-09-05T17:33:27.558751+0000","last_active":"2024-09-05T17:33:46.641240+0000","last_peered":"2024-09-05T17:33:46.641240+0000","last_clean":"2024-09-05T17:33:46.641240+0000","last_became_active":"2024-09-05T17:33:22.534475+0000","last_became_peered":"2024-09-05T17:33:22.534475+0000","last_unstale":"2024-09-05T17:33:46.641240+0000","last_undegraded":"2024-09-05T17:33:46.641240+0000","last_fullsized":"2024-09-05T17:33:46.641240+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:38:47.387024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012121090000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":845,"num_read_kb":16276,"num_write":252,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":569030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"164'500","reported_seq":14604,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.647127+0000","last_change":"2024-09-05T17:33:40.605573+0000","last_active":"2024-09-05T17:33:46.647127+0000","last_peered":"2024-09-05T17:33:46.647127+0000","last_clean":"2024-09-05T17:33:46.647127+0000","last_became_active":"2024-09-05T17:33:40.603253+0000","last_became_peered":"2024-09-05T17:33:40.603253+0000","last_unstale":"2024-09-05T17:33:46.647127+0000","last_undegraded":"2024-09-05T17:33:46.647127+0000","last_fullsized":"2024-09-05T17:33:46.647127+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:39:38.233465+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.007672519,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":15151,"num_read_kb":37250,"num_write":448,"num_write_kb":4447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":339,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.835100+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:33:46.835100+0000","last_peered":"2024-09-05T17:33:46.835100+0000","last_clean":"2024-09-05T17:33:46.835100+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:33:46.835100+0000","last_undegraded":"2024-09-05T17:33:46.835100+0000","last_fullsized":"2024-09-05T17:33:46.835100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"165'524","reported_seq":6010,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.039442+0000","last_change":"2024-09-05T17:33:27.527118+0000","last_active":"2024-09-05T17:33:47.039442+0000","last_peered":"2024-09-05T17:33:47.039442+0000","last_clean":"2024-09-05T17:33:47.039442+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:33:47.039442+0000","last_undegraded":"2024-09-05T17:33:47.039442+0000","last_fullsized":"2024-09-05T17:33:47.039442+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:24:22.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042900200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6499,"num_read_kb":26402,"num_write":438,"num_write_kb":8494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645500+0000","last_change":"2024-09-05T17:33:33.531154+0000","last_active":"2024-09-05T17:33:46.645500+0000","last_peered":"2024-09-05T17:33:46.645500+0000","last_clean":"2024-09-05T17:33:46.645500+0000","last_became_active":"2024-09-05T17:33:33.530723+0000","last_became_peered":"2024-09-05T17:33:33.530723+0000","last_unstale":"2024-09-05T17:33:46.645500+0000","last_undegraded":"2024-09-05T17:33:46.645500+0000","last_fullsized":"2024-09-05T17:33:46.645500+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:09:48.381008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"163'457","reported_seq":1963,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.835017+0000","last_change":"2024-09-05T17:33:27.562400+0000","last_active":"2024-09-05T17:33:46.835017+0000","last_peered":"2024-09-05T17:33:46.835017+0000","last_clean":"2024-09-05T17:33:46.835017+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:33:46.835017+0000","last_undegraded":"2024-09-05T17:33:46.835017+0000","last_fullsized":"2024-09-05T17:33:46.835017+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:13:25.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002227845,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1548,"num_read_kb":31708,"num_write":526,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":353,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927621+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:33:46.927621+0000","last_peered":"2024-09-05T17:33:46.927621+0000","last_clean":"2024-09-05T17:33:46.927621+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:33:46.927621+0000","last_undegraded":"2024-09-05T17:33:46.927621+0000","last_fullsized":"2024-09-05T17:33:46.927621+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'780","reported_seq":3963,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645171+0000","last_change":"2024-09-05T17:33:27.559456+0000","last_active":"2024-09-05T17:33:46.645171+0000","last_peered":"2024-09-05T17:33:46.645171+0000","last_clean":"2024-09-05T17:33:46.645171+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:33:46.645171+0000","last_undegraded":"2024-09-05T17:33:46.645171+0000","last_fullsized":"2024-09-05T17:33:46.645171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:35:34.672356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154923,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6341,"num_read_kb":21039,"num_write":1016,"num_write_kb":10164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":350,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645288+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:33:46.645288+0000","last_peered":"2024-09-05T17:33:46.645288+0000","last_clean":"2024-09-05T17:33:46.645288+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:33:46.645288+0000","last_undegraded":"2024-09-05T17:33:46.645288+0000","last_fullsized":"2024-09-05T17:33:46.645288+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"165'567","reported_seq":2194,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642508+0000","last_change":"2024-09-05T17:33:27.537861+0000","last_active":"2024-09-05T17:33:46.642508+0000","last_peered":"2024-09-05T17:33:46.642508+0000","last_clean":"2024-09-05T17:33:46.642508+0000","last_became_active":"2024-09-05T17:33:00.880861+0000","last_became_peered":"2024-09-05T17:33:00.880861+0000","last_unstale":"2024-09-05T17:33:46.642508+0000","last_undegraded":"2024-09-05T17:33:46.642508+0000","last_fullsized":"2024-09-05T17:33:46.642508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:06:13.457185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070026660000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3321,"num_read_kb":48513,"num_write":581,"num_write_kb":29613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":14386340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"165'646","reported_seq":7500,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.646736+0000","last_change":"2024-09-05T17:33:40.602148+0000","last_active":"2024-09-05T17:33:46.646736+0000","last_peered":"2024-09-05T17:33:46.646736+0000","last_clean":"2024-09-05T17:33:46.646736+0000","last_became_active":"2024-09-05T17:33:40.596831+0000","last_became_peered":"2024-09-05T17:33:40.596831+0000","last_unstale":"2024-09-05T17:33:46.646736+0000","last_undegraded":"2024-09-05T17:33:46.646736+0000","last_fullsized":"2024-09-05T17:33:46.646736+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:30:06.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034718079999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7401,"num_read_kb":46805,"num_write":650,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":118,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.648400+0000","last_change":"2024-09-05T17:33:46.648152+0000","last_active":"2024-09-05T17:33:46.648400+0000","last_peered":"2024-09-05T17:33:46.648400+0000","last_clean":"2024-09-05T17:33:46.648400+0000","last_became_active":"2024-09-05T17:33:46.647362+0000","last_became_peered":"2024-09-05T17:33:46.647362+0000","last_unstale":"2024-09-05T17:33:46.648400+0000","last_undegraded":"2024-09-05T17:33:46.648400+0000","last_fullsized":"2024-09-05T17:33:46.648400+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:37:29.442303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"164'1413","reported_seq":3828,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645411+0000","last_change":"2024-09-05T17:33:27.560376+0000","last_active":"2024-09-05T17:33:46.645411+0000","last_peered":"2024-09-05T17:33:46.645411+0000","last_clean":"2024-09-05T17:33:46.645411+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:33:46.645411+0000","last_undegraded":"2024-09-05T17:33:46.645411+0000","last_fullsized":"2024-09-05T17:33:46.645411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1413,"log_dups_size":0,"ondisk_log_size":1413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:29:58.319332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002241706,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8376,"num_read_kb":10426,"num_write":2211,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":338,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.641317+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:33:46.641317+0000","last_peered":"2024-09-05T17:33:46.641317+0000","last_clean":"2024-09-05T17:33:46.641317+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:33:46.641317+0000","last_undegraded":"2024-09-05T17:33:46.641317+0000","last_fullsized":"2024-09-05T17:33:46.641317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"164'629","reported_seq":9160,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.038772+0000","last_change":"2024-09-05T17:33:27.525383+0000","last_active":"2024-09-05T17:33:47.038772+0000","last_peered":"2024-09-05T17:33:47.038772+0000","last_clean":"2024-09-05T17:33:47.038772+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:33:47.038772+0000","last_undegraded":"2024-09-05T17:33:47.038772+0000","last_fullsized":"2024-09-05T17:33:47.038772+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:44:42.369588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003039473,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":10304,"num_read_kb":44453,"num_write":657,"num_write_kb":11408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":365,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927329+0000","last_change":"2024-09-05T17:33:33.538285+0000","last_active":"2024-09-05T17:33:46.927329+0000","last_peered":"2024-09-05T17:33:46.927329+0000","last_clean":"2024-09-05T17:33:46.927329+0000","last_became_active":"2024-09-05T17:33:33.537690+0000","last_became_peered":"2024-09-05T17:33:33.537690+0000","last_unstale":"2024-09-05T17:33:46.927329+0000","last_undegraded":"2024-09-05T17:33:46.927329+0000","last_fullsized":"2024-09-05T17:33:46.927329+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:52.432612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"164'1672","reported_seq":5830,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.640346+0000","last_change":"2024-09-05T17:33:27.523383+0000","last_active":"2024-09-05T17:33:46.640346+0000","last_peered":"2024-09-05T17:33:46.640346+0000","last_clean":"2024-09-05T17:33:46.640346+0000","last_became_active":"2024-09-05T17:33:00.882030+0000","last_became_peered":"2024-09-05T17:33:00.882030+0000","last_unstale":"2024-09-05T17:33:46.640346+0000","last_undegraded":"2024-09-05T17:33:46.640346+0000","last_fullsized":"2024-09-05T17:33:46.640346+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1672,"log_dups_size":0,"ondisk_log_size":1672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:58:05.278028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731130000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":11375,"num_read_kb":20355,"num_write":2804,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":4232019,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":204,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642068+0000","last_change":"2024-09-05T17:33:00.874549+0000","last_active":"2024-09-05T17:33:46.642068+0000","last_peered":"2024-09-05T17:33:46.642068+0000","last_clean":"2024-09-05T17:33:46.642068+0000","last_became_active":"2024-09-05T17:33:00.874107+0000","last_became_peered":"2024-09-05T17:33:00.874107+0000","last_unstale":"2024-09-05T17:33:46.642068+0000","last_undegraded":"2024-09-05T17:33:46.642068+0000","last_fullsized":"2024-09-05T17:33:46.642068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:27:19.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":456,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927500+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:33:46.927500+0000","last_peered":"2024-09-05T17:33:46.927500+0000","last_clean":"2024-09-05T17:33:46.927500+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:33:46.927500+0000","last_undegraded":"2024-09-05T17:33:46.927500+0000","last_fullsized":"2024-09-05T17:33:46.927500+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"165'371","reported_seq":3757,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.640304+0000","last_change":"2024-09-05T17:33:37.564245+0000","last_active":"2024-09-05T17:33:46.640304+0000","last_peered":"2024-09-05T17:33:46.640304+0000","last_clean":"2024-09-05T17:33:46.640304+0000","last_became_active":"2024-09-05T17:33:37.562005+0000","last_became_peered":"2024-09-05T17:33:37.562005+0000","last_unstale":"2024-09-05T17:33:46.640304+0000","last_undegraded":"2024-09-05T17:33:46.640304+0000","last_fullsized":"2024-09-05T17:33:46.640304+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:09:10.250677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020255859999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2194,"num_read_kb":22000,"num_write":372,"num_write_kb":23336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":10672151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"165'781","reported_seq":5295,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.646452+0000","last_change":"2024-09-05T17:33:27.528354+0000","last_active":"2024-09-05T17:33:46.646452+0000","last_peered":"2024-09-05T17:33:46.646452+0000","last_clean":"2024-09-05T17:33:46.646452+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:33:46.646452+0000","last_undegraded":"2024-09-05T17:33:46.646452+0000","last_fullsized":"2024-09-05T17:33:46.646452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:21:45.713020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030988410000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":7390,"num_read_kb":22417,"num_write":1016,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'577","reported_seq":4385,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.834965+0000","last_change":"2024-09-05T17:33:27.562550+0000","last_active":"2024-09-05T17:33:46.834965+0000","last_peered":"2024-09-05T17:33:46.834965+0000","last_clean":"2024-09-05T17:33:46.834965+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:33:46.834965+0000","last_undegraded":"2024-09-05T17:33:46.834965+0000","last_fullsized":"2024-09-05T17:33:46.834965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:25:22.635469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00250161,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":4100,"num_read_kb":25746,"num_write":648,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'1097","reported_seq":11157,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.640433+0000","last_change":"2024-09-05T17:33:27.523997+0000","last_active":"2024-09-05T17:33:46.640433+0000","last_peered":"2024-09-05T17:33:46.640433+0000","last_clean":"2024-09-05T17:33:46.640433+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:33:46.640433+0000","last_undegraded":"2024-09-05T17:33:46.640433+0000","last_fullsized":"2024-09-05T17:33:46.640433+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:12:41.390494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020407899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13753,"num_read_kb":37185,"num_write":1490,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"164'341","reported_seq":1345,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642162+0000","last_change":"2024-09-05T17:33:27.536025+0000","last_active":"2024-09-05T17:33:46.642162+0000","last_peered":"2024-09-05T17:33:46.642162+0000","last_clean":"2024-09-05T17:33:46.642162+0000","last_became_active":"2024-09-05T17:33:00.880726+0000","last_became_peered":"2024-09-05T17:33:00.880726+0000","last_unstale":"2024-09-05T17:33:46.642162+0000","last_undegraded":"2024-09-05T17:33:46.642162+0000","last_fullsized":"2024-09-05T17:33:46.642162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:50:36.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005949078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1859,"num_read_kb":26572,"num_write":297,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2323932,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"164'457","reported_seq":2329,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927686+0000","last_change":"2024-09-05T17:33:27.550025+0000","last_active":"2024-09-05T17:33:46.927686+0000","last_peered":"2024-09-05T17:33:46.927686+0000","last_clean":"2024-09-05T17:33:46.927686+0000","last_became_active":"2024-09-05T17:33:03.523083+0000","last_became_peered":"2024-09-05T17:33:03.523083+0000","last_unstale":"2024-09-05T17:33:46.927686+0000","last_undegraded":"2024-09-05T17:33:46.927686+0000","last_fullsized":"2024-09-05T17:33:46.927686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:43:53.113722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066025220000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2520,"num_read_kb":18217,"num_write":450,"num_write_kb":14035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":5727979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'275","reported_seq":2433,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927185+0000","last_change":"2024-09-05T17:33:27.547453+0000","last_active":"2024-09-05T17:33:46.927185+0000","last_peered":"2024-09-05T17:33:46.927185+0000","last_clean":"2024-09-05T17:33:46.927185+0000","last_became_active":"2024-09-05T17:33:22.545834+0000","last_became_peered":"2024-09-05T17:33:22.545834+0000","last_unstale":"2024-09-05T17:33:46.927185+0000","last_undegraded":"2024-09-05T17:33:46.927185+0000","last_fullsized":"2024-09-05T17:33:46.927185+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:30:38.658230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045236249999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1479,"num_read_kb":36544,"num_write":267,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":281923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'494","reported_seq":4932,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927938+0000","last_change":"2024-09-05T17:33:27.548358+0000","last_active":"2024-09-05T17:33:46.927938+0000","last_peered":"2024-09-05T17:33:46.927938+0000","last_clean":"2024-09-05T17:33:46.927938+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:33:46.927938+0000","last_undegraded":"2024-09-05T17:33:46.927938+0000","last_fullsized":"2024-09-05T17:33:46.927938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:08:37.483626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054246379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5058,"num_read_kb":16620,"num_write":538,"num_write_kb":6033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"165'606","reported_seq":4845,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645312+0000","last_change":"2024-09-05T17:33:27.559853+0000","last_active":"2024-09-05T17:33:46.645312+0000","last_peered":"2024-09-05T17:33:46.645312+0000","last_clean":"2024-09-05T17:33:46.645312+0000","last_became_active":"2024-09-05T17:32:51.787759+0000","last_became_peered":"2024-09-05T17:32:51.787759+0000","last_unstale":"2024-09-05T17:33:46.645312+0000","last_undegraded":"2024-09-05T17:33:46.645312+0000","last_fullsized":"2024-09-05T17:33:46.645312+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:30:12.742477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897787,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5143,"num_read_kb":22219,"num_write":724,"num_write_kb":9428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":4462425,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"164'371","reported_seq":2102,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927456+0000","last_change":"2024-09-05T17:33:27.545860+0000","last_active":"2024-09-05T17:33:46.927456+0000","last_peered":"2024-09-05T17:33:46.927456+0000","last_clean":"2024-09-05T17:33:46.927456+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:33:46.927456+0000","last_undegraded":"2024-09-05T17:33:46.927456+0000","last_fullsized":"2024-09-05T17:33:46.927456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:41:24.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033971309999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1549,"num_read_kb":23623,"num_write":342,"num_write_kb":9257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"164'606","reported_seq":8788,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.038783+0000","last_change":"2024-09-05T17:33:27.526697+0000","last_active":"2024-09-05T17:33:47.038783+0000","last_peered":"2024-09-05T17:33:47.038783+0000","last_clean":"2024-09-05T17:33:47.038783+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:33:47.038783+0000","last_undegraded":"2024-09-05T17:33:47.038783+0000","last_fullsized":"2024-09-05T17:33:47.038783+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:09:50.306527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042963640000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":9444,"num_read_kb":23607,"num_write":623,"num_write_kb":9519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'819","reported_seq":3415,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927522+0000","last_change":"2024-09-05T17:33:27.546665+0000","last_active":"2024-09-05T17:33:46.927522+0000","last_peered":"2024-09-05T17:33:46.927522+0000","last_clean":"2024-09-05T17:33:46.927522+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:33:46.927522+0000","last_undegraded":"2024-09-05T17:33:46.927522+0000","last_fullsized":"2024-09-05T17:33:46.927522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:43:32.759282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040029130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6651,"num_read_kb":10491,"num_write":908,"num_write_kb":5581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":28,"num_read":174589,"num_read_kb":806017,"num_write":23773,"num_write_kb":363990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2614,"num_bytes_recovered":109452136,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},"log_size":19946,"ondisk_log_size":19946,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41704,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330136,"statfs":{"total":96636764160,"available":96594059264,"internally_reserved":0,"allocated":2248704,"data_stored":1646876,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542190,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41652,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330188,"statfs":{"total":96636764160,"available":96594112512,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":137,"seq":588410519564,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35252,"kb_used_data":2144,"kb_used_omap":28,"kb_used_meta":33059,"kb_avail":94336588,"statfs":{"total":96636764160,"available":96600666112,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28700,"internal_metadata":33853412},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65264,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306576,"statfs":{"total":96636764160,"available":96569933824,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51388,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320452,"statfs":{"total":96636764160,"available":96584142848,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55544,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316296,"statfs":{"total":96636764160,"available":96579887104,"internally_reserved":0,"allocated":2199552,"data_stored":1056546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47256,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324584,"statfs":{"total":96636764160,"available":96588374016,"internally_reserved":0,"allocated":2232320,"data_stored":1646876,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:33:52.050 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T17:33:52.342 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:52.342 INFO:teuthology.orchestra.run.smithi050.stdout:{"epoch":182,"fsid":"229efc05-fdc4-4e1f-8246-413b49f3eeda","created":"2024-09-05T17:30:12.762369+0000","modified":"2024-09-05T17:33:46.635377+0000","last_up_change":"2024-09-05T17:32:59.859041+0000","last_in_change":"2024-09-05T17:32:09.963211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T17:30:25.818485+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-05T17:30:30.943478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-05T17:30:42.082168+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":44,"snap_epoch":165,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"38dd1565-a37f-4055-acb3-aa82457cf9e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6824","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6825","nonce":1446480840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6826","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6827","nonce":1446480840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6830","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6831","nonce":1446480840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6828","nonce":1446480840},{"type":"v1","addr":"172.21.15.50:6829","nonce":1446480840}]},"public_addr":"172.21.15.50:6825/1446480840","cluster_addr":"172.21.15.50:6827/1446480840","heartbeat_back_addr":"172.21.15.50:6831/1446480840","heartbeat_front_addr":"172.21.15.50:6829/1446480840","state":["exists","up"]},{"osd":1,"uuid":"f5ef5f03-d714-4329-b14b-1881ad1e7358","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6808","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6809","nonce":3885625462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6810","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6811","nonce":3885625462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6814","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6815","nonce":3885625462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6812","nonce":3885625462},{"type":"v1","addr":"172.21.15.50:6813","nonce":3885625462}]},"public_addr":"172.21.15.50:6809/3885625462","cluster_addr":"172.21.15.50:6811/3885625462","heartbeat_back_addr":"172.21.15.50:6815/3885625462","heartbeat_front_addr":"172.21.15.50:6813/3885625462","state":["exists","up"]},{"osd":2,"uuid":"7b87b0cc-2484-4a66-be1b-232a7e36dc11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6800","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6801","nonce":3027840955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6802","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6803","nonce":3027840955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6806","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6807","nonce":3027840955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6804","nonce":3027840955},{"type":"v1","addr":"172.21.15.50:6805","nonce":3027840955}]},"public_addr":"172.21.15.50:6801/3027840955","cluster_addr":"172.21.15.50:6803/3027840955","heartbeat_back_addr":"172.21.15.50:6807/3027840955","heartbeat_front_addr":"172.21.15.50:6805/3027840955","state":["exists","up"]},{"osd":3,"uuid":"f6d63b1e-2673-4542-a2e2-fbb0c4577864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6816","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6817","nonce":2889879466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6818","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6819","nonce":2889879466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6822","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6823","nonce":2889879466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.50:6820","nonce":2889879466},{"type":"v1","addr":"172.21.15.50:6821","nonce":2889879466}]},"public_addr":"172.21.15.50:6817/2889879466","cluster_addr":"172.21.15.50:6819/2889879466","heartbeat_back_addr":"172.21.15.50:6823/2889879466","heartbeat_front_addr":"172.21.15.50:6821/2889879466","state":["exists","up"]},{"osd":4,"uuid":"273ec4c6-0c2a-41d5-90c1-68b317365484","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6809","nonce":1774319792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6811","nonce":1774319792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6815","nonce":1774319792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":1774319792},{"type":"v1","addr":"172.21.15.110:6813","nonce":1774319792}]},"public_addr":"172.21.15.110:6809/1774319792","cluster_addr":"172.21.15.110:6811/1774319792","heartbeat_back_addr":"172.21.15.110:6815/1774319792","heartbeat_front_addr":"172.21.15.110:6813/1774319792","state":["exists","up"]},{"osd":5,"uuid":"5f6cf36b-2dd0-47de-97c4-42e98f849734","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":103,"up_from":137,"up_thru":181,"down_at":104,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6817","nonce":1996346700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6819","nonce":1996346700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6823","nonce":1996346700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1996346700},{"type":"v1","addr":"172.21.15.110:6821","nonce":1996346700}]},"public_addr":"172.21.15.110:6817/1996346700","cluster_addr":"172.21.15.110:6819/1996346700","heartbeat_back_addr":"172.21.15.110:6823/1996346700","heartbeat_front_addr":"172.21.15.110:6821/1996346700","state":["exists","up"]},{"osd":6,"uuid":"2d6ed4a6-3d83-4c9d-9e96-2dbab049448a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6825","nonce":792585226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6827","nonce":792585226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6831","nonce":792585226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":792585226},{"type":"v1","addr":"172.21.15.110:6829","nonce":792585226}]},"public_addr":"172.21.15.110:6825/792585226","cluster_addr":"172.21.15.110:6827/792585226","heartbeat_back_addr":"172.21.15.110:6831/792585226","heartbeat_front_addr":"172.21.15.110:6829/792585226","state":["exists","up"]},{"osd":7,"uuid":"dbe1901b-5f78-419f-864a-89946452f4a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6801","nonce":2161010500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6803","nonce":2161010500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6807","nonce":2161010500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2161010500},{"type":"v1","addr":"172.21.15.110:6805","nonce":2161010500}]},"public_addr":"172.21.15.110:6801/2161010500","cluster_addr":"172.21.15.110:6803/2161010500","heartbeat_back_addr":"172.21.15.110:6807/2161010500","heartbeat_front_addr":"172.21.15.110:6805/2161010500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:22.246726+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.638940+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.694544+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.653253+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.467561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.797765+0000","dead_epoch":104},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.649372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T17:30:21.242988+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.7","osds":[6,7]},{"pgid":"3.10","osds":[1,7]}],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T17:33:53.360 INFO:tasks.ceph:Scrubbing osd.0 2024-09-05T17:33:53.361 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-05T17:33:53.529 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:53.529 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T17:33:53.529 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:53.545 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-05T17:33:53.860 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 0 to deep-scrub 2024-09-05T17:33:53.878 INFO:tasks.ceph:Scrubbing osd.1 2024-09-05T17:33:53.878 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-05T17:33:54.026 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:54.027 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T17:33:54.027 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:54.041 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-05T17:33:54.336 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 1 to deep-scrub 2024-09-05T17:33:54.354 INFO:tasks.ceph:Scrubbing osd.2 2024-09-05T17:33:54.355 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-05T17:33:54.493 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:54.493 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T17:33:54.493 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:54.508 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-05T17:33:54.813 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 2 to deep-scrub 2024-09-05T17:33:54.831 INFO:tasks.ceph:Scrubbing osd.3 2024-09-05T17:33:54.832 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-05T17:33:54.970 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:54.970 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T17:33:54.970 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:54.986 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-05T17:33:55.291 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 3 to deep-scrub 2024-09-05T17:33:55.310 INFO:tasks.ceph:Scrubbing osd.4 2024-09-05T17:33:55.310 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-05T17:33:55.468 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:55.468 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T17:33:55.468 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:55.483 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-05T17:33:55.780 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 4 to deep-scrub 2024-09-05T17:33:55.799 INFO:tasks.ceph:Scrubbing osd.5 2024-09-05T17:33:55.799 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-05T17:33:55.946 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:55.946 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T17:33:55.946 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:55.961 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-05T17:33:56.257 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 5 to deep-scrub 2024-09-05T17:33:56.276 INFO:tasks.ceph:Scrubbing osd.6 2024-09-05T17:33:56.276 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-05T17:33:56.429 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:56.429 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T17:33:56.429 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:56.444 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-05T17:33:56.748 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 6 to deep-scrub 2024-09-05T17:33:56.769 INFO:tasks.ceph:Scrubbing osd.7 2024-09-05T17:33:56.769 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-05T17:33:56.926 INFO:teuthology.orchestra.run.smithi050.stdout:{ 2024-09-05T17:33:56.926 INFO:teuthology.orchestra.run.smithi050.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-05T17:33:56.926 INFO:teuthology.orchestra.run.smithi050.stdout:} 2024-09-05T17:33:56.943 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-05T17:33:57.249 INFO:teuthology.orchestra.run.smithi050.stderr:instructed osd(s) 7 to deep-scrub 2024-09-05T17:33:57.270 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:33:57.577 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:33:57.578 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:33:57.596 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-05T17:33:55.825501+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":28,"num_read":174655,"num_read_kb":806072,"num_write":23876,"num_write_kb":365620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2618,"num_bytes_recovered":110632872,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20022,"ondisk_log_size":20022,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":389440,"kb_used_data":17232,"kb_used_omap":38,"kb_used_meta":371993,"kb_avail":754585280,"statfs":{"total":773094113280,"available":772695326720,"internally_reserved":0,"allocated":17645568,"data_stored":9632876,"data_compressed":12002,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":39856,"internal_metadata":380920912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002826"},"pg_stats":[{"pgid":"3.1f","version":"165'448","reported_seq":3528,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.039644+0000","last_change":"2024-09-05T17:33:27.528018+0000","last_active":"2024-09-05T17:33:47.039644+0000","last_peered":"2024-09-05T17:33:47.039644+0000","last_clean":"2024-09-05T17:33:47.039644+0000","last_became_active":"2024-09-05T17:33:03.518878+0000","last_became_peered":"2024-09-05T17:33:03.518878+0000","last_unstale":"2024-09-05T17:33:47.039644+0000","last_undegraded":"2024-09-05T17:33:47.039644+0000","last_fullsized":"2024-09-05T17:33:47.039644+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:23:49.365058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047849989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3196,"num_read_kb":16881,"num_write":523,"num_write_kb":14009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":8881682,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"164'338","reported_seq":2204,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.640693+0000","last_change":"2024-09-05T17:33:27.523243+0000","last_active":"2024-09-05T17:33:46.640693+0000","last_peered":"2024-09-05T17:33:46.640693+0000","last_clean":"2024-09-05T17:33:46.640693+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:33:46.640693+0000","last_undegraded":"2024-09-05T17:33:46.640693+0000","last_fullsized":"2024-09-05T17:33:46.640693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:31:29.837874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014678029999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2321,"num_read_kb":10748,"num_write":345,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"163'555","reported_seq":3395,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642209+0000","last_change":"2024-09-05T17:33:27.533144+0000","last_active":"2024-09-05T17:33:46.642209+0000","last_peered":"2024-09-05T17:33:46.642209+0000","last_clean":"2024-09-05T17:33:46.642209+0000","last_became_active":"2024-09-05T17:33:00.876268+0000","last_became_peered":"2024-09-05T17:33:00.876268+0000","last_unstale":"2024-09-05T17:33:46.642209+0000","last_undegraded":"2024-09-05T17:33:46.642209+0000","last_fullsized":"2024-09-05T17:33:46.642209+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:13:54.593252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030898620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3969,"num_read_kb":19900,"num_write":584,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"165'540","reported_seq":3720,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.653403+0000","last_change":"2024-09-05T17:33:46.653096+0000","last_active":"2024-09-05T17:33:46.653403+0000","last_peered":"2024-09-05T17:33:46.653403+0000","last_clean":"2024-09-05T17:33:46.653403+0000","last_became_active":"2024-09-05T17:33:46.648777+0000","last_became_peered":"2024-09-05T17:33:46.648777+0000","last_unstale":"2024-09-05T17:33:46.653403+0000","last_undegraded":"2024-09-05T17:33:46.653403+0000","last_fullsized":"2024-09-05T17:33:46.653403+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:04:53.109193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033133500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3871,"num_read_kb":20517,"num_write":615,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":4255396,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"164'442","reported_seq":2440,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.039421+0000","last_change":"2024-09-05T17:33:27.527618+0000","last_active":"2024-09-05T17:33:47.039421+0000","last_peered":"2024-09-05T17:33:47.039421+0000","last_clean":"2024-09-05T17:33:47.039421+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:33:47.039421+0000","last_undegraded":"2024-09-05T17:33:47.039421+0000","last_fullsized":"2024-09-05T17:33:47.039421+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:01:30.400215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045349270000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2391,"num_read_kb":34006,"num_write":458,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"164'699","reported_seq":6290,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.646461+0000","last_change":"2024-09-05T17:33:40.601569+0000","last_active":"2024-09-05T17:33:46.646461+0000","last_peered":"2024-09-05T17:33:46.646461+0000","last_clean":"2024-09-05T17:33:46.646461+0000","last_became_active":"2024-09-05T17:33:40.597916+0000","last_became_peered":"2024-09-05T17:33:40.597916+0000","last_unstale":"2024-09-05T17:33:46.646461+0000","last_undegraded":"2024-09-05T17:33:46.646461+0000","last_fullsized":"2024-09-05T17:33:46.646461+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:32:58.940343+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0011638989999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7746,"num_read_kb":18821,"num_write":755,"num_write_kb":4676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"162'604","reported_seq":8203,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645151+0000","last_change":"2024-09-05T17:33:27.559356+0000","last_active":"2024-09-05T17:33:46.645151+0000","last_peered":"2024-09-05T17:33:46.645151+0000","last_clean":"2024-09-05T17:33:46.645151+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:33:46.645151+0000","last_undegraded":"2024-09-05T17:33:46.645151+0000","last_fullsized":"2024-09-05T17:33:46.645151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:46:44.836387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014326129999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":8628,"num_read_kb":37043,"num_write":694,"num_write_kb":9672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"165'465","reported_seq":2894,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.639829+0000","last_change":"2024-09-05T17:33:27.522871+0000","last_active":"2024-09-05T17:33:46.639829+0000","last_peered":"2024-09-05T17:33:46.639829+0000","last_clean":"2024-09-05T17:33:46.639829+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:33:46.639829+0000","last_undegraded":"2024-09-05T17:33:46.639829+0000","last_fullsized":"2024-09-05T17:33:46.639829+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:33:41.546159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012170869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2261,"num_read_kb":32589,"num_write":546,"num_write_kb":10681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"164'767","reported_seq":2771,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.039505+0000","last_change":"2024-09-05T17:33:27.526380+0000","last_active":"2024-09-05T17:33:47.039505+0000","last_peered":"2024-09-05T17:33:47.039505+0000","last_clean":"2024-09-05T17:33:47.039505+0000","last_became_active":"2024-09-05T17:33:00.882325+0000","last_became_peered":"2024-09-05T17:33:00.882325+0000","last_unstale":"2024-09-05T17:33:47.039505+0000","last_undegraded":"2024-09-05T17:33:47.039505+0000","last_fullsized":"2024-09-05T17:33:47.039505+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:31:39.064715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036302930000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3604,"num_read_kb":12753,"num_write":1031,"num_write_kb":5567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":2814153,"num_keys_recovered":25,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"164'785","reported_seq":2033,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642380+0000","last_change":"2024-09-05T17:33:27.536152+0000","last_active":"2024-09-05T17:33:46.642380+0000","last_peered":"2024-09-05T17:33:46.642380+0000","last_clean":"2024-09-05T17:33:46.642380+0000","last_became_active":"2024-09-05T17:33:00.872821+0000","last_became_peered":"2024-09-05T17:33:00.872821+0000","last_unstale":"2024-09-05T17:33:46.642380+0000","last_undegraded":"2024-09-05T17:33:46.642380+0000","last_fullsized":"2024-09-05T17:33:46.642380+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:11:07.066264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053104290000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4301,"num_read_kb":14291,"num_write":964,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"164'320","reported_seq":1612,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.641240+0000","last_change":"2024-09-05T17:33:27.558751+0000","last_active":"2024-09-05T17:33:46.641240+0000","last_peered":"2024-09-05T17:33:46.641240+0000","last_clean":"2024-09-05T17:33:46.641240+0000","last_became_active":"2024-09-05T17:33:22.534475+0000","last_became_peered":"2024-09-05T17:33:22.534475+0000","last_unstale":"2024-09-05T17:33:46.641240+0000","last_undegraded":"2024-09-05T17:33:46.641240+0000","last_fullsized":"2024-09-05T17:33:46.641240+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:38:47.387024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012121090000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":845,"num_read_kb":16276,"num_write":252,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":569030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"164'500","reported_seq":14604,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.647127+0000","last_change":"2024-09-05T17:33:40.605573+0000","last_active":"2024-09-05T17:33:46.647127+0000","last_peered":"2024-09-05T17:33:46.647127+0000","last_clean":"2024-09-05T17:33:46.647127+0000","last_became_active":"2024-09-05T17:33:40.603253+0000","last_became_peered":"2024-09-05T17:33:40.603253+0000","last_unstale":"2024-09-05T17:33:46.647127+0000","last_undegraded":"2024-09-05T17:33:46.647127+0000","last_fullsized":"2024-09-05T17:33:46.647127+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:39:38.233465+0000","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0.007672519,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":15151,"num_read_kb":37250,"num_write":448,"num_write_kb":4447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":339,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.835100+0000","last_change":"2024-09-05T17:30:34.060553+0000","last_active":"2024-09-05T17:33:46.835100+0000","last_peered":"2024-09-05T17:33:46.835100+0000","last_clean":"2024-09-05T17:33:46.835100+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:33:46.835100+0000","last_undegraded":"2024-09-05T17:33:46.835100+0000","last_fullsized":"2024-09-05T17:33:46.835100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:52:46.461231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"165'524","reported_seq":6010,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.039442+0000","last_change":"2024-09-05T17:33:27.527118+0000","last_active":"2024-09-05T17:33:47.039442+0000","last_peered":"2024-09-05T17:33:47.039442+0000","last_clean":"2024-09-05T17:33:47.039442+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:33:47.039442+0000","last_undegraded":"2024-09-05T17:33:47.039442+0000","last_fullsized":"2024-09-05T17:33:47.039442+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:24:22.846163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042900200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6499,"num_read_kb":26402,"num_write":438,"num_write_kb":8494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645500+0000","last_change":"2024-09-05T17:33:33.531154+0000","last_active":"2024-09-05T17:33:46.645500+0000","last_peered":"2024-09-05T17:33:46.645500+0000","last_clean":"2024-09-05T17:33:46.645500+0000","last_became_active":"2024-09-05T17:33:33.530723+0000","last_became_peered":"2024-09-05T17:33:33.530723+0000","last_unstale":"2024-09-05T17:33:46.645500+0000","last_undegraded":"2024-09-05T17:33:46.645500+0000","last_fullsized":"2024-09-05T17:33:46.645500+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:09:48.381008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"163'457","reported_seq":1963,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.835017+0000","last_change":"2024-09-05T17:33:27.562400+0000","last_active":"2024-09-05T17:33:46.835017+0000","last_peered":"2024-09-05T17:33:46.835017+0000","last_clean":"2024-09-05T17:33:46.835017+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:33:46.835017+0000","last_undegraded":"2024-09-05T17:33:46.835017+0000","last_fullsized":"2024-09-05T17:33:46.835017+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:13:25.162013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002227845,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1548,"num_read_kb":31708,"num_write":526,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":353,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927621+0000","last_change":"2024-09-05T17:32:10.996698+0000","last_active":"2024-09-05T17:33:46.927621+0000","last_peered":"2024-09-05T17:33:46.927621+0000","last_clean":"2024-09-05T17:33:46.927621+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:33:46.927621+0000","last_undegraded":"2024-09-05T17:33:46.927621+0000","last_fullsized":"2024-09-05T17:33:46.927621+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:32:41.017481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"164'780","reported_seq":3963,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645171+0000","last_change":"2024-09-05T17:33:27.559456+0000","last_active":"2024-09-05T17:33:46.645171+0000","last_peered":"2024-09-05T17:33:46.645171+0000","last_clean":"2024-09-05T17:33:46.645171+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:33:46.645171+0000","last_undegraded":"2024-09-05T17:33:46.645171+0000","last_fullsized":"2024-09-05T17:33:46.645171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:35:34.672356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00154923,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6341,"num_read_kb":21039,"num_write":1016,"num_write_kb":10164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":350,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645288+0000","last_change":"2024-09-05T17:32:10.990437+0000","last_active":"2024-09-05T17:33:46.645288+0000","last_peered":"2024-09-05T17:33:46.645288+0000","last_clean":"2024-09-05T17:33:46.645288+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:33:46.645288+0000","last_undegraded":"2024-09-05T17:33:46.645288+0000","last_fullsized":"2024-09-05T17:33:46.645288+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:00:46.828584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"165'567","reported_seq":2194,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642508+0000","last_change":"2024-09-05T17:33:27.537861+0000","last_active":"2024-09-05T17:33:46.642508+0000","last_peered":"2024-09-05T17:33:46.642508+0000","last_clean":"2024-09-05T17:33:46.642508+0000","last_became_active":"2024-09-05T17:33:00.880861+0000","last_became_peered":"2024-09-05T17:33:00.880861+0000","last_unstale":"2024-09-05T17:33:46.642508+0000","last_undegraded":"2024-09-05T17:33:46.642508+0000","last_fullsized":"2024-09-05T17:33:46.642508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:06:13.457185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070026660000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3321,"num_read_kb":48513,"num_write":581,"num_write_kb":29613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":14386340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"165'646","reported_seq":7500,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.646736+0000","last_change":"2024-09-05T17:33:40.602148+0000","last_active":"2024-09-05T17:33:46.646736+0000","last_peered":"2024-09-05T17:33:46.646736+0000","last_clean":"2024-09-05T17:33:46.646736+0000","last_became_active":"2024-09-05T17:33:40.596831+0000","last_became_peered":"2024-09-05T17:33:40.596831+0000","last_unstale":"2024-09-05T17:33:46.646736+0000","last_undegraded":"2024-09-05T17:33:46.646736+0000","last_fullsized":"2024-09-05T17:33:46.646736+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:30:06.716770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034718079999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7401,"num_read_kb":46805,"num_write":650,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":118,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.648400+0000","last_change":"2024-09-05T17:33:46.648152+0000","last_active":"2024-09-05T17:33:46.648400+0000","last_peered":"2024-09-05T17:33:46.648400+0000","last_clean":"2024-09-05T17:33:46.648400+0000","last_became_active":"2024-09-05T17:33:46.647362+0000","last_became_peered":"2024-09-05T17:33:46.647362+0000","last_unstale":"2024-09-05T17:33:46.648400+0000","last_undegraded":"2024-09-05T17:33:46.648400+0000","last_fullsized":"2024-09-05T17:33:46.648400+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:37:29.442303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"164'1413","reported_seq":3828,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645411+0000","last_change":"2024-09-05T17:33:27.560376+0000","last_active":"2024-09-05T17:33:46.645411+0000","last_peered":"2024-09-05T17:33:46.645411+0000","last_clean":"2024-09-05T17:33:46.645411+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:33:46.645411+0000","last_undegraded":"2024-09-05T17:33:46.645411+0000","last_fullsized":"2024-09-05T17:33:46.645411+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1413,"log_dups_size":0,"ondisk_log_size":1413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:29:58.319332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002241706,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8376,"num_read_kb":10426,"num_write":2211,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":338,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.641317+0000","last_change":"2024-09-05T17:30:34.143473+0000","last_active":"2024-09-05T17:33:46.641317+0000","last_peered":"2024-09-05T17:33:46.641317+0000","last_clean":"2024-09-05T17:33:46.641317+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:33:46.641317+0000","last_undegraded":"2024-09-05T17:33:46.641317+0000","last_fullsized":"2024-09-05T17:33:46.641317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:03:16.984227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"182'630","reported_seq":9169,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:54.105941+0000","last_change":"2024-09-05T17:33:54.105941+0000","last_active":"2024-09-05T17:33:54.105941+0000","last_peered":"2024-09-05T17:33:54.105941+0000","last_clean":"2024-09-05T17:33:54.105941+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:33:54.105941+0000","last_undegraded":"2024-09-05T17:33:54.105941+0000","last_fullsized":"2024-09-05T17:33:54.105941+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'630","last_scrub_stamp":"2024-09-05T17:33:54.105870+0000","last_deep_scrub":"182'630","last_deep_scrub_stamp":"2024-09-05T17:33:54.105870+0000","last_clean_scrub_stamp":"2024-09-05T17:33:54.105870+0000","objects_scrubbed":1,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:52:16.858915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.003039473,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":10304,"num_read_kb":44453,"num_write":657,"num_write_kb":11408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":365,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927329+0000","last_change":"2024-09-05T17:33:33.538285+0000","last_active":"2024-09-05T17:33:46.927329+0000","last_peered":"2024-09-05T17:33:46.927329+0000","last_clean":"2024-09-05T17:33:46.927329+0000","last_became_active":"2024-09-05T17:33:33.537690+0000","last_became_peered":"2024-09-05T17:33:33.537690+0000","last_unstale":"2024-09-05T17:33:46.927329+0000","last_undegraded":"2024-09-05T17:33:46.927329+0000","last_fullsized":"2024-09-05T17:33:46.927329+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:23:52.432612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"164'1672","reported_seq":5830,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.640346+0000","last_change":"2024-09-05T17:33:27.523383+0000","last_active":"2024-09-05T17:33:46.640346+0000","last_peered":"2024-09-05T17:33:46.640346+0000","last_clean":"2024-09-05T17:33:46.640346+0000","last_became_active":"2024-09-05T17:33:00.882030+0000","last_became_peered":"2024-09-05T17:33:00.882030+0000","last_unstale":"2024-09-05T17:33:46.640346+0000","last_undegraded":"2024-09-05T17:33:46.640346+0000","last_fullsized":"2024-09-05T17:33:46.640346+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1672,"log_dups_size":0,"ondisk_log_size":1672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:58:05.278028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014731130000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":11375,"num_read_kb":20355,"num_write":2804,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":4232019,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":204,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642068+0000","last_change":"2024-09-05T17:33:00.874549+0000","last_active":"2024-09-05T17:33:46.642068+0000","last_peered":"2024-09-05T17:33:46.642068+0000","last_clean":"2024-09-05T17:33:46.642068+0000","last_became_active":"2024-09-05T17:33:00.874107+0000","last_became_peered":"2024-09-05T17:33:00.874107+0000","last_unstale":"2024-09-05T17:33:46.642068+0000","last_undegraded":"2024-09-05T17:33:46.642068+0000","last_fullsized":"2024-09-05T17:33:46.642068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:31.027711+0000","last_clean_scrub_stamp":"2024-09-05T17:30:31.027711+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:27:19.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":456,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927500+0000","last_change":"2024-09-05T17:32:11.006672+0000","last_active":"2024-09-05T17:33:46.927500+0000","last_peered":"2024-09-05T17:33:46.927500+0000","last_clean":"2024-09-05T17:33:46.927500+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:33:46.927500+0000","last_undegraded":"2024-09-05T17:33:46.927500+0000","last_fullsized":"2024-09-05T17:33:46.927500+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:25.987330+0000","last_clean_scrub_stamp":"2024-09-05T17:30:25.987330+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:21:30.031659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"165'371","reported_seq":3757,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.640304+0000","last_change":"2024-09-05T17:33:37.564245+0000","last_active":"2024-09-05T17:33:46.640304+0000","last_peered":"2024-09-05T17:33:46.640304+0000","last_clean":"2024-09-05T17:33:46.640304+0000","last_became_active":"2024-09-05T17:33:37.562005+0000","last_became_peered":"2024-09-05T17:33:37.562005+0000","last_unstale":"2024-09-05T17:33:46.640304+0000","last_undegraded":"2024-09-05T17:33:46.640304+0000","last_fullsized":"2024-09-05T17:33:46.640304+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:09:10.250677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020255859999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2194,"num_read_kb":22000,"num_write":372,"num_write_kb":23336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":10672151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"165'781","reported_seq":5295,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.646452+0000","last_change":"2024-09-05T17:33:27.528354+0000","last_active":"2024-09-05T17:33:46.646452+0000","last_peered":"2024-09-05T17:33:46.646452+0000","last_clean":"2024-09-05T17:33:46.646452+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:33:46.646452+0000","last_undegraded":"2024-09-05T17:33:46.646452+0000","last_fullsized":"2024-09-05T17:33:46.646452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:21:45.713020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030988410000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":7390,"num_read_kb":22417,"num_write":1016,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"164'577","reported_seq":4385,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.834965+0000","last_change":"2024-09-05T17:33:27.562550+0000","last_active":"2024-09-05T17:33:46.834965+0000","last_peered":"2024-09-05T17:33:46.834965+0000","last_clean":"2024-09-05T17:33:46.834965+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:33:46.834965+0000","last_undegraded":"2024-09-05T17:33:46.834965+0000","last_fullsized":"2024-09-05T17:33:46.834965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:25:22.635469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00250161,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":4100,"num_read_kb":25746,"num_write":648,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'1097","reported_seq":11157,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.640433+0000","last_change":"2024-09-05T17:33:27.523997+0000","last_active":"2024-09-05T17:33:46.640433+0000","last_peered":"2024-09-05T17:33:46.640433+0000","last_clean":"2024-09-05T17:33:46.640433+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:33:46.640433+0000","last_undegraded":"2024-09-05T17:33:46.640433+0000","last_fullsized":"2024-09-05T17:33:46.640433+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:12:41.390494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020407899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13753,"num_read_kb":37185,"num_write":1490,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"164'341","reported_seq":1345,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.642162+0000","last_change":"2024-09-05T17:33:27.536025+0000","last_active":"2024-09-05T17:33:46.642162+0000","last_peered":"2024-09-05T17:33:46.642162+0000","last_clean":"2024-09-05T17:33:46.642162+0000","last_became_active":"2024-09-05T17:33:00.880726+0000","last_became_peered":"2024-09-05T17:33:00.880726+0000","last_unstale":"2024-09-05T17:33:46.642162+0000","last_undegraded":"2024-09-05T17:33:46.642162+0000","last_fullsized":"2024-09-05T17:33:46.642162+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:50:36.868913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005949078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1859,"num_read_kb":26572,"num_write":297,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2323932,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"164'457","reported_seq":2329,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927686+0000","last_change":"2024-09-05T17:33:27.550025+0000","last_active":"2024-09-05T17:33:46.927686+0000","last_peered":"2024-09-05T17:33:46.927686+0000","last_clean":"2024-09-05T17:33:46.927686+0000","last_became_active":"2024-09-05T17:33:03.523083+0000","last_became_peered":"2024-09-05T17:33:03.523083+0000","last_unstale":"2024-09-05T17:33:46.927686+0000","last_undegraded":"2024-09-05T17:33:46.927686+0000","last_fullsized":"2024-09-05T17:33:46.927686+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:43:53.113722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066025220000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2520,"num_read_kb":18217,"num_write":450,"num_write_kb":14035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":5727979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"164'275","reported_seq":2433,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927185+0000","last_change":"2024-09-05T17:33:27.547453+0000","last_active":"2024-09-05T17:33:46.927185+0000","last_peered":"2024-09-05T17:33:46.927185+0000","last_clean":"2024-09-05T17:33:46.927185+0000","last_became_active":"2024-09-05T17:33:22.545834+0000","last_became_peered":"2024-09-05T17:33:22.545834+0000","last_unstale":"2024-09-05T17:33:46.927185+0000","last_undegraded":"2024-09-05T17:33:46.927185+0000","last_fullsized":"2024-09-05T17:33:46.927185+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:30:38.658230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045236249999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1479,"num_read_kb":36544,"num_write":267,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":281923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'494","reported_seq":4932,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927938+0000","last_change":"2024-09-05T17:33:27.548358+0000","last_active":"2024-09-05T17:33:46.927938+0000","last_peered":"2024-09-05T17:33:46.927938+0000","last_clean":"2024-09-05T17:33:46.927938+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:33:46.927938+0000","last_undegraded":"2024-09-05T17:33:46.927938+0000","last_fullsized":"2024-09-05T17:33:46.927938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:08:37.483626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054246379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5058,"num_read_kb":16620,"num_write":538,"num_write_kb":6033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"165'606","reported_seq":4845,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.645312+0000","last_change":"2024-09-05T17:33:27.559853+0000","last_active":"2024-09-05T17:33:46.645312+0000","last_peered":"2024-09-05T17:33:46.645312+0000","last_clean":"2024-09-05T17:33:46.645312+0000","last_became_active":"2024-09-05T17:32:51.787759+0000","last_became_peered":"2024-09-05T17:32:51.787759+0000","last_unstale":"2024-09-05T17:33:46.645312+0000","last_undegraded":"2024-09-05T17:33:46.645312+0000","last_fullsized":"2024-09-05T17:33:46.645312+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:30:12.742477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001897787,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5143,"num_read_kb":22219,"num_write":724,"num_write_kb":9428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":4462425,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"164'371","reported_seq":2102,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927456+0000","last_change":"2024-09-05T17:33:27.545860+0000","last_active":"2024-09-05T17:33:46.927456+0000","last_peered":"2024-09-05T17:33:46.927456+0000","last_clean":"2024-09-05T17:33:46.927456+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:33:46.927456+0000","last_undegraded":"2024-09-05T17:33:46.927456+0000","last_fullsized":"2024-09-05T17:33:46.927456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:41:24.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033971309999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1549,"num_read_kb":23623,"num_write":342,"num_write_kb":9257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"164'606","reported_seq":8788,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:47.038783+0000","last_change":"2024-09-05T17:33:27.526697+0000","last_active":"2024-09-05T17:33:47.038783+0000","last_peered":"2024-09-05T17:33:47.038783+0000","last_clean":"2024-09-05T17:33:47.038783+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:33:47.038783+0000","last_undegraded":"2024-09-05T17:33:47.038783+0000","last_fullsized":"2024-09-05T17:33:47.038783+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:09:50.306527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042963640000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":9444,"num_read_kb":23607,"num_write":623,"num_write_kb":9519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'819","reported_seq":3415,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:46.927522+0000","last_change":"2024-09-05T17:33:27.546665+0000","last_active":"2024-09-05T17:33:46.927522+0000","last_peered":"2024-09-05T17:33:46.927522+0000","last_clean":"2024-09-05T17:33:46.927522+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:33:46.927522+0000","last_undegraded":"2024-09-05T17:33:46.927522+0000","last_fullsized":"2024-09-05T17:33:46.927522+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:30:42.559059+0000","last_clean_scrub_stamp":"2024-09-05T17:30:42.559059+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:43:32.759282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040029130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6651,"num_read_kb":10491,"num_write":908,"num_write_kb":5581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":28,"num_read":174589,"num_read_kb":806017,"num_write":23773,"num_write_kb":363990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2614,"num_bytes_recovered":109452136,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},"log_size":19947,"ondisk_log_size":19947,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542191,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41704,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330136,"statfs":{"total":96636764160,"available":96594059264,"internally_reserved":0,"allocated":2248704,"data_stored":1646876,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41652,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330188,"statfs":{"total":96636764160,"available":96594112512,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":137,"seq":588410519565,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35252,"kb_used_data":2144,"kb_used_omap":28,"kb_used_meta":33059,"kb_avail":94336588,"statfs":{"total":96636764160,"available":96600666112,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28700,"internal_metadata":33853412},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65264,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306576,"statfs":{"total":96636764160,"available":96569933824,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51388,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320452,"statfs":{"total":96636764160,"available":96584142848,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55544,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316296,"statfs":{"total":96636764160,"available":96579887104,"internally_reserved":0,"allocated":2199552,"data_stored":1056546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47256,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324584,"statfs":{"total":96636764160,"available":96588374016,"internally_reserved":0,"allocated":2232320,"data_stored":1646876,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:33:57.634 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.634 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.634 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.635 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-05T17:30:31.027711+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=31, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-05T17:30:31.027711+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=31, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-05T17:30:31.027711+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=31, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-05T17:30:31.027711+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=31, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.636 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-05T17:30:31.027711+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=31, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-05T17:30:31.027711+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=31, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-05T17:30:31.027711+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=31, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-05T17:30:31.027711+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=31, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-05T17:30:25.987330+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.637 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.638 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-05T17:30:42.559059+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=30, tm_sec=42, tm_wday=3, tm_yday=249, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=5, tm_hour=17, tm_min=33, tm_sec=52, tm_wday=3, tm_yday=249, tm_isdst=0) 2024-09-05T17:33:57.639 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-05T17:34:17.640 DEBUG:teuthology.orchestra.run.smithi050:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T17:34:17.970 INFO:teuthology.orchestra.run.smithi050.stdout: 2024-09-05T17:34:17.971 INFO:teuthology.orchestra.run.smithi050.stderr:dumped all 2024-09-05T17:34:17.990 INFO:teuthology.orchestra.run.smithi050.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-05T17:34:17.832401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":28,"num_read":174655,"num_read_kb":806072,"num_write":23876,"num_write_kb":365620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2618,"num_bytes_recovered":110632872,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20056,"ondisk_log_size":20056,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":389392,"kb_used_data":17232,"kb_used_omap":38,"kb_used_meta":371993,"kb_avail":754585328,"statfs":{"total":773094113280,"available":772695375872,"internally_reserved":0,"allocated":17645568,"data_stored":9632876,"data_compressed":12002,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":39856,"internal_metadata":380920912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003827"},"pg_stats":[{"pgid":"3.1f","version":"182'449","reported_seq":3537,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:59.172972+0000","last_change":"2024-09-05T17:33:59.172972+0000","last_active":"2024-09-05T17:33:59.172972+0000","last_peered":"2024-09-05T17:33:59.172972+0000","last_clean":"2024-09-05T17:33:59.172972+0000","last_became_active":"2024-09-05T17:33:03.518878+0000","last_became_peered":"2024-09-05T17:33:03.518878+0000","last_unstale":"2024-09-05T17:33:59.172972+0000","last_undegraded":"2024-09-05T17:33:59.172972+0000","last_fullsized":"2024-09-05T17:33:59.172972+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'449","last_scrub_stamp":"2024-09-05T17:33:59.172787+0000","last_deep_scrub":"182'449","last_deep_scrub_stamp":"2024-09-05T17:33:59.172787+0000","last_clean_scrub_stamp":"2024-09-05T17:33:59.172787+0000","objects_scrubbed":1,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:45:21.613149+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0047849989999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3196,"num_read_kb":16881,"num_write":523,"num_write_kb":14009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":8881682,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"182'340","reported_seq":2214,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:59.321951+0000","last_change":"2024-09-05T17:33:59.321951+0000","last_active":"2024-09-05T17:33:59.321951+0000","last_peered":"2024-09-05T17:33:59.321951+0000","last_clean":"2024-09-05T17:33:59.321951+0000","last_became_active":"2024-09-05T17:30:43.594468+0000","last_became_peered":"2024-09-05T17:30:43.594468+0000","last_unstale":"2024-09-05T17:33:59.321951+0000","last_undegraded":"2024-09-05T17:33:59.321951+0000","last_fullsized":"2024-09-05T17:33:59.321951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'340","last_scrub_stamp":"2024-09-05T17:33:59.321727+0000","last_deep_scrub":"182'340","last_deep_scrub_stamp":"2024-09-05T17:33:59.321727+0000","last_clean_scrub_stamp":"2024-09-05T17:33:59.321727+0000","objects_scrubbed":2,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:30:42.397776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014678029999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":2321,"num_read_kb":10748,"num_write":345,"num_write_kb":4129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"182'556","reported_seq":3404,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:34:01.627205+0000","last_change":"2024-09-05T17:34:01.627205+0000","last_active":"2024-09-05T17:34:01.627205+0000","last_peered":"2024-09-05T17:34:01.627205+0000","last_clean":"2024-09-05T17:34:01.627205+0000","last_became_active":"2024-09-05T17:33:00.876268+0000","last_became_peered":"2024-09-05T17:33:00.876268+0000","last_unstale":"2024-09-05T17:34:01.627205+0000","last_undegraded":"2024-09-05T17:34:01.627205+0000","last_fullsized":"2024-09-05T17:34:01.627205+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'556","last_scrub_stamp":"2024-09-05T17:34:01.627009+0000","last_deep_scrub":"182'556","last_deep_scrub_stamp":"2024-09-05T17:34:01.627009+0000","last_clean_scrub_stamp":"2024-09-05T17:34:01.627009+0000","objects_scrubbed":1,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:53:50.645815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0030898620000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":3969,"num_read_kb":19900,"num_write":584,"num_write_kb":7622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":2097152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"182'541","reported_seq":3729,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:34:00.651292+0000","last_change":"2024-09-05T17:34:00.651292+0000","last_active":"2024-09-05T17:34:00.651292+0000","last_peered":"2024-09-05T17:34:00.651292+0000","last_clean":"2024-09-05T17:34:00.651292+0000","last_became_active":"2024-09-05T17:33:46.648777+0000","last_became_peered":"2024-09-05T17:33:46.648777+0000","last_unstale":"2024-09-05T17:34:00.651292+0000","last_undegraded":"2024-09-05T17:34:00.651292+0000","last_fullsized":"2024-09-05T17:34:00.651292+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'541","last_scrub_stamp":"2024-09-05T17:34:00.651108+0000","last_deep_scrub":"182'541","last_deep_scrub_stamp":"2024-09-05T17:34:00.651108+0000","last_clean_scrub_stamp":"2024-09-05T17:34:00.651108+0000","objects_scrubbed":1,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:01:28.623837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0033133500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3871,"num_read_kb":20517,"num_write":615,"num_write_kb":9784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":4255396,"num_keys_recovered":46,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"164'442","reported_seq":2448,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:57.150004+0000","last_change":"2024-09-05T17:33:57.150004+0000","last_active":"2024-09-05T17:33:57.150004+0000","last_peered":"2024-09-05T17:33:57.150004+0000","last_clean":"2024-09-05T17:33:57.150004+0000","last_became_active":"2024-09-05T17:32:16.016377+0000","last_became_peered":"2024-09-05T17:32:16.016377+0000","last_unstale":"2024-09-05T17:33:57.150004+0000","last_undegraded":"2024-09-05T17:33:57.150004+0000","last_fullsized":"2024-09-05T17:33:57.150004+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'442","last_scrub_stamp":"2024-09-05T17:33:57.149879+0000","last_deep_scrub":"164'442","last_deep_scrub_stamp":"2024-09-05T17:33:57.149879+0000","last_clean_scrub_stamp":"2024-09-05T17:33:57.149879+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:03:39.745275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045349270000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2391,"num_read_kb":34006,"num_write":458,"num_write_kb":23033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":145,"num_bytes_recovered":4834351,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"182'701","reported_seq":6300,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:58.945062+0000","last_change":"2024-09-05T17:33:58.945062+0000","last_active":"2024-09-05T17:33:58.945062+0000","last_peered":"2024-09-05T17:33:58.945062+0000","last_clean":"2024-09-05T17:33:58.945062+0000","last_became_active":"2024-09-05T17:33:40.597916+0000","last_became_peered":"2024-09-05T17:33:40.597916+0000","last_unstale":"2024-09-05T17:33:58.945062+0000","last_undegraded":"2024-09-05T17:33:58.945062+0000","last_fullsized":"2024-09-05T17:33:58.945062+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'701","last_scrub_stamp":"2024-09-05T17:33:58.944861+0000","last_deep_scrub":"182'701","last_deep_scrub_stamp":"2024-09-05T17:33:58.944861+0000","last_clean_scrub_stamp":"2024-09-05T17:33:58.944861+0000","objects_scrubbed":2,"log_size":701,"log_dups_size":0,"ondisk_log_size":701,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:56:37.873109+0000","scrub_duration":7,"objects_trimmed":2,"snaptrim_duration":0.0011638989999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7746,"num_read_kb":18821,"num_write":755,"num_write_kb":4676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"182'605","reported_seq":8212,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:57.924625+0000","last_change":"2024-09-05T17:33:57.924625+0000","last_active":"2024-09-05T17:33:57.924625+0000","last_peered":"2024-09-05T17:33:57.924625+0000","last_clean":"2024-09-05T17:33:57.924625+0000","last_became_active":"2024-09-05T17:30:43.590550+0000","last_became_peered":"2024-09-05T17:30:43.590550+0000","last_unstale":"2024-09-05T17:33:57.924625+0000","last_undegraded":"2024-09-05T17:33:57.924625+0000","last_fullsized":"2024-09-05T17:33:57.924625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'605","last_scrub_stamp":"2024-09-05T17:33:57.924422+0000","last_deep_scrub":"182'605","last_deep_scrub_stamp":"2024-09-05T17:33:57.924422+0000","last_clean_scrub_stamp":"2024-09-05T17:33:57.924422+0000","objects_scrubbed":1,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:13:17.744692+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0014326129999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":8628,"num_read_kb":37043,"num_write":694,"num_write_kb":9672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"165'465","reported_seq":2902,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:56.376115+0000","last_change":"2024-09-05T17:33:56.376115+0000","last_active":"2024-09-05T17:33:56.376115+0000","last_peered":"2024-09-05T17:33:56.376115+0000","last_clean":"2024-09-05T17:33:56.376115+0000","last_became_active":"2024-09-05T17:32:15.013384+0000","last_became_peered":"2024-09-05T17:32:15.013384+0000","last_unstale":"2024-09-05T17:33:56.376115+0000","last_undegraded":"2024-09-05T17:33:56.376115+0000","last_fullsized":"2024-09-05T17:33:56.376115+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'465","last_scrub_stamp":"2024-09-05T17:33:56.375929+0000","last_deep_scrub":"165'465","last_deep_scrub_stamp":"2024-09-05T17:33:56.375929+0000","last_clean_scrub_stamp":"2024-09-05T17:33:56.375929+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:12:57.481673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012170869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2261,"num_read_kb":32589,"num_write":546,"num_write_kb":10681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":5940925,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"182'769","reported_seq":2781,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:56.139843+0000","last_change":"2024-09-05T17:33:56.139843+0000","last_active":"2024-09-05T17:33:56.139843+0000","last_peered":"2024-09-05T17:33:56.139843+0000","last_clean":"2024-09-05T17:33:56.139843+0000","last_became_active":"2024-09-05T17:33:00.882325+0000","last_became_peered":"2024-09-05T17:33:00.882325+0000","last_unstale":"2024-09-05T17:33:56.139843+0000","last_undegraded":"2024-09-05T17:33:56.139843+0000","last_fullsized":"2024-09-05T17:33:56.139843+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'769","last_scrub_stamp":"2024-09-05T17:33:56.139708+0000","last_deep_scrub":"182'769","last_deep_scrub_stamp":"2024-09-05T17:33:56.139708+0000","last_clean_scrub_stamp":"2024-09-05T17:33:56.139708+0000","objects_scrubbed":2,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:58:26.953876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0036302930000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":3604,"num_read_kb":12753,"num_write":1031,"num_write_kb":5567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":2814153,"num_keys_recovered":25,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"182'786","reported_seq":2042,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:34:02.660057+0000","last_change":"2024-09-05T17:34:02.660057+0000","last_active":"2024-09-05T17:34:02.660057+0000","last_peered":"2024-09-05T17:34:02.660057+0000","last_clean":"2024-09-05T17:34:02.660057+0000","last_became_active":"2024-09-05T17:33:00.872821+0000","last_became_peered":"2024-09-05T17:33:00.872821+0000","last_unstale":"2024-09-05T17:34:02.660057+0000","last_undegraded":"2024-09-05T17:34:02.660057+0000","last_fullsized":"2024-09-05T17:34:02.660057+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'786","last_scrub_stamp":"2024-09-05T17:34:02.659851+0000","last_deep_scrub":"182'786","last_deep_scrub_stamp":"2024-09-05T17:34:02.659851+0000","last_clean_scrub_stamp":"2024-09-05T17:34:02.659851+0000","objects_scrubbed":1,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:45:58.068118+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0053104290000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":4301,"num_read_kb":14291,"num_write":964,"num_write_kb":13325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"182'321","reported_seq":1621,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:56.430005+0000","last_change":"2024-09-05T17:33:56.430005+0000","last_active":"2024-09-05T17:33:56.430005+0000","last_peered":"2024-09-05T17:33:56.430005+0000","last_clean":"2024-09-05T17:33:56.430005+0000","last_became_active":"2024-09-05T17:33:22.534475+0000","last_became_peered":"2024-09-05T17:33:22.534475+0000","last_unstale":"2024-09-05T17:33:56.430005+0000","last_undegraded":"2024-09-05T17:33:56.430005+0000","last_fullsized":"2024-09-05T17:33:56.430005+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'321","last_scrub_stamp":"2024-09-05T17:33:56.429940+0000","last_deep_scrub":"182'321","last_deep_scrub_stamp":"2024-09-05T17:33:56.429940+0000","last_clean_scrub_stamp":"2024-09-05T17:33:56.429940+0000","objects_scrubbed":1,"log_size":321,"log_dups_size":0,"ondisk_log_size":321,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:22:01.775871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012121090000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":845,"num_read_kb":16276,"num_write":252,"num_write_kb":10122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":569030,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"182'501","reported_seq":14613,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:56.970730+0000","last_change":"2024-09-05T17:33:56.970730+0000","last_active":"2024-09-05T17:33:56.970730+0000","last_peered":"2024-09-05T17:33:56.970730+0000","last_clean":"2024-09-05T17:33:56.970730+0000","last_became_active":"2024-09-05T17:33:40.603253+0000","last_became_peered":"2024-09-05T17:33:40.603253+0000","last_unstale":"2024-09-05T17:33:56.970730+0000","last_undegraded":"2024-09-05T17:33:56.970730+0000","last_fullsized":"2024-09-05T17:33:56.970730+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'501","last_scrub_stamp":"2024-09-05T17:33:56.970506+0000","last_deep_scrub":"182'501","last_deep_scrub_stamp":"2024-09-05T17:33:56.970506+0000","last_clean_scrub_stamp":"2024-09-05T17:33:56.970506+0000","objects_scrubbed":1,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T18:48:48.880282+0000","scrub_duration":3,"objects_trimmed":8,"snaptrim_duration":0.007672519,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":15151,"num_read_kb":37250,"num_write":448,"num_write_kb":4447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":347,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:57.368288+0000","last_change":"2024-09-05T17:33:57.368288+0000","last_active":"2024-09-05T17:33:57.368288+0000","last_peered":"2024-09-05T17:33:57.368288+0000","last_clean":"2024-09-05T17:33:57.368288+0000","last_became_active":"2024-09-05T17:30:32.047910+0000","last_became_peered":"2024-09-05T17:30:32.047910+0000","last_unstale":"2024-09-05T17:33:57.368288+0000","last_undegraded":"2024-09-05T17:33:57.368288+0000","last_fullsized":"2024-09-05T17:33:57.368288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:33:57.368109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:33:57.368109+0000","last_clean_scrub_stamp":"2024-09-05T17:33:57.368109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:34:10.326538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00084345000000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"182'525","reported_seq":6019,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:55.130260+0000","last_change":"2024-09-05T17:33:55.130260+0000","last_active":"2024-09-05T17:33:55.130260+0000","last_peered":"2024-09-05T17:33:55.130260+0000","last_clean":"2024-09-05T17:33:55.130260+0000","last_became_active":"2024-09-05T17:32:15.009822+0000","last_became_peered":"2024-09-05T17:32:15.009822+0000","last_unstale":"2024-09-05T17:33:55.130260+0000","last_undegraded":"2024-09-05T17:33:55.130260+0000","last_fullsized":"2024-09-05T17:33:55.130260+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'525","last_scrub_stamp":"2024-09-05T17:33:55.130182+0000","last_deep_scrub":"182'525","last_deep_scrub_stamp":"2024-09-05T17:33:55.130182+0000","last_clean_scrub_stamp":"2024-09-05T17:33:55.130182+0000","objects_scrubbed":1,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:35:07.995674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042900200000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6499,"num_read_kb":26402,"num_write":438,"num_write_kb":8494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":10437006,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:56.918630+0000","last_change":"2024-09-05T17:33:56.918630+0000","last_active":"2024-09-05T17:33:56.918630+0000","last_peered":"2024-09-05T17:33:56.918630+0000","last_clean":"2024-09-05T17:33:56.918630+0000","last_became_active":"2024-09-05T17:33:33.530723+0000","last_became_peered":"2024-09-05T17:33:33.530723+0000","last_unstale":"2024-09-05T17:33:56.918630+0000","last_undegraded":"2024-09-05T17:33:56.918630+0000","last_fullsized":"2024-09-05T17:33:56.918630+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:33:56.918552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:33:56.918552+0000","last_clean_scrub_stamp":"2024-09-05T17:33:56.918552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:13:18.689573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"182'458","reported_seq":1972,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:59.447315+0000","last_change":"2024-09-05T17:33:59.447315+0000","last_active":"2024-09-05T17:33:59.447315+0000","last_peered":"2024-09-05T17:33:59.447315+0000","last_clean":"2024-09-05T17:33:59.447315+0000","last_became_active":"2024-09-05T17:31:18.496116+0000","last_became_peered":"2024-09-05T17:31:18.496116+0000","last_unstale":"2024-09-05T17:33:59.447315+0000","last_undegraded":"2024-09-05T17:33:59.447315+0000","last_fullsized":"2024-09-05T17:33:59.447315+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'458","last_scrub_stamp":"2024-09-05T17:33:59.447142+0000","last_deep_scrub":"182'458","last_deep_scrub_stamp":"2024-09-05T17:33:59.447142+0000","last_clean_scrub_stamp":"2024-09-05T17:33:59.447142+0000","objects_scrubbed":1,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:12:40.667264+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002227845,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1548,"num_read_kb":31708,"num_write":526,"num_write_kb":12088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":44,"num_bytes_recovered":192481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":361,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:58.818095+0000","last_change":"2024-09-05T17:33:58.818095+0000","last_active":"2024-09-05T17:33:58.818095+0000","last_peered":"2024-09-05T17:33:58.818095+0000","last_clean":"2024-09-05T17:33:58.818095+0000","last_became_active":"2024-09-05T17:32:10.996110+0000","last_became_peered":"2024-09-05T17:32:10.996110+0000","last_unstale":"2024-09-05T17:33:58.818095+0000","last_undegraded":"2024-09-05T17:33:58.818095+0000","last_fullsized":"2024-09-05T17:33:58.818095+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:33:58.817911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:33:58.817911+0000","last_clean_scrub_stamp":"2024-09-05T17:33:58.817911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T05:26:09.876942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093705999999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"182'781","reported_seq":3972,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:58.961340+0000","last_change":"2024-09-05T17:33:58.961340+0000","last_active":"2024-09-05T17:33:58.961340+0000","last_peered":"2024-09-05T17:33:58.961340+0000","last_clean":"2024-09-05T17:33:58.961340+0000","last_became_active":"2024-09-05T17:30:43.589072+0000","last_became_peered":"2024-09-05T17:30:43.589072+0000","last_unstale":"2024-09-05T17:33:58.961340+0000","last_undegraded":"2024-09-05T17:33:58.961340+0000","last_fullsized":"2024-09-05T17:33:58.961340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'781","last_scrub_stamp":"2024-09-05T17:33:58.961159+0000","last_deep_scrub":"182'781","last_deep_scrub_stamp":"2024-09-05T17:33:58.961159+0000","last_clean_scrub_stamp":"2024-09-05T17:33:58.961159+0000","objects_scrubbed":1,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:21:25.018536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00154923,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":6341,"num_read_kb":21039,"num_write":1016,"num_write_kb":10164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":358,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:54.972954+0000","last_change":"2024-09-05T17:33:54.972954+0000","last_active":"2024-09-05T17:33:54.972954+0000","last_peered":"2024-09-05T17:33:54.972954+0000","last_clean":"2024-09-05T17:33:54.972954+0000","last_became_active":"2024-09-05T17:32:10.989701+0000","last_became_peered":"2024-09-05T17:32:10.989701+0000","last_unstale":"2024-09-05T17:33:54.972954+0000","last_undegraded":"2024-09-05T17:33:54.972954+0000","last_fullsized":"2024-09-05T17:33:54.972954+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:33:54.972873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:33:54.972873+0000","last_clean_scrub_stamp":"2024-09-05T17:33:54.972873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:14:25.585188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000907569,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"165'567","reported_seq":2202,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:57.647767+0000","last_change":"2024-09-05T17:33:57.647767+0000","last_active":"2024-09-05T17:33:57.647767+0000","last_peered":"2024-09-05T17:33:57.647767+0000","last_clean":"2024-09-05T17:33:57.647767+0000","last_became_active":"2024-09-05T17:33:00.880861+0000","last_became_peered":"2024-09-05T17:33:00.880861+0000","last_unstale":"2024-09-05T17:33:57.647767+0000","last_undegraded":"2024-09-05T17:33:57.647767+0000","last_fullsized":"2024-09-05T17:33:57.647767+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'567","last_scrub_stamp":"2024-09-05T17:33:57.647587+0000","last_deep_scrub":"165'567","last_deep_scrub_stamp":"2024-09-05T17:33:57.647587+0000","last_clean_scrub_stamp":"2024-09-05T17:33:57.647587+0000","objects_scrubbed":0,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:29:39.418650+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0070026660000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3321,"num_read_kb":48513,"num_write":581,"num_write_kb":29613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":14386340,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"182'647","reported_seq":7509,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:55.924090+0000","last_change":"2024-09-05T17:33:55.924090+0000","last_active":"2024-09-05T17:33:55.924090+0000","last_peered":"2024-09-05T17:33:55.924090+0000","last_clean":"2024-09-05T17:33:55.924090+0000","last_became_active":"2024-09-05T17:33:40.596831+0000","last_became_peered":"2024-09-05T17:33:40.596831+0000","last_unstale":"2024-09-05T17:33:55.924090+0000","last_undegraded":"2024-09-05T17:33:55.924090+0000","last_fullsized":"2024-09-05T17:33:55.924090+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'647","last_scrub_stamp":"2024-09-05T17:33:55.923928+0000","last_deep_scrub":"182'647","last_deep_scrub_stamp":"2024-09-05T17:33:55.923928+0000","last_clean_scrub_stamp":"2024-09-05T17:33:55.923928+0000","objects_scrubbed":2,"log_size":647,"log_dups_size":0,"ondisk_log_size":647,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:14:09.600163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0034718079999999998,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":7401,"num_read_kb":46805,"num_write":650,"num_write_kb":19097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":156,"num_bytes_recovered":5077825,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"182'3","reported_seq":127,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:56.655094+0000","last_change":"2024-09-05T17:33:56.655094+0000","last_active":"2024-09-05T17:33:56.655094+0000","last_peered":"2024-09-05T17:33:56.655094+0000","last_clean":"2024-09-05T17:33:56.655094+0000","last_became_active":"2024-09-05T17:33:46.647362+0000","last_became_peered":"2024-09-05T17:33:46.647362+0000","last_unstale":"2024-09-05T17:33:56.655094+0000","last_undegraded":"2024-09-05T17:33:56.655094+0000","last_fullsized":"2024-09-05T17:33:56.655094+0000","mapping_epoch":181,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":182,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'3","last_scrub_stamp":"2024-09-05T17:33:56.654920+0000","last_deep_scrub":"182'3","last_deep_scrub_stamp":"2024-09-05T17:33:56.654920+0000","last_clean_scrub_stamp":"2024-09-05T17:33:56.654920+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:45:15.788635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0019726879999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"182'1415","reported_seq":3838,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:55.937805+0000","last_change":"2024-09-05T17:33:55.937805+0000","last_active":"2024-09-05T17:33:55.937805+0000","last_peered":"2024-09-05T17:33:55.937805+0000","last_clean":"2024-09-05T17:33:55.937805+0000","last_became_active":"2024-09-05T17:30:43.589236+0000","last_became_peered":"2024-09-05T17:30:43.589236+0000","last_unstale":"2024-09-05T17:33:55.937805+0000","last_undegraded":"2024-09-05T17:33:55.937805+0000","last_fullsized":"2024-09-05T17:33:55.937805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'1415","last_scrub_stamp":"2024-09-05T17:33:55.937700+0000","last_deep_scrub":"182'1415","last_deep_scrub_stamp":"2024-09-05T17:33:55.937700+0000","last_clean_scrub_stamp":"2024-09-05T17:33:55.937700+0000","objects_scrubbed":2,"log_size":1415,"log_dups_size":0,"ondisk_log_size":1415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T21:36:49.484892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002241706,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":8376,"num_read_kb":10426,"num_write":2211,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":346,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:55.453730+0000","last_change":"2024-09-05T17:33:55.453730+0000","last_active":"2024-09-05T17:33:55.453730+0000","last_peered":"2024-09-05T17:33:55.453730+0000","last_clean":"2024-09-05T17:33:55.453730+0000","last_became_active":"2024-09-05T17:30:32.047922+0000","last_became_peered":"2024-09-05T17:30:32.047922+0000","last_unstale":"2024-09-05T17:33:55.453730+0000","last_undegraded":"2024-09-05T17:33:55.453730+0000","last_fullsized":"2024-09-05T17:33:55.453730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:33:55.453650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:33:55.453650+0000","last_clean_scrub_stamp":"2024-09-05T17:33:55.453650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:10:08.873432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000525016,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"182'630","reported_seq":9169,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:54.105941+0000","last_change":"2024-09-05T17:33:54.105941+0000","last_active":"2024-09-05T17:33:54.105941+0000","last_peered":"2024-09-05T17:33:54.105941+0000","last_clean":"2024-09-05T17:33:54.105941+0000","last_became_active":"2024-09-05T17:32:16.014545+0000","last_became_peered":"2024-09-05T17:32:16.014545+0000","last_unstale":"2024-09-05T17:33:54.105941+0000","last_undegraded":"2024-09-05T17:33:54.105941+0000","last_fullsized":"2024-09-05T17:33:54.105941+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'630","last_scrub_stamp":"2024-09-05T17:33:54.105870+0000","last_deep_scrub":"182'630","last_deep_scrub_stamp":"2024-09-05T17:33:54.105870+0000","last_clean_scrub_stamp":"2024-09-05T17:33:54.105870+0000","objects_scrubbed":1,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T03:52:16.858915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.003039473,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":10304,"num_read_kb":44453,"num_write":657,"num_write_kb":11408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":162,"num_bytes_recovered":4490555,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":373,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:59.801523+0000","last_change":"2024-09-05T17:33:59.801523+0000","last_active":"2024-09-05T17:33:59.801523+0000","last_peered":"2024-09-05T17:33:59.801523+0000","last_clean":"2024-09-05T17:33:59.801523+0000","last_became_active":"2024-09-05T17:33:33.537690+0000","last_became_peered":"2024-09-05T17:33:33.537690+0000","last_unstale":"2024-09-05T17:33:59.801523+0000","last_undegraded":"2024-09-05T17:33:59.801523+0000","last_fullsized":"2024-09-05T17:33:59.801523+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T17:33:59.801342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T17:33:59.801342+0000","last_clean_scrub_stamp":"2024-09-05T17:33:59.801342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:40:29.627672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097370200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"182'1673","reported_seq":5839,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:58.360993+0000","last_change":"2024-09-05T17:33:58.360993+0000","last_active":"2024-09-05T17:33:58.360993+0000","last_peered":"2024-09-05T17:33:58.360993+0000","last_clean":"2024-09-05T17:33:58.360993+0000","last_became_active":"2024-09-05T17:33:00.882030+0000","last_became_peered":"2024-09-05T17:33:00.882030+0000","last_unstale":"2024-09-05T17:33:58.360993+0000","last_undegraded":"2024-09-05T17:33:58.360993+0000","last_fullsized":"2024-09-05T17:33:58.360993+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'1673","last_scrub_stamp":"2024-09-05T17:33:58.360803+0000","last_deep_scrub":"182'1673","last_deep_scrub_stamp":"2024-09-05T17:33:58.360803+0000","last_clean_scrub_stamp":"2024-09-05T17:33:58.360803+0000","objects_scrubbed":1,"log_size":1673,"log_dups_size":0,"ondisk_log_size":1673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:13:51.562532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0014731130000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":11375,"num_read_kb":20355,"num_write":2804,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":4232019,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"182'2","reported_seq":213,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:58.639734+0000","last_change":"2024-09-05T17:33:58.639734+0000","last_active":"2024-09-05T17:33:58.639734+0000","last_peered":"2024-09-05T17:33:58.639734+0000","last_clean":"2024-09-05T17:33:58.639734+0000","last_became_active":"2024-09-05T17:33:00.874107+0000","last_became_peered":"2024-09-05T17:33:00.874107+0000","last_unstale":"2024-09-05T17:33:58.639734+0000","last_undegraded":"2024-09-05T17:33:58.639734+0000","last_fullsized":"2024-09-05T17:33:58.639734+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'2","last_scrub_stamp":"2024-09-05T17:33:58.639530+0000","last_deep_scrub":"182'2","last_deep_scrub_stamp":"2024-09-05T17:33:58.639530+0000","last_clean_scrub_stamp":"2024-09-05T17:33:58.639530+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T20:04:50.269376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"182'74","reported_seq":466,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:57.837737+0000","last_change":"2024-09-05T17:33:57.837737+0000","last_active":"2024-09-05T17:33:57.837737+0000","last_peered":"2024-09-05T17:33:57.837737+0000","last_clean":"2024-09-05T17:33:57.837737+0000","last_became_active":"2024-09-05T17:32:10.996658+0000","last_became_peered":"2024-09-05T17:32:10.996658+0000","last_unstale":"2024-09-05T17:33:57.837737+0000","last_undegraded":"2024-09-05T17:33:57.837737+0000","last_fullsized":"2024-09-05T17:33:57.837737+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'74","last_scrub_stamp":"2024-09-05T17:33:57.837554+0000","last_deep_scrub":"182'74","last_deep_scrub_stamp":"2024-09-05T17:33:57.837554+0000","last_clean_scrub_stamp":"2024-09-05T17:33:57.837554+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T00:57:33.764936+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"182'372","reported_seq":3766,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:55.420751+0000","last_change":"2024-09-05T17:33:55.420751+0000","last_active":"2024-09-05T17:33:55.420751+0000","last_peered":"2024-09-05T17:33:55.420751+0000","last_clean":"2024-09-05T17:33:55.420751+0000","last_became_active":"2024-09-05T17:33:37.562005+0000","last_became_peered":"2024-09-05T17:33:37.562005+0000","last_unstale":"2024-09-05T17:33:55.420751+0000","last_undegraded":"2024-09-05T17:33:55.420751+0000","last_fullsized":"2024-09-05T17:33:55.420751+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'372","last_scrub_stamp":"2024-09-05T17:33:55.420641+0000","last_deep_scrub":"182'372","last_deep_scrub_stamp":"2024-09-05T17:33:55.420641+0000","last_clean_scrub_stamp":"2024-09-05T17:33:55.420641+0000","objects_scrubbed":1,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:02:21.564745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020255859999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2194,"num_read_kb":22000,"num_write":372,"num_write_kb":23336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":398,"num_bytes_recovered":10672151,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"182'782","reported_seq":5304,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:57.964818+0000","last_change":"2024-09-05T17:33:57.964818+0000","last_active":"2024-09-05T17:33:57.964818+0000","last_peered":"2024-09-05T17:33:57.964818+0000","last_clean":"2024-09-05T17:33:57.964818+0000","last_became_active":"2024-09-05T17:30:43.576693+0000","last_became_peered":"2024-09-05T17:30:43.576693+0000","last_unstale":"2024-09-05T17:33:57.964818+0000","last_undegraded":"2024-09-05T17:33:57.964818+0000","last_fullsized":"2024-09-05T17:33:57.964818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'782","last_scrub_stamp":"2024-09-05T17:33:57.964626+0000","last_deep_scrub":"182'782","last_deep_scrub_stamp":"2024-09-05T17:33:57.964626+0000","last_clean_scrub_stamp":"2024-09-05T17:33:57.964626+0000","objects_scrubbed":1,"log_size":782,"log_dups_size":0,"ondisk_log_size":782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:23:01.467826+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0030988410000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":7390,"num_read_kb":22417,"num_write":1016,"num_write_kb":4578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"182'580","reported_seq":4396,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:58.417337+0000","last_change":"2024-09-05T17:33:58.417337+0000","last_active":"2024-09-05T17:33:58.417337+0000","last_peered":"2024-09-05T17:33:58.417337+0000","last_clean":"2024-09-05T17:33:58.417337+0000","last_became_active":"2024-09-05T17:30:43.590498+0000","last_became_peered":"2024-09-05T17:30:43.590498+0000","last_unstale":"2024-09-05T17:33:58.417337+0000","last_undegraded":"2024-09-05T17:33:58.417337+0000","last_fullsized":"2024-09-05T17:33:58.417337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'580","last_scrub_stamp":"2024-09-05T17:33:58.417153+0000","last_deep_scrub":"182'580","last_deep_scrub_stamp":"2024-09-05T17:33:58.417153+0000","last_clean_scrub_stamp":"2024-09-05T17:33:58.417153+0000","objects_scrubbed":3,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T02:15:04.926896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00250161,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":2,"num_read":4100,"num_read_kb":25746,"num_write":648,"num_write_kb":15521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"164'1097","reported_seq":11165,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:57.348772+0000","last_change":"2024-09-05T17:33:57.348772+0000","last_active":"2024-09-05T17:33:57.348772+0000","last_peered":"2024-09-05T17:33:57.348772+0000","last_clean":"2024-09-05T17:33:57.348772+0000","last_became_active":"2024-09-05T17:32:17.018254+0000","last_became_peered":"2024-09-05T17:32:17.018254+0000","last_unstale":"2024-09-05T17:33:57.348772+0000","last_undegraded":"2024-09-05T17:33:57.348772+0000","last_fullsized":"2024-09-05T17:33:57.348772+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'1097","last_scrub_stamp":"2024-09-05T17:33:57.348541+0000","last_deep_scrub":"164'1097","last_deep_scrub_stamp":"2024-09-05T17:33:57.348541+0000","last_clean_scrub_stamp":"2024-09-05T17:33:57.348541+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:03:10.078708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0020407899999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13753,"num_read_kb":37185,"num_write":1490,"num_write_kb":15768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":7858280,"num_keys_recovered":35,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"182'342","reported_seq":1354,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:59.689095+0000","last_change":"2024-09-05T17:33:59.689095+0000","last_active":"2024-09-05T17:33:59.689095+0000","last_peered":"2024-09-05T17:33:59.689095+0000","last_clean":"2024-09-05T17:33:59.689095+0000","last_became_active":"2024-09-05T17:33:00.880726+0000","last_became_peered":"2024-09-05T17:33:00.880726+0000","last_unstale":"2024-09-05T17:33:59.689095+0000","last_undegraded":"2024-09-05T17:33:59.689095+0000","last_fullsized":"2024-09-05T17:33:59.689095+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'342","last_scrub_stamp":"2024-09-05T17:33:59.688914+0000","last_deep_scrub":"182'342","last_deep_scrub_stamp":"2024-09-05T17:33:59.688914+0000","last_clean_scrub_stamp":"2024-09-05T17:33:59.688914+0000","objects_scrubbed":1,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T01:37:24.902795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.005949078,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":1859,"num_read_kb":26572,"num_write":297,"num_write_kb":5677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2323932,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"182'458","reported_seq":2338,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:34:00.835946+0000","last_change":"2024-09-05T17:34:00.835946+0000","last_active":"2024-09-05T17:34:00.835946+0000","last_peered":"2024-09-05T17:34:00.835946+0000","last_clean":"2024-09-05T17:34:00.835946+0000","last_became_active":"2024-09-05T17:33:03.523083+0000","last_became_peered":"2024-09-05T17:33:03.523083+0000","last_unstale":"2024-09-05T17:34:00.835946+0000","last_undegraded":"2024-09-05T17:34:00.835946+0000","last_fullsized":"2024-09-05T17:34:00.835946+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'458","last_scrub_stamp":"2024-09-05T17:34:00.835759+0000","last_deep_scrub":"182'458","last_deep_scrub_stamp":"2024-09-05T17:34:00.835759+0000","last_clean_scrub_stamp":"2024-09-05T17:34:00.835759+0000","objects_scrubbed":1,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T23:37:06.006501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0066025220000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":2520,"num_read_kb":18217,"num_write":450,"num_write_kb":14035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":5727979,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"182'277","reported_seq":2443,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:34:01.874464+0000","last_change":"2024-09-05T17:34:01.874464+0000","last_active":"2024-09-05T17:34:01.874464+0000","last_peered":"2024-09-05T17:34:01.874464+0000","last_clean":"2024-09-05T17:34:01.874464+0000","last_became_active":"2024-09-05T17:33:22.545834+0000","last_became_peered":"2024-09-05T17:33:22.545834+0000","last_unstale":"2024-09-05T17:34:01.874464+0000","last_undegraded":"2024-09-05T17:34:01.874464+0000","last_fullsized":"2024-09-05T17:34:01.874464+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'277","last_scrub_stamp":"2024-09-05T17:34:01.874283+0000","last_deep_scrub":"182'277","last_deep_scrub_stamp":"2024-09-05T17:34:01.874283+0000","last_clean_scrub_stamp":"2024-09-05T17:34:01.874283+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:43:59.705864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0045236249999999999,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":2,"num_read":1479,"num_read_kb":36544,"num_write":267,"num_write_kb":20470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":96,"num_bytes_recovered":281923,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'494","reported_seq":4940,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:34:02.829908+0000","last_change":"2024-09-05T17:34:02.829908+0000","last_active":"2024-09-05T17:34:02.829908+0000","last_peered":"2024-09-05T17:34:02.829908+0000","last_clean":"2024-09-05T17:34:02.829908+0000","last_became_active":"2024-09-05T17:30:43.600917+0000","last_became_peered":"2024-09-05T17:30:43.600917+0000","last_unstale":"2024-09-05T17:34:02.829908+0000","last_undegraded":"2024-09-05T17:34:02.829908+0000","last_fullsized":"2024-09-05T17:34:02.829908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'494","last_scrub_stamp":"2024-09-05T17:34:02.829641+0000","last_deep_scrub":"164'494","last_deep_scrub_stamp":"2024-09-05T17:34:02.829641+0000","last_clean_scrub_stamp":"2024-09-05T17:34:02.829641+0000","objects_scrubbed":0,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T17:40:17.711072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0054246379999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5058,"num_read_kb":16620,"num_write":538,"num_write_kb":6033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"165'606","reported_seq":4853,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:59.972762+0000","last_change":"2024-09-05T17:33:59.972762+0000","last_active":"2024-09-05T17:33:59.972762+0000","last_peered":"2024-09-05T17:33:59.972762+0000","last_clean":"2024-09-05T17:33:59.972762+0000","last_became_active":"2024-09-05T17:32:51.787759+0000","last_became_peered":"2024-09-05T17:32:51.787759+0000","last_unstale":"2024-09-05T17:33:59.972762+0000","last_undegraded":"2024-09-05T17:33:59.972762+0000","last_fullsized":"2024-09-05T17:33:59.972762+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'606","last_scrub_stamp":"2024-09-05T17:33:59.972556+0000","last_deep_scrub":"165'606","last_deep_scrub_stamp":"2024-09-05T17:33:59.972556+0000","last_clean_scrub_stamp":"2024-09-05T17:33:59.972556+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:05:07.784196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001897787,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5143,"num_read_kb":22219,"num_write":724,"num_write_kb":9428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":4462425,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"164'371","reported_seq":2110,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:34:03.876675+0000","last_change":"2024-09-05T17:34:03.876675+0000","last_active":"2024-09-05T17:34:03.876675+0000","last_peered":"2024-09-05T17:34:03.876675+0000","last_clean":"2024-09-05T17:34:03.876675+0000","last_became_active":"2024-09-05T17:30:43.597241+0000","last_became_peered":"2024-09-05T17:30:43.597241+0000","last_unstale":"2024-09-05T17:34:03.876675+0000","last_undegraded":"2024-09-05T17:34:03.876675+0000","last_fullsized":"2024-09-05T17:34:03.876675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'371","last_scrub_stamp":"2024-09-05T17:34:03.876494+0000","last_deep_scrub":"164'371","last_deep_scrub_stamp":"2024-09-05T17:34:03.876494+0000","last_clean_scrub_stamp":"2024-09-05T17:34:03.876494+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T22:05:20.029177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0033971309999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1549,"num_read_kb":23623,"num_write":342,"num_write_kb":9257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"182'607","reported_seq":8797,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:33:58.153863+0000","last_change":"2024-09-05T17:33:58.153863+0000","last_active":"2024-09-05T17:33:58.153863+0000","last_peered":"2024-09-05T17:33:58.153863+0000","last_clean":"2024-09-05T17:33:58.153863+0000","last_became_active":"2024-09-05T17:32:16.017207+0000","last_became_peered":"2024-09-05T17:32:16.017207+0000","last_unstale":"2024-09-05T17:33:58.153863+0000","last_undegraded":"2024-09-05T17:33:58.153863+0000","last_fullsized":"2024-09-05T17:33:58.153863+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"182'607","last_scrub_stamp":"2024-09-05T17:33:58.153665+0000","last_deep_scrub":"182'607","last_deep_scrub_stamp":"2024-09-05T17:33:58.153665+0000","last_clean_scrub_stamp":"2024-09-05T17:33:58.153665+0000","objects_scrubbed":1,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T19:16:57.015185+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0042963640000000004,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":1,"num_read":9444,"num_read_kb":23607,"num_write":623,"num_write_kb":9519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":5722227,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"164'819","reported_seq":3423,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-05T17:34:04.840393+0000","last_change":"2024-09-05T17:34:04.840393+0000","last_active":"2024-09-05T17:34:04.840393+0000","last_peered":"2024-09-05T17:34:04.840393+0000","last_clean":"2024-09-05T17:34:04.840393+0000","last_became_active":"2024-09-05T17:30:43.601100+0000","last_became_peered":"2024-09-05T17:30:43.601100+0000","last_unstale":"2024-09-05T17:34:04.840393+0000","last_undegraded":"2024-09-05T17:34:04.840393+0000","last_fullsized":"2024-09-05T17:34:04.840393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'819","last_scrub_stamp":"2024-09-05T17:34:04.840197+0000","last_deep_scrub":"164'819","last_deep_scrub_stamp":"2024-09-05T17:34:04.840197+0000","last_clean_scrub_stamp":"2024-09-05T17:34:04.840197+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-07T04:51:36.127486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0040029130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6651,"num_read_kb":10491,"num_write":908,"num_write_kb":5581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":28,"num_read":174589,"num_read_kb":806017,"num_write":23773,"num_write_kb":363990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2614,"num_bytes_recovered":109452136,"num_keys_recovered":262,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},"log_size":19977,"ondisk_log_size":19977,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":18410,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41700,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330140,"statfs":{"total":96636764160,"available":96594063360,"internally_reserved":0,"allocated":2248704,"data_stored":1646876,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41644,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330196,"statfs":{"total":96636764160,"available":96594120704,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":137,"seq":588410519569,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35248,"kb_used_data":2144,"kb_used_omap":28,"kb_used_meta":33059,"kb_avail":94336592,"statfs":{"total":96636764160,"available":96600670208,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28700,"internal_metadata":33853412},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542193,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51376,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320464,"statfs":{"total":96636764160,"available":96584155136,"internally_reserved":0,"allocated":2195456,"data_stored":1056527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65260,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94306580,"statfs":{"total":96636764160,"available":96569937920,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":64616903},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51372,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320468,"statfs":{"total":96636764160,"available":96584159232,"internally_reserved":0,"allocated":2191360,"data_stored":1056508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55540,"kb_used_data":2148,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316300,"statfs":{"total":96636764160,"available":96579891200,"internally_reserved":0,"allocated":2199552,"data_stored":1056546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47252,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324588,"statfs":{"total":96636764160,"available":96588378112,"internally_reserved":0,"allocated":2232320,"data_stored":1646876,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6408,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5594,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10325,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T17:34:17.993 DEBUG:teuthology.orchestra.run.smithi050:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-05T17:34:18.325 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-05T17:34:18.326 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-05T17:34:18.326 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-05T17:34:18.326 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:18.389 INFO:tasks.ceph.osd.0:Stopped 2024-09-05T17:34:18.390 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-05T17:34:18.390 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:18.476 INFO:tasks.ceph.osd.1:Stopped 2024-09-05T17:34:18.476 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-05T17:34:18.476 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:18.565 INFO:tasks.ceph.osd.2:Stopped 2024-09-05T17:34:18.565 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-05T17:34:18.565 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:18.644 INFO:tasks.ceph.osd.3:Stopped 2024-09-05T17:34:18.645 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-05T17:34:18.645 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:18.743 INFO:tasks.ceph.osd.4:Stopped 2024-09-05T17:34:18.743 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-05T17:34:18.743 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:18.825 INFO:tasks.ceph.osd.5:Stopped 2024-09-05T17:34:18.825 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-05T17:34:18.825 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:23.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-05T17:34:24.927 INFO:tasks.ceph.osd.6:Stopped 2024-09-05T17:34:24.928 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-05T17:34:24.928 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:25.005 INFO:tasks.ceph.osd.7:Stopped 2024-09-05T17:34:25.005 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-05T17:34:25.005 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-05T17:34:25.006 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:25.035 INFO:tasks.ceph.mgr.y:Stopped 2024-09-05T17:34:25.035 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-05T17:34:25.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:25.066 INFO:tasks.ceph.mgr.x:Stopped 2024-09-05T17:34:25.066 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-05T17:34:25.066 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-05T17:34:25.067 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:25.092 INFO:tasks.ceph.mon.a:Stopped 2024-09-05T17:34:25.092 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-05T17:34:25.092 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:25.148 INFO:tasks.ceph.mon.c:Stopped 2024-09-05T17:34:25.148 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-05T17:34:25.148 INFO:teuthology.orchestra.run:waiting for 300 2024-09-05T17:34:25.169 INFO:tasks.ceph.mon.b:Stopped 2024-09-05T17:34:25.169 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-05T17:34:25.170 DEBUG:teuthology.orchestra.run.smithi050:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-05T17:34:25.206 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:34:25.207 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-05T17:34:25.613 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:34:25.613 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-05T17:34:25.850 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:34:25.850 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-05T17:34:26.032 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:34:26.032 DEBUG:teuthology.orchestra.run.smithi050:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-05T17:34:26.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:34:26.225 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-05T17:34:26.518 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:34:26.519 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-05T17:34:26.726 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:34:26.727 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-05T17:34:26.915 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:34:26.915 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-05T17:34:27.075 INFO:tasks.ceph:Archiving mon data... 2024-09-05T17:34:27.076 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/data/mon.a.tgz 2024-09-05T17:34:27.076 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-05T17:34:27.082 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.JsTxYnoES0 2024-09-05T17:34:27.083 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JsTxYnoES0 2024-09-05T17:34:27.237 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.JsTxYnoES0 2024-09-05T17:34:27.301 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.JsTxYnoES0 is 420KB 2024-09-05T17:34:27.363 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.JsTxYnoES0 2024-09-05T17:34:27.368 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/data/mon.c.tgz 2024-09-05T17:34:27.368 DEBUG:teuthology.orchestra.run.smithi050:> mktemp 2024-09-05T17:34:27.414 INFO:teuthology.orchestra.run.smithi050.stdout:/tmp/tmp.wIeFsztN0h 2024-09-05T17:34:27.414 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.wIeFsztN0h 2024-09-05T17:34:27.596 DEBUG:teuthology.orchestra.run.smithi050:> sudo chmod 0666 /tmp/tmp.wIeFsztN0h 2024-09-05T17:34:27.661 DEBUG:teuthology.orchestra.remote:smithi050:/tmp/tmp.wIeFsztN0h is 571KB 2024-09-05T17:34:27.723 DEBUG:teuthology.orchestra.run.smithi050:> rm -fr /tmp/tmp.wIeFsztN0h 2024-09-05T17:34:27.728 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/data/mon.b.tgz 2024-09-05T17:34:27.729 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-05T17:34:27.735 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.oNFDghs0l5 2024-09-05T17:34:27.735 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.oNFDghs0l5 2024-09-05T17:34:27.918 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.oNFDghs0l5 2024-09-05T17:34:27.981 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.oNFDghs0l5 is 571KB 2024-09-05T17:34:28.043 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.oNFDghs0l5 2024-09-05T17:34:28.048 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-05T17:34:28.048 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-05T17:34:28.050 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-05T17:34:28.115 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-05T17:34:28.157 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-05T17:34:28.157 INFO:tasks.ceph:Archiving crash dumps... 2024-09-05T17:34:28.159 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/remote/smithi050/crash 2024-09-05T17:34:28.160 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-05T17:34:28.175 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/remote/smithi110/crash 2024-09-05T17:34:28.176 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-05T17:34:28.212 INFO:tasks.ceph:Compressing logs... 2024-09-05T17:34:28.212 DEBUG:teuthology.orchestra.run.smithi050:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T17:34:28.223 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T17:34:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35894.log 2024-09-05T17:34:28.245 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32961.log 2024-09-05T17:34:28.246 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35894.log.gz 2024-09-05T17:34:28.246 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35584.log 2024-09-05T17:34:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32961.log.gz 2024-09-05T17:34:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34090.log 2024-09-05T17:34:28.247 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30604.log 2024-09-05T17:34:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35584.log: /var/log/ceph/ceph-client.admin.34090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38774.log 2024-09-05T17:34:28.248 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35584.log.gz 2024-09-05T17:34:28.248 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34090.log.gz 2024-09-05T17:34:28.248 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30604.log.gz 2024-09-05T17:34:28.258 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2024-09-05T17:34:28.258 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38764.log 2024-09-05T17:34:28.258 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38774.log.gz 2024-09-05T17:34:28.258 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-09-05T17:34:28.258 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39738.log 2024-09-05T17:34:28.258 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38970.log 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38764.log.gz 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39738.log.gz 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38286.log 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38970.log.gz 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32218.log 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38286.log.gz 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38000.log 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32218.log.gz 2024-09-05T17:34:28.259 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26423.log 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32718.log 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38000.log.gz 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.26423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26423.log.gz 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35026.log 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32191.log 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32718.log.gz 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35026.log.gz 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31661.log 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30291.log 2024-09-05T17:34:28.260 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32191.log.gz 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31661.log.gz 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38334.log 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34486.log 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30291.log.gz 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38334.log.gz 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37417.log 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31634.log 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34486.log.gz 2024-09-05T17:34:28.261 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37417.log.gz 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32577.log 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31634.log.gz 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30500.log 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35981.log 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32577.log.gz 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30111.log 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30500.log.gz 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35981.log.gz 2024-09-05T17:34:28.262 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2024-09-05T17:34:28.263 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31721.log 2024-09-05T17:34:28.263 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30111.log.gz 2024-09-05T17:34:28.297 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26318.log 2024-09-05T17:34:28.297 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26270.log 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26318.log.gz 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26366.log 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26270.log.gz 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.26366.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31464.log 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26366.log.gz 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/objectstore_tool.31464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26390.log 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26414.log 2024-09-05T17:34:28.298 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26342.log 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26390.log.gz 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26438.log 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26414.log.gz 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26342.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26342.log.gz 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr: 94.5% -- replaced with /var/log/ceph/objectstore_tool.31464.log.gz 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26438.log.gz 2024-09-05T17:34:28.299 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-05T17:34:28.300 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26294.log 2024-09-05T17:34:28.300 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-05T17:34:28.300 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26294.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-05T17:34:28.300 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26294.log.gz 2024-09-05T17:34:28.300 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31676.log 2024-09-05T17:34:28.300 INFO:teuthology.orchestra.run.smithi110.stderr: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-05T17:34:28.300 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-05T17:34:28.300 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31248.log 2024-09-05T17:34:28.301 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/objectstore_tool.31676.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.32432.log 2024-09-05T17:34:28.301 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/objectstore_tool.31248.log: 94.8% -- replaced with /var/log/ceph/objectstore_tool.31248.log.gz 2024-09-05T17:34:28.303 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/objectstore_tool.32432.log: 95.1% -- replaced with /var/log/ceph/objectstore_tool.31676.log.gz 2024-09-05T17:34:28.303 INFO:teuthology.orchestra.run.smithi110.stderr: 95.2% -- replaced with /var/log/ceph/objectstore_tool.32432.log.gz 2024-09-05T17:34:28.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-05T17:34:28.375 INFO:teuthology.orchestra.run.smithi110.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-05T17:34:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39452.log 2024-09-05T17:34:28.382 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2024-09-05T17:34:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32717.log 2024-09-05T17:34:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31721.log.gz 2024-09-05T17:34:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39452.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.33740.log 2024-09-05T17:34:28.382 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39452.log.gz 2024-09-05T17:34:28.382 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30578.log 2024-09-05T17:34:28.382 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32717.log.gz 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38765.log 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33740.log.gz 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33492.log 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30578.log.gz 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38765.log.gzgzip 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36183.log 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35836.log 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33492.log.gz 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36183.log.gz 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2024-09-05T17:34:28.383 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36271.log 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35836.log.gz 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39582.log 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26176.log 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36271.log.gz 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33143.log 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39582.log.gz 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:gzip/var/log/ceph/ceph-client.admin.26176.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31608.log 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26176.log.gz 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33143.log.gz 2024-09-05T17:34:28.384 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38490.log 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39634.log 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31608.log.gz 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38985.log 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38490.log.gz 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39634.log.gz 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38464.log 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30783.log 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38985.log.gz 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38464.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38464.log.gz 2024-09-05T17:34:28.385 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34612.log 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33866.log 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30783.log.gz 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39177.log 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34612.log.gz 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31057.log 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33866.log.gz 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30303.log 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39177.log.gz 2024-09-05T17:34:28.386 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36693.log 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31057.log.gz 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30303.log.gz 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33653.log 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39504.log 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36693.log.gz 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38199.log 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33653.log.gz 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38954.log 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39504.log.gz 2024-09-05T17:34:28.387 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37134.log 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38199.log.gz 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34773.log 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38954.log.gz 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37134.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37134.log.gz 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38986.log 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34773.log.gz 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34532.log 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35669.log 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38986.log.gz 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34532.log.gz 2024-09-05T17:34:28.388 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39374.log 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35669.log.gz 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39374.log.gz 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31001.log 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36966.log 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31691.log 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31001.log.gz 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39660.log 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36966.log.gz 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29935.log 2024-09-05T17:34:28.389 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31691.log.gz 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39660.log.gz 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39166.log 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32534.log 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.29935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29935.log.gz 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39166.log.gz 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30103.log 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32534.log.gz 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36560.log/var/log/ceph/ceph-client.admin.30103.log: 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30103.log.gz 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35374.log 2024-09-05T17:34:28.390 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.36560.log: -- /var/log/ceph/ceph-mon.a.log 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36560.log.gz 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35374.log.gz 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26323.log 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30708.log 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.26323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26323.log.gz 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30107.log 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38438.log 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30708.log: /var/log/ceph/ceph-client.admin.30107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30708.log.gz 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30107.log.gz 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38568.log 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32619.log 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38438.log.gz 2024-09-05T17:34:28.391 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39920.log 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38568.log.gz 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32619.log.gz 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31029.log 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39920.log: /var/log/ceph/ceph-client.admin.31029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39920.log.gz 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31029.log.gz 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30526.log 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32464.log 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36526.log: /var/log/ceph/ceph-client.admin.30526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30526.log.gz 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35192.log 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31854.log 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32464.log.gz 2024-09-05T17:34:28.392 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38724.log 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35192.log.gz 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31854.log.gz 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30630.log 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29848.log 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38724.log.gz 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30630.log.gz 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30973.log 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.29848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29848.log.gz 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36091.log 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36245.log 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30973.log.gz 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31582.log 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36091.log.gz 2024-09-05T17:34:28.393 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36245.log.gz 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39790.log 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39764.log 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31582.log.gz 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39790.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.39790.log.gz /var/log/ceph/ceph-client.admin.39686.log 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39764.log.gz 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37393.log 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35535.log 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39686.log.gz 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37393.log.gz 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35797.log 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31398.log 2024-09-05T17:34:28.394 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35535.log: 0.0%/var/log/ceph/ceph-client.admin.35797.log: -- replaced with /var/log/ceph/ceph-client.admin.35535.log.gz 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33648.log 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35797.log.gz 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37872.log 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31398.log.gz 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33648.log.gz 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31979.log 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35723.log 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37872.log.gz 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31979.log.gz 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38084.log 2024-09-05T17:34:28.395 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36492.log 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35723.log: /var/log/ceph/ceph-client.admin.38084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35723.log.gz 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30306.log 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38084.log.gz 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36492.log.gz 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32904.log 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37096.log 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30306.log.gz 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32904.log.gz 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40050.log 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30313.log 2024-09-05T17:34:28.396 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37096.log: /var/log/ceph/ceph-client.admin.40050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37096.log.gz 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.36750.log -- replaced with /var/log/ceph/ceph-client.admin.40050.log.gz 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30313.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.38412.log 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30313.log.gz 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37331.log/var/log/ceph/ceph-client.admin.36750.log: 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36750.log.gz 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38412.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37331.log.gz 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32058.log 2024-09-05T17:34:28.397 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31945.log 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.32058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32058.log.gz 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35167.log 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37492.log 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31945.log.gz 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35167.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35167.log.gz 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34645.log 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37492.log.gz 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37760.log 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30109.log 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34645.log.gz 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39178.log 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37760.log.gz 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30109.log.gz 2024-09-05T17:34:28.398 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36152.log 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40024.log 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39178.log.gz 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36152.log.gz 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38620.log 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34453.log 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40024.log.gz 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38620.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38620.log.gz -5 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39170.log 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34453.log.gz 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39382.log 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38542.log 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39170.log: /var/log/ceph/ceph-client.admin.39382.log: 25.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31468.log 2024-09-05T17:34:28.399 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39382.log.gz 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39170.log.gz 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38542.log.gz 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30780.log 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37541.log 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31468.log.gz 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30780.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30780.log.gz 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37541.log.gz 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38974.log 2024-09-05T17:34:28.400 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36613.log 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.38974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35030.log 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38974.log.gz 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36613.log.gz 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36314.log 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30112.log 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35030.log: /var/log/ceph/ceph-client.admin.36314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35030.log.gz 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33147.log 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36314.log.gz 2024-09-05T17:34:28.401 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37579.log 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30112.log.gz 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36448.log 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33147.log.gz 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31308.log 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37579.log: /var/log/ceph/ceph-client.admin.36448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37579.log.gz 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36448.log.gz 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32492.log 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31308.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39894.log 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31308.log.gz 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35401.log 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32492.log.gz 2024-09-05T17:34:28.402 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33420.log 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39894.log.gz 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38778.log 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35401.log.gz/var/log/ceph/ceph-client.admin.33420.log: 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30656.log 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33420.log.gz 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38778.log.gz 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30108.log 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30656.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37735.log 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30656.log.gz 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36423.log 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30108.log.gz 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34238.log 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37735.log.gz 2024-09-05T17:34:28.403 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31131.log 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36423.log.gz 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34238.log.gz 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38965.log 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35469.log 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31131.log.gz 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31541.log 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38965.log.gz 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35102.log 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35469.log.gz 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30058.log 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31541.log: /var/log/ceph/ceph-client.admin.35102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36618.log 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31541.log.gz 2024-09-05T17:34:28.404 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35102.log.gz 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30058.log.gz 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30682.log 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34271.log 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36618.log: /var/log/ceph/ceph-client.admin.30682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30423.log 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36618.log.gz 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30682.log.gz 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34271.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.34271.log.gz --verbose 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr: -- /var/log/ceph/ceph-client.admin.34705.log 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33957.log 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30423.log.gz 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34705.log.gz 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30299.log 2024-09-05T17:34:28.405 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36368.log 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33957.log: /var/log/ceph/ceph-client.admin.30299.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37237.log 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33957.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30299.log.gz 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36368.log.gz 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35610.log 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37237.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37237.log.gz -5 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph.log 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38594.log 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35610.log.gz 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34985.log 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38594.log.gz 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30032.log 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30106.log 2024-09-05T17:34:28.406 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34985.log.gz 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30032.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30032.log.gz 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30106.log.gz 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33428.log 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35266.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz -5 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39222.log 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31472.log 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33428.log.gz 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29960.log 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39222.log.gz 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29910.log 2024-09-05T17:34:28.407 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31472.log.gz 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.29960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29960.log.gz 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36058.log 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.29910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32648.log 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29910.log.gz 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30738.log 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36058.log.gz 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35278.log 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32648.log.gz 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40077.log 2024-09-05T17:34:28.408 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30738.log: 0.0%/var/log/ceph/ceph-client.admin.35278.log: -- replaced with /var/log/ceph/ceph-client.admin.30738.log.gz 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35278.log.gz 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35428.log 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40077.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40077.log.gz 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35428.log.gz 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30098.log 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30552.log 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33908.log 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30098.log.gz 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30552.log.gz 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34298.log 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33908.log.gz 2024-09-05T17:34:28.409 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34298.log.gz 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32430.log 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34007.log 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37203.log: /var/log/ceph/ceph-client.admin.32430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32430.log.gz 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39868.log 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34882.log 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34007.log: /var/log/ceph/ceph-client.admin.39868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34007.log.gz 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39868.log.gz 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34196.log 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29980.log 2024-09-05T17:34:28.410 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34882.log: /var/log/ceph/ceph-client.admin.34196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34882.log.gz 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34196.log.gz 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34384.log 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34558.log 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.29980.log: /var/log/ceph/ceph-client.admin.34384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29980.log.gz 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34384.log.gz 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39202.log 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34558.log: /var/log/ceph/ceph-client.admin.32389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34558.log.gz 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gz 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38983.log 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31824.log 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39202.log.gz 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38983.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38255.log 2024-09-05T17:34:28.411 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31824.log.gz 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39946.log 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38255.log.gz 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39998.log 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39946.log.gz 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38698.log 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39998.log.gz 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30944.log 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr: 93.8%/var/log/ceph/ceph-client.admin.38698.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38698.log.gz 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31182.log 2024-09-05T17:34:28.412 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30944.log: /var/log/ceph/ceph-client.admin.33093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30944.log.gz 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39478.log 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30916.log 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31182.log: /var/log/ceph/ceph-client.admin.39478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31182.log.gz 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39478.log.gz 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37682.log 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39224.log 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30916.log: /var/log/ceph/ceph-client.admin.37682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30916.log.gz 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37682.log.gz 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38283.log 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38773.log 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0%/var/log/ceph/ceph-client.admin.38283.log: -- replaced with /var/log/ceph/ceph-client.admin.39224.log.gz 2024-09-05T17:34:28.413 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38283.log.gz 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31281.log 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34114.log 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38773.log: /var/log/ceph/ceph-client.admin.31281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38773.log.gz 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31281.log.gz 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39842.log 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39223.log 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34114.log: /var/log/ceph/ceph-client.admin.39842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34114.log.gz 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39842.log.gz 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33809.log 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31464.log 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39223.log: /var/log/ceph/ceph-client.admin.33809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39223.log.gz 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33809.log.gz 2024-09-05T17:34:28.414 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39972.log 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37053.log 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31464.log: /var/log/ceph/ceph-client.admin.39972.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39972.log.gz 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31464.log.gz 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32324.log 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33284.log 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37053.log: /var/log/ceph/ceph-client.admin.32324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37053.log.gz 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32324.log.gz 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31097.log 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33284.log: /var/log/ceph/ceph-client.admin.31097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33284.log.gz 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31097.log.gz 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39712.log 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33206.log 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2024-09-05T17:34:28.415 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39712.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39608.log 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33206.log.gz 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34801.log 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38777.log 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39608.log: /var/log/ceph/ceph-client.admin.34801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39608.log.gz 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34801.log.gz 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32987.log 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36847.log 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38777.log.gz 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32987.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32113.log 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36847.log.gz 2024-09-05T17:34:28.416 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21384.log 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33570.log 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32113.log: /var/log/ceph/ceph.tmp-client.admin.21384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32113.log.gz 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21384.log.gz 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34827.log 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38775.log 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33570.log.gz 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34827.log.gz 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39556.log 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38775.log.gz 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38028.log 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38672.log 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39556.log: /var/log/ceph/ceph-client.admin.38028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39556.log.gz 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38028.log.gz 2024-09-05T17:34:28.417 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34006.log 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33699.log 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38672.log.gz 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34006.log.gzgzip 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31244.log 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33699.log.gz 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38969.log 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39816.log 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31244.log: /var/log/ceph/ceph-client.admin.38969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31244.log.gz 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38969.log.gz 2024-09-05T17:34:28.418 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38125.log 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37880.log 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39816.log: /var/log/ceph/ceph-client.admin.38125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39816.log.gz 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38125.log.gz 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30314.log 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38386.log 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37880.log: /var/log/ceph/ceph-client.admin.30314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37880.log.gz 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30314.log.gz 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33052.log 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31357.log 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38386.log.gz 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33052.log.gz 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37282.log 2024-09-05T17:34:28.419 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31357.log.gz 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39530.log 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32844.log 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37282.log.gz 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39530.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33325.log 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.32844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32844.log.gz 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30295.log 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37628.log 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.33325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33325.log.gz 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30295.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37628.log.gz 2024-09-05T17:34:28.420 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38771.log 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37943.log 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gz 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38771.log.gz 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30867.log 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.37943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37943.log.gz 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35951.log 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38223.log 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30867.log.gz 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35951.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35279.log 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38223.log.gz 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34739.log 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39378.log 2024-09-05T17:34:28.421 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.35279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35279.log.gz 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34562.log 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34739.log.gz 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.39378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39378.log.gz 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33537.log 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38516.log 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.34562.log: /var/log/ceph/ceph-client.admin.33537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34562.log.gz 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33537.log.gz 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31984.log 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30006.log 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38516.log: /var/log/ceph/ceph-client.admin.31984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38516.log.gz 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31984.log.gz 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30771.log 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30006.log: /var/log/ceph/ceph-client.admin.32088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30006.log.gz 2024-09-05T17:34:28.422 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz 2024-09-05T17:34:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32274.log 2024-09-05T17:34:28.423 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31766.log 2024-09-05T17:34:28.423 INFO:teuthology.orchestra.run.smithi110.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.0.30771.log: /var/log/ceph/ceph-client.admin.32274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32274.log.gz 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.30771.log.gz 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36792.log 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40101.log 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31766.log.gz 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.36792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36792.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31899.log 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.40101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40101.log.gz 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32805.log 2024-09-05T17:34:28.427 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38360.log 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.31899.log: /var/log/ceph/ceph-client.admin.32805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31899.log.gz 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32805.log.gz 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30782.log 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.38360.log: /var/log/ceph/ceph-client.admin.36944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38360.log.gz 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33355.log 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr:/var/log/ceph/ceph-client.admin.30782.log: /var/log/ceph/ceph-client.admin.33355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30782.log.gz 2024-09-05T17:34:28.428 INFO:teuthology.orchestra.run.smithi050.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33355.log.gz 2024-09-05T17:34:28.491 INFO:teuthology.orchestra.run.smithi050.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-05T17:34:28.582 INFO:teuthology.orchestra.run.smithi050.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-05T17:34:28.771 INFO:teuthology.orchestra.run.smithi050.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-05T17:34:29.803 INFO:teuthology.orchestra.run.smithi110.stderr: 95.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-05T17:34:30.014 INFO:teuthology.orchestra.run.smithi110.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-05T17:34:30.324 INFO:teuthology.orchestra.run.smithi110.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-05T17:34:30.975 INFO:teuthology.orchestra.run.smithi050.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-05T17:34:31.021 INFO:teuthology.orchestra.run.smithi050.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-05T17:34:31.827 INFO:teuthology.orchestra.run.smithi110.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-05T17:34:31.828 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-05T17:34:31.828 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m3.561s 2024-09-05T17:34:31.828 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m8.699s 2024-09-05T17:34:31.828 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.384s 2024-09-05T17:34:31.932 INFO:teuthology.orchestra.run.smithi050.stderr: 95.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-05T17:34:31.933 INFO:teuthology.orchestra.run.smithi050.stderr: 2024-09-05T17:34:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:real 0m3.709s 2024-09-05T17:34:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:user 0m9.992s 2024-09-05T17:34:31.934 INFO:teuthology.orchestra.run.smithi050.stderr:sys 0m0.367s 2024-09-05T17:34:31.934 INFO:tasks.ceph:Archiving logs... 2024-09-05T17:34:31.934 DEBUG:teuthology.misc:Transferring archived files from smithi050:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/remote/smithi050/log 2024-09-05T17:34:31.935 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T17:34:33.147 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/remote/smithi110/log 2024-09-05T17:34:33.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T17:34:34.069 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-05T17:34:34.077 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-05T17:34:34.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T17:34:34.080 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T17:34:34.155 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-05T17:34:34.163 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-05T17:34:34.164 DEBUG:teuthology.orchestra.run.smithi050:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T17:34:34.166 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T17:34:34.177 INFO:teuthology.orchestra.run.smithi050.stdout: remote refid st t when poll reach delay offset jitter 2024-09-05T17:34:34.177 INFO:teuthology.orchestra.run.smithi050.stdout:============================================================================== 2024-09-05T17:34:34.177 INFO:teuthology.orchestra.run.smithi050.stdout:+hv01.front.sepi 67.205.162.81 3 u 19 64 177 0.096 -4.923 3.142 2024-09-05T17:34:34.178 INFO:teuthology.orchestra.run.smithi050.stdout:+hv02.front.sepi 63.231.80.2 3 u 22 64 177 0.084 +0.527 2.178 2024-09-05T17:34:34.178 INFO:teuthology.orchestra.run.smithi050.stdout:*hv03.front.sepi 74.6.168.72 3 u 24 64 177 0.141 -0.836 2.180 2024-09-05T17:34:34.178 INFO:teuthology.orchestra.run.smithi050.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:34:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-09-05T17:34:34.180 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-09-05T17:34:34.180 INFO:teuthology.orchestra.run.smithi110.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 177 0.096 -0.816 0.718 2024-09-05T17:34:34.180 INFO:teuthology.orchestra.run.smithi110.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 177 0.081 -0.227 0.914 2024-09-05T17:34:34.180 INFO:teuthology.orchestra.run.smithi110.stdout:*hv03.front.sepi 74.6.168.72 3 u 26 64 177 0.074 -0.539 0.721 2024-09-05T17:34:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-05T17:34:34.180 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-05T17:34:34.188 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-05T17:34:34.189 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-05T17:34:34.201 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-05T17:34:34.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-05T17:34:34.219 INFO:teuthology.task.internal:Duration was 882.304916 seconds 2024-09-05T17:34:34.220 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-05T17:34:34.229 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-05T17:34:34.229 DEBUG:teuthology.orchestra.run.smithi050:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T17:34:34.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T17:34:34.269 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-05T17:34:34.269 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi050.front.sepia.ceph.com 2024-09-05T17:34:34.269 DEBUG:teuthology.orchestra.run.smithi050:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T17:34:34.323 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-09-05T17:34:34.324 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T17:34:34.334 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-05T17:34:34.334 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T17:34:34.366 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T17:34:34.403 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-05T17:34:34.403 DEBUG:teuthology.orchestra.run.smithi050:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T17:34:34.438 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T17:34:34.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-05T17:34:34.523 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-05T17:34:34.524 DEBUG:teuthology.orchestra.run.smithi050:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T17:34:34.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T17:34:34.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-05T17:34:34.560 DEBUG:teuthology.orchestra.run.smithi050:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T17:34:34.583 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T17:34:34.591 INFO:teuthology.orchestra.run.smithi050.stdout:kernel.core_pattern = core 2024-09-05T17:34:34.607 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-09-05T17:34:34.626 DEBUG:teuthology.orchestra.run.smithi050:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T17:34:34.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:34:34.657 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T17:34:34.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T17:34:34.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-05T17:34:34.685 INFO:teuthology.task.internal:Transferring archived files... 2024-09-05T17:34:34.686 DEBUG:teuthology.misc:Transferring archived files from smithi050:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/remote/smithi050 2024-09-05T17:34:34.686 DEBUG:teuthology.orchestra.run.smithi050:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T17:34:34.733 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-03_20:16:17-rbd-main-distro-default-smithi/7888094/remote/smithi110 2024-09-05T17:34:34.733 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T17:34:34.753 INFO:teuthology.task.internal:Removing archive directory... 2024-09-05T17:34:34.753 DEBUG:teuthology.orchestra.run.smithi050:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T17:34:34.779 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T17:34:34.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-05T17:34:34.810 INFO:teuthology.task.internal:Not uploading archives. 2024-09-05T17:34:34.810 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-05T17:34:34.819 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-05T17:34:34.820 DEBUG:teuthology.orchestra.run.smithi050:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T17:34:34.830 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T17:34:34.834 INFO:teuthology.orchestra.run.smithi050.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 17:34 /home/ubuntu/cephtest 2024-09-05T17:34:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 17:34 /home/ubuntu/cephtest 2024-09-05T17:34:34.847 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-05T17:34:34.857 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-05T17:34:34.879 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writethrough} duration: 882.3049159049988 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-05T17:34:34.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T17:34:34.994 INFO:teuthology.run:pass